-- Logs begin at Mon 2022-06-27 08:39:54 UTC, end at Mon 2022-06-27 09:52:19 UTC. -- Jun 27 09:13:45.364340 dv-cinder-847730-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 27 09:13:45.373089 dv-cinder-847730-1-smb devstack@keystone.service[80293]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 27 09:13:45.375084 dv-cinder-847730-1-smb devstack@keystone.service[80293]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 27 09:13:45 2022] *** Jun 27 09:13:45.375084 dv-cinder-847730-1-smb devstack@keystone.service[80293]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 27 09:13:45.375084 dv-cinder-847730-1-smb devstack@keystone.service[80293]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 27 09:13:45.375084 dv-cinder-847730-1-smb devstack@keystone.service[80293]: nodename: dv-cinder-847730-1-smb Jun 27 09:13:45.375084 dv-cinder-847730-1-smb devstack@keystone.service[80293]: machine: x86_64 Jun 27 09:13:45.375084 dv-cinder-847730-1-smb devstack@keystone.service[80293]: clock source: unix Jun 27 09:13:45.375084 dv-cinder-847730-1-smb devstack@keystone.service[80293]: pcre jit disabled Jun 27 09:13:45.375084 dv-cinder-847730-1-smb devstack@keystone.service[80293]: detected number of CPU cores: 4 Jun 27 09:13:45.375084 dv-cinder-847730-1-smb devstack@keystone.service[80293]: current working directory: / Jun 27 09:13:45.375084 dv-cinder-847730-1-smb devstack@keystone.service[80293]: detected binary path: /usr/bin/uwsgi-core Jun 27 09:13:45.375655 dv-cinder-847730-1-smb devstack@keystone.service[80293]: your processes number limit is 47680 Jun 27 09:13:45.375655 dv-cinder-847730-1-smb devstack@keystone.service[80293]: your memory page size is 4096 bytes Jun 27 09:13:45.375655 dv-cinder-847730-1-smb devstack@keystone.service[80293]: detected max file descriptor number: 2048 Jun 27 09:13:45.375655 dv-cinder-847730-1-smb devstack@keystone.service[80293]: lock engine: pthread robust mutexes Jun 27 09:13:45.375655 dv-cinder-847730-1-smb devstack@keystone.service[80293]: thunder lock: enabled Jun 27 09:13:45.375655 dv-cinder-847730-1-smb devstack@keystone.service[80293]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 27 09:13:45.375655 dv-cinder-847730-1-smb devstack@keystone.service[80293]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 27 09:13:45.420833 dv-cinder-847730-1-smb devstack@keystone.service[80293]: Python main interpreter initialized at 0x55944803d9c0 Jun 27 09:13:45.420833 dv-cinder-847730-1-smb devstack@keystone.service[80293]: python threads support enabled Jun 27 09:13:45.420833 dv-cinder-847730-1-smb devstack@keystone.service[80293]: your server socket listen backlog is limited to 100 connections Jun 27 09:13:45.420833 dv-cinder-847730-1-smb devstack@keystone.service[80293]: your mercy for graceful operations on workers is 90 seconds Jun 27 09:13:45.421220 dv-cinder-847730-1-smb devstack@keystone.service[80293]: mapped 403077 bytes (393 KB) for 2 cores Jun 27 09:13:45.421304 dv-cinder-847730-1-smb devstack@keystone.service[80293]: *** Operational MODE: preforking *** Jun 27 09:13:45.421541 dv-cinder-847730-1-smb devstack@keystone.service[80293]: *** uWSGI is running in multiple interpreter mode *** Jun 27 09:13:45.421541 dv-cinder-847730-1-smb devstack@keystone.service[80293]: spawned uWSGI master process (pid: 80293) Jun 27 09:13:45.421755 dv-cinder-847730-1-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 27 09:13:45.422836 dv-cinder-847730-1-smb devstack@keystone.service[80293]: spawned uWSGI worker 1 (pid: 80306, cores: 1) Jun 27 09:13:45.422836 dv-cinder-847730-1-smb devstack@keystone.service[80293]: spawned uWSGI worker 2 (pid: 80307, cores: 1) Jun 27 09:13:45.422836 dv-cinder-847730-1-smb devstack@keystone.service[80293]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 27 09:13:50.936906 dv-cinder-847730-1-smb devstack@keystone.service[80307]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 09:13:50.936906 dv-cinder-847730-1-smb devstack@keystone.service[80307]: from cryptography.utils import int_from_bytes Jun 27 09:13:50.937718 dv-cinder-847730-1-smb devstack@keystone.service[80306]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 09:13:50.937718 dv-cinder-847730-1-smb devstack@keystone.service[80306]: from cryptography.utils import int_from_bytes Jun 27 09:13:50.938169 dv-cinder-847730-1-smb devstack@keystone.service[80307]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 09:13:50.938169 dv-cinder-847730-1-smb devstack@keystone.service[80307]: from cryptography.utils import int_from_bytes Jun 27 09:13:50.938279 dv-cinder-847730-1-smb devstack@keystone.service[80306]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 09:13:50.938279 dv-cinder-847730-1-smb devstack@keystone.service[80306]: from cryptography.utils import int_from_bytes Jun 27 09:13:50.986607 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 27 09:13:50.986773 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 27 09:13:50.986871 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 27 09:13:50.986952 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 27 09:13:50.987027 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] command line args: [] {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 27 09:13:50.987087 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] command line args: [] {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 27 09:13:50.987232 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 27 09:13:50.987332 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 27 09:13:50.987411 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ================================================================================ {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 27 09:13:50.987483 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ================================================================================ {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 27 09:13:50.987652 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] admin_token = **** {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.987746 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] admin_token = **** {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.987908 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] config_dir = [] {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.988007 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] config_dir = [] {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.988086 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.988165 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.988285 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] config_source = [] {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.988361 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] config_source = [] {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.988436 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] debug = True {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.988519 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] debug = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.988632 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.988893 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.988986 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.989056 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.989184 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.989271 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.990173 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.990310 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.990416 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.990506 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.990590 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] list_limit = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.990712 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] list_limit = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.990794 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] log_config_append = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.990865 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] log_config_append = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.990989 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.991072 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.991143 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] log_dir = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.991214 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] log_dir = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.991284 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] log_file = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.991404 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] log_file = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.991492 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.991564 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.991685 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.991762 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.991839 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.991909 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.992035 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.992120 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.992257 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.992347 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.992473 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.992550 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.992677 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.992759 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.992831 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.992901 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.992976 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.993101 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.993221 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.993297 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.993410 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.993492 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.993568 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.993690 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.993766 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.993887 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.993963 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.994028 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.994092 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.994260 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.994344 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.62/identity {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.994461 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.62/identity {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.994549 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] publish_errors = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.994611 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] publish_errors = False {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.994721 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.994801 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.994949 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.995037 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.995114 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.995182 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.995356 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.995450 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.995590 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.995667 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.995822 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] standard_threads = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.995907 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] standard_threads = False {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.996052 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.996138 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.996316 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.996406 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.996485 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.996554 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.996670 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] use_journal = False {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.996823 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] use_journal = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.996904 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] use_json = False {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.996984 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] use_json = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.997056 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] use_stderr = False {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.997130 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] use_stderr = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.997201 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] use_syslog = False {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.997281 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] use_syslog = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.997358 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.997434 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:13:50.997594 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:50.997674 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:50.997829 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:50.997917 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:50.998086 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:50.998164 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:50.998322 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:50.998408 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:50.998569 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:50.998655 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:50.998804 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:50.998881 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:50.999052 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:50.999131 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:50.999286 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:50.999371 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:50.999531 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:50.999607 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:50.999775 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:50.999852 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.000023 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.000112 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.000287 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.000369 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.000532 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.000620 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.000768 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.000864 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.001013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.001089 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.001257 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.001341 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.001501 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.001628 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.001739 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.001818 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.001991 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.002067 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.002234 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.002388 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.002461 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.002529 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.002708 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.002787 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.002964 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.003049 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.003216 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.003294 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.003461 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.003538 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.003689 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.003772 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.003915 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.003992 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.004139 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.004241 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.004398 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.004478 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.004644 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.004720 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.004887 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.004964 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.005113 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.005191 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.005340 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.005417 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.005582 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.005659 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.005827 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.005906 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.006061 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.006138 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.006305 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.006391 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.006531 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.006610 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.007613 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.007709 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.007709 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.007939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.008065 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.008182 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.008368 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.008486 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.009098 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.009213 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.009341 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.009464 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.009593 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.009711 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.009827 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.009931 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.010045 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.010169 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.010292 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.010414 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.010530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.010642 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.010757 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.010880 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.011003 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.011119 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.011240 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.011357 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.011472 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.011596 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.011713 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.011835 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.011940 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.012060 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.012177 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.012322 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.012440 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.012556 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.012672 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.012790 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.012911 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.013045 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.013169 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.013285 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.013400 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.013521 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.013637 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.014070 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.014198 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.014316 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.014445 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.014563 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.014678 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.014802 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.014920 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.015036 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.015152 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.015267 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.015381 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.015572 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.015692 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.015808 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.015926 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.016050 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.016173 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.016323 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.016442 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.016557 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.016672 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.016787 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.016902 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.017033 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.017158 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.017283 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.017407 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.017523 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.017638 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.017753 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.017869 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.017994 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.018107 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.018222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.018338 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.018453 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.018568 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.018692 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.018814 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.018936 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.019060 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.019182 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.019303 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.019427 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.019544 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.019659 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.019782 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.019904 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.020031 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.020148 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.020283 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.020399 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.020525 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.020642 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.020769 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.020897 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.021014 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.021130 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.021245 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.021359 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.021483 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.021599 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.021714 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.021829 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.021944 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.022059 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.022182 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.022304 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.022421 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.022536 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.022650 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.022821 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.022989 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.023110 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.023226 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.023341 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.023456 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.023571 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.023695 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.023812 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.023927 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.024042 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.024187 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.024875 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.024989 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] auth.external = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.025113 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] auth.external = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.025230 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.025347 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.025469 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.025613 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.025741 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.025859 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.025984 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] auth.password = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.026102 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] auth.password = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.026218 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] auth.token = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.026333 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] auth.token = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.026451 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.026567 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.026692 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.026810 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.026926 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.027042 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.027158 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.027273 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.027397 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.027517 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.027634 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.027750 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.027866 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.027981 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.028105 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] credential.caching = True {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.028267 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] credential.caching = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.028388 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.028506 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.028622 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.028739 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.028869 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.028988 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.029108 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.029226 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.029342 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.029457 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.029586 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.029704 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.030071 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.030200 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.030323 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.030440 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.030634 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.030755 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.030872 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.030988 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.031104 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.031226 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.031352 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.031475 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.031599 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.031717 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.031832 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.031948 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.032081 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.032224 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.032357 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] federation.caching = True {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.032483 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] federation.caching = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.032601 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.032718 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.032843 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.032960 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.033083 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.033200 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.033316 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.033431 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.033556 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.033674 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.033792 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.033908 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.034024 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.034148 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.034267 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.034383 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.034499 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.034615 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.034731 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.034857 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.034975 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.035091 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.035207 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] identity.caching = True {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.035322 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] identity.caching = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.035438 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.035562 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.035681 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.035797 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.035914 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.036030 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.036148 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.036343 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.036463 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.036579 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.036695 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.036811 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.036928 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.037056 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.037174 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.037290 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.037389 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.037503 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.037620 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.037744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.037861 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.037978 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.038094 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.038209 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.038325 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.038449 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.038567 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.038683 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.038798 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.038914 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.039035 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.039162 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.039280 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.039397 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.039513 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.039645 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.039825 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.039955 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.040074 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.040190 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.040328 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.040444 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.040561 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.040690 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.040809 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.040925 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.041041 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.041164 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.041290 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.041416 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.041533 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.041649 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.041765 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.041880 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.041996 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.042122 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.042240 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.042355 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.042471 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.042586 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.042702 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.042826 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.042944 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.043060 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.043177 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.043292 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.043408 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.043533 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.043657 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.043775 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.043891 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.044007 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.044122 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.044264 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.044385 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.044501 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.044624 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.044741 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.044857 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.044981 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.045089 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.045186 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.045284 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.045400 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.045516 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.045641 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.045759 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.045875 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.045991 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.046106 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.046231 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.046350 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.046466 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.046582 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.046699 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.046814 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.046939 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.047056 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.047184 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.047302 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.047419 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ldap.user = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.047518 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.user = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.047642 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.047760 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.047876 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.047876 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.048094 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.048094 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.048357 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.048477 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.048593 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.048708 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.048828 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.048828 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.049054 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.049172 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.049288 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.049403 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.049520 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.049636 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.049760 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.049878 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.049994 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.050109 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.050225 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.050225 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.050450 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.050569 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.050685 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.050800 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.050915 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.051031 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.051158 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.051276 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.051392 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.051392 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.051610 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.051725 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.051849 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.051966 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.052082 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.052216 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.052335 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.052451 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.052579 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.052697 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.052813 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.052928 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.053044 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.053044 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.053406 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.053406 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.053635 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.053635 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.053853 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.053853 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.054082 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.054082 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.054301 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.054301 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.054568 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.054690 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.054817 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.054935 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.055051 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.055051 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.055269 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.055385 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.055511 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.055511 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.055731 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.055847 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.055963 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.056078 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] resource.caching = True {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.056252 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.056252 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] resource.caching = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.056476 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.056592 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.056708 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.056708 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.056941 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.057059 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.057175 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.057290 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.057406 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.057522 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.057650 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.057769 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.057886 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.058001 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.058139 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.058255 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.058380 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.058497 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] role.caching = True {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.058613 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.058733 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] role.driver = sql {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.058849 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] role.caching = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.058966 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.059091 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] role.driver = sql {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.059209 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.059324 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.059439 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.059555 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.059679 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.059797 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.059913 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.060030 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.060145 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.060276 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.060405 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.060523 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.060640 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.060756 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.060871 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.060989 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.061114 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.061231 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.061347 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.061463 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.061578 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.061694 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.061818 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.061935 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.062053 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.062170 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.062170 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.062387 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.062387 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.062615 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.062731 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.062847 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.062962 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.063079 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.063203 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.063321 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.063437 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.063552 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.063668 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.063783 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.063908 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.064025 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.064142 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.064386 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.064505 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.064633 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.064752 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.064868 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.064984 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.065100 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.065217 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.065341 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.065459 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.065575 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.065691 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.065807 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.065922 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.066047 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.066171 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.066290 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.066407 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.066522 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.066638 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.066762 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.066880 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] token.caching = True {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.066996 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.067112 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.067227 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] token.caching = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.067344 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.067468 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.067586 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.067701 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.067816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.067932 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.068048 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.068172 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.068307 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.068425 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.068544 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.068662 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.068778 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.068905 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.069024 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.069140 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.069256 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.069372 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.069488 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.069611 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.069728 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.069844 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.069959 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.070075 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.070190 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.070314 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.070432 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.070548 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.070664 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.070779 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.070894 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.071524 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.071646 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] database.connection = **** {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.071771 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.071897 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.072015 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] database.connection = **** {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.072171 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.072337 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.072457 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.072574 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.072767 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.072888 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.073003 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.073119 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.073235 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.073350 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.073475 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.073594 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.073710 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.073826 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.073942 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.074059 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.074183 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.074302 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.074417 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.074534 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.074651 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.074767 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.074892 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.075010 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.075127 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.075243 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.075360 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.075477 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.075603 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.075723 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.075840 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.075957 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.076074 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.076190 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.076341 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 27 09:13:51.076461 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:13:51.076461 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 27 09:13:51.102981 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.103211 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.103445 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.103561 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.103674 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.103888 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.112189 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.112598 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.140697 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.140924 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.141255 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.141487 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.283313 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.284314 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.333717 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.333941 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.334984 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.335224 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.399419 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.399608 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.399690 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.399819 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.399925 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.400069 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.400235 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.400368 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.400455 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.400535 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.400629 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.400708 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.425820 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.426026 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.426122 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.426224 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.426305 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.426381 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.426455 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.426529 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.426644 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.426731 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.426854 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.426938 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.427066 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.427158 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.438841 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.439053 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.452022 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.452275 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.452365 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.452502 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.452588 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.452719 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.452801 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.452933 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.453025 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.453145 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.453228 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.453356 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.453437 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.453564 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 09:13:51.470686 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.470891 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 27 09:13:51.471228 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.471310 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.471427 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 27 09:13:51.471531 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 27 09:13:51.471696 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.471810 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.471955 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.472035 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 27 09:13:51.472227 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.472311 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.472489 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.472568 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.472772 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.473026 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.483425 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.483697 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.483965 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.484048 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.484264 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.484366 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.484536 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.484813 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.493860 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 09:13:51.494425 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 09:13:51.497485 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 09:13:51.497767 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.497923 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 09:13:51.498049 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.498201 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.498330 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.498482 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.498613 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.498760 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.498871 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.499039 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.499131 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.499297 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.499458 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.499562 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.499726 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.499821 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.500000 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.500082 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.500289 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.500374 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.500645 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.527306 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.527611 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.529391 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 09:13:51.529391 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.529616 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 09:13:51.529616 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.534822 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 09:13:51.535061 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 09:13:51.535148 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.535419 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.535513 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.535712 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.543308 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 09:13:51.543578 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 09:13:51.543697 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.543850 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.548121 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 09:13:51.548423 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.548511 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 09:13:51.548704 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.548786 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.548985 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.549071 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.549259 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.549340 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.549530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.549621 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.549793 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.549873 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.550056 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.550135 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.550318 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.569377 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.569652 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.569747 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.569923 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.574425 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 09:13:51.574574 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 09:13:51.578118 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.578256 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.578509 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.578650 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.583556 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 09:13:51.583698 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 09:13:51.587258 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 09:13:51.587359 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 09:13:51.590952 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.591079 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.591249 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.591344 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.591533 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.591624 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.591814 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.591897 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.592088 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.592169 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.592386 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.592470 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.611985 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 09:13:51.612106 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 09:13:51.612292 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.612415 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.612564 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.612649 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.612834 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.612918 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.621309 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.621442 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.623009 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.623097 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.623282 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.623368 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.626561 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 09:13:51.626681 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 09:13:51.626834 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.626919 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.627105 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.627187 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.627389 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.627473 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.627662 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.627746 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.641098 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 09:13:51.641219 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 09:13:51.641370 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.641458 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.641652 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.641735 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.641929 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.642013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.643593 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.643678 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.643880 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.643972 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.644170 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.644323 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.662435 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 09:13:51.662542 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 09:13:51.666322 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 09:13:51.666444 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 09:13:51.669658 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.669745 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.671386 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.671470 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.673051 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 09:13:51.673151 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 09:13:51.673320 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.673405 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.673594 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.673729 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.681509 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.681611 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.683134 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 09:13:51.683275 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 09:13:51.686401 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.686547 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.686682 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.686777 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.687066 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.687181 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.687333 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.687417 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.696508 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 09:13:51.696607 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 09:13:51.696786 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.696870 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.697062 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.697146 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.704963 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 09:13:51.705068 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 09:13:51.705233 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.705319 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.705505 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.705598 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.705776 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.705872 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.706043 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.706126 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.706408 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.706493 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.706688 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.706770 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.706956 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.707039 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.707222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.707304 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.707488 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.707572 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.707755 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.707836 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.708024 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.708182 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.708311 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.708393 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.708578 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.708660 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 09:13:51.747606 dv-cinder-847730-1-smb devstack@keystone.service[80307]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55944803d9c0 pid: 80307 (default app) Jun 27 09:13:51.747842 dv-cinder-847730-1-smb devstack@keystone.service[80306]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55944803d9c0 pid: 80306 (default app) Jun 27 09:13:51.751035 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f8b3a-2006-4c88-ae65-a55a0af4c8d7 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:13:51.751338 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f8b3a-2006-4c88-ae65-a55a0af4c8d7 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:13:51.751613 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f8b3a-2006-4c88-ae65-a55a0af4c8d7 None None] PATH_INFO: `/v3` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:13:51.755785 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1/1] 10.222.0.62 () {50 vars in 791 bytes} [Mon Jun 27 09:13:51 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:00.352565 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12438cb-3402-41b3-8427-fb465842bd6b None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:00.353162 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12438cb-3402-41b3-8427-fb465842bd6b None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:00.353162 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12438cb-3402-41b3-8427-fb465842bd6b None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:00.357521 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1/2] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 09:14:00.363342 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148b383-d010-4c26-8212-43b4b54002f5 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:00.363776 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148b383-d010-4c26-8212-43b4b54002f5 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:00.363869 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148b383-d010-4c26-8212-43b4b54002f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:00.433377 dv-cinder-847730-1-smb devstack@keystone.service[80307]: INFO dbcounter [None req-6148b383-d010-4c26-8212-43b4b54002f5 None None] Registered counter for database keystone Jun 27 09:14:00.455058 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG oslo_db.sqlalchemy.engines [None req-6148b383-d010-4c26-8212-43b4b54002f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80307) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 09:14:00.461275 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writer thread running {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 09:14:00.641709 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG passlib.handlers.bcrypt [None req-6148b383-d010-4c26-8212-43b4b54002f5 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80307) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 27 09:14:00.642035 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG passlib.handlers.bcrypt [None req-6148b383-d010-4c26-8212-43b4b54002f5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80307) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 27 09:14:00.698145 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-6148b383-d010-4c26-8212-43b4b54002f5 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:00.699744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-6148b383-d010-4c26-8212-43b4b54002f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:00.838665 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 2/3] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 476 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 27 09:14:01.005522 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12438cb-3402-41b3-8427-fb465842bd6b None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:01.081578 dv-cinder-847730-1-smb devstack@keystone.service[80306]: INFO dbcounter [None req-e12438cb-3402-41b3-8427-fb465842bd6b None None] Registered counter for database keystone Jun 27 09:14:01.103443 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG oslo_db.sqlalchemy.engines [None req-e12438cb-3402-41b3-8427-fb465842bd6b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80306) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 09:14:01.110774 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writer thread running {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 09:14:01.230541 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12438cb-3402-41b3-8427-fb465842bd6b None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:01.234901 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923c232-d87b-45be-ad8c-34993ad618a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:01.235564 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923c232-d87b-45be-ad8c-34993ad618a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:01.235851 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923c232-d87b-45be-ad8c-34993ad618a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:01.236133 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923c232-d87b-45be-ad8c-34993ad618a6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:01.244313 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5923c232-d87b-45be-ad8c-34993ad618a6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:01.296469 dv-cinder-847730-1-smb devstack@keystone.service[80306]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5923c232-d87b-45be-ad8c-34993ad618a6 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 27 09:14:01.296805 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5923c232-d87b-45be-ad8c-34993ad618a6 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:01.306874 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 2/4] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Jun 27 09:14:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 09:14:01.312830 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6148b383-d010-4c26-8212-43b4b54002f5 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:01.327672 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6148b383-d010-4c26-8212-43b4b54002f5 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:01.332174 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a58949-aea6-424d-be67-12f2e2cfe202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:01.333342 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a58949-aea6-424d-be67-12f2e2cfe202 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:01.333628 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a58949-aea6-424d-be67-12f2e2cfe202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:01.333905 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a58949-aea6-424d-be67-12f2e2cfe202 admin admin] PATH_INFO: `/v3/projects/22d0a8f6bf9e4c98ba20a328083165ac` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:01.338557 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a58949-aea6-424d-be67-12f2e2cfe202 admin admin] RBAC: Authorizing `identity:get_project(project_id=22d0a8f6bf9e4c98ba20a328083165ac)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:01.388648 dv-cinder-847730-1-smb devstack@keystone.service[80307]: WARNING keystone.common.rbac_enforcer.enforcer [None req-65a58949-aea6-424d-be67-12f2e2cfe202 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 27 09:14:01.389295 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a58949-aea6-424d-be67-12f2e2cfe202 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:01.393755 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 3/5] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Jun 27 09:14:01 2022] GET /identity/v3/projects/22d0a8f6bf9e4c98ba20a328083165ac => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:03.417935 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e63f6a-40bc-4e4c-8926-afb21c7e2e5a None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:03.418435 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e63f6a-40bc-4e4c-8926-afb21c7e2e5a None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:03.418435 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e63f6a-40bc-4e4c-8926-afb21c7e2e5a None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:03.422542 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 3/6] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 09:14:03.427983 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351403e-7a1a-420c-ac92-03694e7be535 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:03.428404 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351403e-7a1a-420c-ac92-03694e7be535 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:03.428571 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351403e-7a1a-420c-ac92-03694e7be535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:03.448263 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-e351403e-7a1a-420c-ac92-03694e7be535 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:03.449787 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-e351403e-7a1a-420c-ac92-03694e7be535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:03.457778 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 4/7] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 27 09:14:03.480098 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e63f6a-40bc-4e4c-8926-afb21c7e2e5a None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:03.492857 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e63f6a-40bc-4e4c-8926-afb21c7e2e5a None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:03.497266 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543688aa-9a3b-40bd-8d2d-0209d495eee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:03.497894 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543688aa-9a3b-40bd-8d2d-0209d495eee7 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:03.498181 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543688aa-9a3b-40bd-8d2d-0209d495eee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:03.498459 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543688aa-9a3b-40bd-8d2d-0209d495eee7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:03.506172 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543688aa-9a3b-40bd-8d2d-0209d495eee7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:03.507966 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543688aa-9a3b-40bd-8d2d-0209d495eee7 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:03.517387 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 4/8] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Jun 27 09:14:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 09:14:03.522830 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351403e-7a1a-420c-ac92-03694e7be535 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:03.532377 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351403e-7a1a-420c-ac92-03694e7be535 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:03.536780 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2733b52-ab0e-4ae1-87ab-10d795b810aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:03.537643 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2733b52-ab0e-4ae1-87ab-10d795b810aa admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:03.537925 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2733b52-ab0e-4ae1-87ab-10d795b810aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:03.538197 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2733b52-ab0e-4ae1-87ab-10d795b810aa admin admin] PATH_INFO: `/v3/users/a46ad49f063c49cdb572468399714ea8` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:03.540116 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2733b52-ab0e-4ae1-87ab-10d795b810aa admin admin] RBAC: Authorizing `identity:get_user(user_id=a46ad49f063c49cdb572468399714ea8)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:03.541973 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2733b52-ab0e-4ae1-87ab-10d795b810aa admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:03.543555 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 5/9] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Jun 27 09:14:03 2022] GET /identity/v3/users/a46ad49f063c49cdb572468399714ea8 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:05.625578 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd62fd-0bde-4071-b47d-1ad93be8ca6f None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:05.626122 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd62fd-0bde-4071-b47d-1ad93be8ca6f None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:05.626122 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd62fd-0bde-4071-b47d-1ad93be8ca6f None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:05.627489 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 5/10] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:14:05.632758 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650c8c0-333e-45c7-8ab0-928e6d895bec None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:05.633258 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650c8c0-333e-45c7-8ab0-928e6d895bec None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:05.634368 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650c8c0-333e-45c7-8ab0-928e6d895bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:05.650732 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-d650c8c0-333e-45c7-8ab0-928e6d895bec None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:05.651899 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-d650c8c0-333e-45c7-8ab0-928e6d895bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:05.659368 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510ed04-eab2-4557-a846-beccb5150898 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:05.659641 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510ed04-eab2-4557-a846-beccb5150898 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:05.659913 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510ed04-eab2-4557-a846-beccb5150898 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:05.661305 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 6/11] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 09:14:05.666922 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1999ea-0097-428e-86e1-0dfe2bf2bd2d None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:05.667205 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1999ea-0097-428e-86e1-0dfe2bf2bd2d None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:05.667490 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1999ea-0097-428e-86e1-0dfe2bf2bd2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:05.706223 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG passlib.handlers.bcrypt [None req-ee1999ea-0097-428e-86e1-0dfe2bf2bd2d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80306) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 27 09:14:05.706634 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG passlib.handlers.bcrypt [None req-ee1999ea-0097-428e-86e1-0dfe2bf2bd2d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80306) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 27 09:14:05.735886 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 6/12] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:14:05.752724 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-ee1999ea-0097-428e-86e1-0dfe2bf2bd2d None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:05.754306 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-ee1999ea-0097-428e-86e1-0dfe2bf2bd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:05.759177 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650c8c0-333e-45c7-8ab0-928e6d895bec None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:05.783939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:05.852548 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 7/13] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 09:14:05.862140 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650c8c0-333e-45c7-8ab0-928e6d895bec None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:05.874531 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1999ea-0097-428e-86e1-0dfe2bf2bd2d None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:05.896361 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9cd259-9a3e-4ae8-a76c-a4d0b71f5618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:05.897082 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9cd259-9a3e-4ae8-a76c-a4d0b71f5618 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:05.897362 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9cd259-9a3e-4ae8-a76c-a4d0b71f5618 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:05.897637 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9cd259-9a3e-4ae8-a76c-a4d0b71f5618 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:05.909644 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9cd259-9a3e-4ae8-a76c-a4d0b71f5618 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:14:05.920866 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-6c9cd259-9a3e-4ae8-a76c-a4d0b71f5618 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:14:05.920866 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:14:05.920866 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:14:05.920866 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:14:05.920866 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:14:05.920866 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:14:05.920866 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:14:05.920866 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:14:05.920866 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:14:05.920866 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:14:05.920866 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:14:05.920866 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:14:05.920866 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:14:05.920866 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:14:05.920866 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:14:05.920866 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:14:05.921939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:14:05.921939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:14:05.921939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:14:05.921939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:14:05.921939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:14:05.921939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:14:05.921939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:14:05.921939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:14:05.921939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:14:05.921939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:14:05.921939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:14:05.921939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:14:05.921939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:14:05.921939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:14:05.921939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:14:05.921939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:14:05.922853 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:14:05.922853 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:14:05.922853 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:14:05.922853 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:14:05.922853 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:14:05.922853 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:14:05.922853 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:14:05.922853 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:14:05.922853 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:14:05.922853 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:14:05.922853 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:14:05.922853 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:14:05.922853 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 7/14] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Jun 27 09:14:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 09:14:05.927858 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9cd259-9a3e-4ae8-a76c-a4d0b71f5618 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:05.976830 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1999ea-0097-428e-86e1-0dfe2bf2bd2d None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:05.979096 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:06.010220 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:06.013677 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe027db-ffe9-49be-822a-b2fd9bc07dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:06.014911 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe027db-ffe9-49be-822a-b2fd9bc07dde None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:06.015205 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe027db-ffe9-49be-822a-b2fd9bc07dde None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:06.015479 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe027db-ffe9-49be-822a-b2fd9bc07dde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:06.029247 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9cd259-9a3e-4ae8-a76c-a4d0b71f5618 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:06.064618 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd9efa-7578-4130-81b1-cccdfe0fdd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:06.065287 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd9efa-7578-4130-81b1-cccdfe0fdd73 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:06.065572 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd9efa-7578-4130-81b1-cccdfe0fdd73 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:06.065848 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd9efa-7578-4130-81b1-cccdfe0fdd73 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:06.066603 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd9efa-7578-4130-81b1-cccdfe0fdd73 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:06.066911 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd9efa-7578-4130-81b1-cccdfe0fdd73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:06.068362 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd9efa-7578-4130-81b1-cccdfe0fdd73 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:06.081014 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 8/15] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:14:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:14:06.085900 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe027db-ffe9-49be-822a-b2fd9bc07dde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:06.087001 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd9efa-7578-4130-81b1-cccdfe0fdd73 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:06.087985 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe027db-ffe9-49be-822a-b2fd9bc07dde None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:06.204413 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd9efa-7578-4130-81b1-cccdfe0fdd73 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:06.209712 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 8/16] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:14:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 27 09:14:06.215881 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe027db-ffe9-49be-822a-b2fd9bc07dde None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:06.221069 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:06.243538 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067283ad-bf25-49a7-9c18-c36939f499f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:06.244509 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067283ad-bf25-49a7-9c18-c36939f499f3 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:06.244751 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067283ad-bf25-49a7-9c18-c36939f499f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:06.245026 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067283ad-bf25-49a7-9c18-c36939f499f3 None admin] PATH_INFO: `/v3/users/a46ad49f063c49cdb572468399714ea8` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:06.246641 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067283ad-bf25-49a7-9c18-c36939f499f3 None admin] RBAC: Authorizing `identity:get_user(user_id=a46ad49f063c49cdb572468399714ea8)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:06.248167 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067283ad-bf25-49a7-9c18-c36939f499f3 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:06.250283 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 9/17] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Jun 27 09:14:06 2022] GET /identity/v3/users/a46ad49f063c49cdb572468399714ea8 => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:14:06.255894 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067283ad-bf25-49a7-9c18-c36939f499f3 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:06.272407 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:06.335013 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe027db-ffe9-49be-822a-b2fd9bc07dde None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:06.363211 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067283ad-bf25-49a7-9c18-c36939f499f3 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:06.368678 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fcada8-1faf-46fe-be40-f33e633ba5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:06.369479 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fcada8-1faf-46fe-be40-f33e633ba5e6 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:06.369787 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fcada8-1faf-46fe-be40-f33e633ba5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:06.370041 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fcada8-1faf-46fe-be40-f33e633ba5e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:06.388976 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fcada8-1faf-46fe-be40-f33e633ba5e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:06.390467 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fcada8-1faf-46fe-be40-f33e633ba5e6 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:06.397591 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4fec4-95bc-4d5e-b9ab-82bcdcd400bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:06.398389 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4fec4-95bc-4d5e-b9ab-82bcdcd400bb None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:06.398704 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4fec4-95bc-4d5e-b9ab-82bcdcd400bb None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:06.398982 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4fec4-95bc-4d5e-b9ab-82bcdcd400bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:06.400251 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a4fec4-95bc-4d5e-b9ab-82bcdcd400bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:06.401714 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a4fec4-95bc-4d5e-b9ab-82bcdcd400bb None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:06.403534 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 10/18] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:14:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:14:06.409396 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4fec4-95bc-4d5e-b9ab-82bcdcd400bb None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:06.413663 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-b6fcada8-1faf-46fe-be40-f33e633ba5e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:14:06.413663 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:14:06.413663 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:14:06.413663 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:14:06.413663 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:14:06.413663 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:14:06.413663 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:14:06.413663 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:14:06.413663 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:14:06.413663 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:14:06.413663 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:14:06.413663 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:14:06.413663 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:14:06.413663 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:14:06.413663 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:14:06.414552 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:14:06.414552 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:14:06.414552 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:14:06.414552 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:14:06.414552 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:14:06.414552 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:14:06.414552 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:14:06.414552 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:14:06.414552 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:14:06.414552 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:14:06.414552 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:14:06.414552 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:14:06.414552 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:14:06.414552 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:14:06.414552 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:14:06.414552 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:14:06.414552 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:14:06.415521 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:14:06.415521 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:14:06.415521 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:14:06.415521 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:14:06.415521 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 9/19] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:14:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 09:14:06.420836 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fcada8-1faf-46fe-be40-f33e633ba5e6 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:06.479628 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:06.493672 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:06.512143 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4fec4-95bc-4d5e-b9ab-82bcdcd400bb None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:06.522519 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fcada8-1faf-46fe-be40-f33e633ba5e6 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:06.546549 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48055ae3-0fe8-4cad-b221-c86cdfae226d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:06.547198 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48055ae3-0fe8-4cad-b221-c86cdfae226d None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:06.547480 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48055ae3-0fe8-4cad-b221-c86cdfae226d None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:06.547750 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48055ae3-0fe8-4cad-b221-c86cdfae226d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:06.548617 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48055ae3-0fe8-4cad-b221-c86cdfae226d None admin] RBAC: Adding query filter params (role.id=91c77942515d45f1ad8189c9fddf4424, scope.domain.id=default, user.id=a46ad49f063c49cdb572468399714ea8) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:06.548925 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48055ae3-0fe8-4cad-b221-c86cdfae226d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:06.550357 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48055ae3-0fe8-4cad-b221-c86cdfae226d None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:06.558407 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 11/20] 10.222.0.62 () {56 vars in 1322 bytes} [Mon Jun 27 09:14:06 2022] GET /identity/v3/role_assignments?user.id=a46ad49f063c49cdb572468399714ea8&scope.domain.id=default&role.id=91c77942515d45f1ad8189c9fddf4424 => generated 233 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:14:06.558553 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2cd13d-f00e-4fbe-99e3-2da0a9ea85ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:06.559087 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2cd13d-f00e-4fbe-99e3-2da0a9ea85ce None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:06.559367 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2cd13d-f00e-4fbe-99e3-2da0a9ea85ce None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:06.559640 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2cd13d-f00e-4fbe-99e3-2da0a9ea85ce None admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:06.560414 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2cd13d-f00e-4fbe-99e3-2da0a9ea85ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:06.560720 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2cd13d-f00e-4fbe-99e3-2da0a9ea85ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:06.562228 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2cd13d-f00e-4fbe-99e3-2da0a9ea85ce None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:06.581891 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 10/21] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:14:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:14:08.862317 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20339719-2121-4ddc-a006-be4644bcb440 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:08.863263 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20339719-2121-4ddc-a006-be4644bcb440 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:08.863726 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20339719-2121-4ddc-a006-be4644bcb440 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:08.865334 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 12/22] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:14:08.871235 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009a01b-2f6e-40e0-8de9-af98ce7462f5 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:08.872047 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009a01b-2f6e-40e0-8de9-af98ce7462f5 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:08.872529 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009a01b-2f6e-40e0-8de9-af98ce7462f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:08.897217 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-f009a01b-2f6e-40e0-8de9-af98ce7462f5 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:08.899384 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-f009a01b-2f6e-40e0-8de9-af98ce7462f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:08.982513 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 11/23] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:14:09.018425 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20339719-2121-4ddc-a006-be4644bcb440 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:09.126547 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e12c8-683c-4e7e-b6d2-1a0819da820a None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:09.126833 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e12c8-683c-4e7e-b6d2-1a0819da820a None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:09.127117 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e12c8-683c-4e7e-b6d2-1a0819da820a None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:09.128526 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 12/24] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:14:09.134103 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86f366-e95c-4c35-b102-0a023f6d57f8 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:09.134387 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86f366-e95c-4c35-b102-0a023f6d57f8 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:09.134664 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86f366-e95c-4c35-b102-0a023f6d57f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:09.160921 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-bd86f366-e95c-4c35-b102-0a023f6d57f8 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:09.162139 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-bd86f366-e95c-4c35-b102-0a023f6d57f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:09.183493 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20339719-2121-4ddc-a006-be4644bcb440 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:09.254682 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:09.260909 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bbe6c7-c41c-4fdb-8692-018a56f5d9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:09.262000 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bbe6c7-c41c-4fdb-8692-018a56f5d9ca None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:09.262475 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bbe6c7-c41c-4fdb-8692-018a56f5d9ca None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:09.263519 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bbe6c7-c41c-4fdb-8692-018a56f5d9ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:09.289253 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bbe6c7-c41c-4fdb-8692-018a56f5d9ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:14:09.290828 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 13/25] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 09:14:09.304220 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-c9bbe6c7-c41c-4fdb-8692-018a56f5d9ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:14:09.304220 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:14:09.304220 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:14:09.304220 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:14:09.304220 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:14:09.304220 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:14:09.304220 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:14:09.304220 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:14:09.304220 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:14:09.304220 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:14:09.304220 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:14:09.304220 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:14:09.304220 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:14:09.304220 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:14:09.304220 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:14:09.304220 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:14:09.305621 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:14:09.305621 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:14:09.305621 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:14:09.305621 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:14:09.305621 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:14:09.305621 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:14:09.305621 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:14:09.305621 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:14:09.305621 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:14:09.305621 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:14:09.305621 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:14:09.305621 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:14:09.305621 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:14:09.305621 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:14:09.305621 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:14:09.305621 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:14:09.306352 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:14:09.306352 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:14:09.306352 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:14:09.306352 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:14:09.306352 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:14:09.306352 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:14:09.306352 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:14:09.306352 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:14:09.306352 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:14:09.306352 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:14:09.306352 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:14:09.306352 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:14:09.306352 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 13/26] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Jun 27 09:14:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:14:09.313428 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86f366-e95c-4c35-b102-0a023f6d57f8 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:09.325353 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bbe6c7-c41c-4fdb-8692-018a56f5d9ca None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:09.330461 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:09.442085 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bbe6c7-c41c-4fdb-8692-018a56f5d9ca None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:09.484439 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b975ed6-7f74-41f5-aa93-edbb26b0429f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:09.485241 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b975ed6-7f74-41f5-aa93-edbb26b0429f None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:09.485526 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b975ed6-7f74-41f5-aa93-edbb26b0429f None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:09.485803 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b975ed6-7f74-41f5-aa93-edbb26b0429f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:09.511570 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b975ed6-7f74-41f5-aa93-edbb26b0429f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:09.513087 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b975ed6-7f74-41f5-aa93-edbb26b0429f None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:09.547853 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-6b975ed6-7f74-41f5-aa93-edbb26b0429f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:14:09.547853 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:14:09.547853 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:14:09.547853 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:14:09.547853 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:14:09.547853 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:14:09.547853 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:14:09.547853 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:14:09.547853 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:14:09.547853 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:14:09.547853 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:14:09.547853 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:14:09.547853 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:14:09.547853 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:14:09.547853 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:14:09.548751 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:14:09.548751 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:14:09.548751 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:14:09.548751 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:14:09.548751 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:14:09.548751 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:14:09.548751 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:14:09.548751 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:14:09.548751 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:14:09.548751 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:14:09.548751 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:14:09.548751 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:14:09.548751 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:14:09.548751 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:14:09.548751 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:14:09.548751 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:14:09.548751 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:14:09.549523 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:14:09.549523 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:14:09.549523 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:14:09.549523 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:14:09.559610 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86f366-e95c-4c35-b102-0a023f6d57f8 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:09.562442 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 14/27] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:14:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:14:09.563933 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d63ee-aaea-4fce-bb3a-889b96cd5220 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:09.564235 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d63ee-aaea-4fce-bb3a-889b96cd5220 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:09.564518 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d63ee-aaea-4fce-bb3a-889b96cd5220 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:09.566131 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 15/28] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:14:09.570933 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d63ee-aaea-4fce-bb3a-889b96cd5220 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:09.640783 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f227cc-1090-486a-adf8-77b66e7d5e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:09.641852 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f227cc-1090-486a-adf8-77b66e7d5e5c None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:09.642325 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f227cc-1090-486a-adf8-77b66e7d5e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:09.642799 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f227cc-1090-486a-adf8-77b66e7d5e5c None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:09.643750 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f227cc-1090-486a-adf8-77b66e7d5e5c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:09.644281 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f227cc-1090-486a-adf8-77b66e7d5e5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:09.645934 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f227cc-1090-486a-adf8-77b66e7d5e5c None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:09.670593 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 14/29] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:14:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:09.671729 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbc06d-a9b1-46aa-83b4-f4f9dced7621 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:09.676264 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbc06d-a9b1-46aa-83b4-f4f9dced7621 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:09.676264 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbc06d-a9b1-46aa-83b4-f4f9dced7621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:09.688625 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:09.707814 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-9ecbc06d-a9b1-46aa-83b4-f4f9dced7621 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:09.713549 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-9ecbc06d-a9b1-46aa-83b4-f4f9dced7621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:09.764104 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d63ee-aaea-4fce-bb3a-889b96cd5220 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:09.767375 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:09.800487 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b35c23-6bd7-42e7-8649-25b4d47f5976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:09.801210 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b35c23-6bd7-42e7-8649-25b4d47f5976 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:09.801495 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b35c23-6bd7-42e7-8649-25b4d47f5976 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:09.802000 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b35c23-6bd7-42e7-8649-25b4d47f5976 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:09.802497 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b35c23-6bd7-42e7-8649-25b4d47f5976 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:09.802802 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b35c23-6bd7-42e7-8649-25b4d47f5976 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:09.804268 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b35c23-6bd7-42e7-8649-25b4d47f5976 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:09.810836 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 15/30] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:14:09.811964 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecbc06d-a9b1-46aa-83b4-f4f9dced7621 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:09.825007 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 16/31] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:09.826600 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950099f-0389-4569-a666-810972b7f533 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:09.826895 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950099f-0389-4569-a666-810972b7f533 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:09.827178 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950099f-0389-4569-a666-810972b7f533 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:09.832888 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 17/32] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:14:09.833752 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950099f-0389-4569-a666-810972b7f533 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:09.934370 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecbc06d-a9b1-46aa-83b4-f4f9dced7621 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:09.943687 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950099f-0389-4569-a666-810972b7f533 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:09.966162 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:09.971177 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d333a-269c-411c-8422-69eaa7114bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:09.972155 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d333a-269c-411c-8422-69eaa7114bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:09.972548 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d333a-269c-411c-8422-69eaa7114bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:09.972900 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d333a-269c-411c-8422-69eaa7114bf8 None admin] PATH_INFO: `/v3/users/a46ad49f063c49cdb572468399714ea8` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:09.974669 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d333a-269c-411c-8422-69eaa7114bf8 None admin] RBAC: Authorizing `identity:get_user(user_id=a46ad49f063c49cdb572468399714ea8)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:09.976213 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d333a-269c-411c-8422-69eaa7114bf8 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:09.984041 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 16/33] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Jun 27 09:14:09 2022] GET /identity/v3/users/a46ad49f063c49cdb572468399714ea8 => generated 247 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:09.984041 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405703b-1b60-404a-bd84-7c55f668cb4a None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:09.984041 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405703b-1b60-404a-bd84-7c55f668cb4a None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:09.984041 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405703b-1b60-404a-bd84-7c55f668cb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:09.988186 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa3655-0852-4e62-854f-27db22f8cf1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:09.988908 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa3655-0852-4e62-854f-27db22f8cf1e None admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:09.989193 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa3655-0852-4e62-854f-27db22f8cf1e None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:09.989470 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa3655-0852-4e62-854f-27db22f8cf1e None admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:09.990193 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aa3655-0852-4e62-854f-27db22f8cf1e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:09.991708 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aa3655-0852-4e62-854f-27db22f8cf1e None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:09.999604 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-3405703b-1b60-404a-bd84-7c55f668cb4a None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:10.001102 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-3405703b-1b60-404a-bd84-7c55f668cb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:10.040771 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:10.076230 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 17/34] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:14:10.076230 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405703b-1b60-404a-bd84-7c55f668cb4a None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:10.197244 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405703b-1b60-404a-bd84-7c55f668cb4a None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:10.233296 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 18/35] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Jun 27 09:14:09 2022] POST /identity/v3/projects => generated 301 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:14:10.234280 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa3655-0852-4e62-854f-27db22f8cf1e None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:10.243886 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb8cd7-9d4c-4c21-acd4-689c3d529a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:10.245867 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb8cd7-9d4c-4c21-acd4-689c3d529a57 None admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:10.246401 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb8cd7-9d4c-4c21-acd4-689c3d529a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:10.246879 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb8cd7-9d4c-4c21-acd4-689c3d529a57 None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:10.248589 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb8cd7-9d4c-4c21-acd4-689c3d529a57 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:10.251166 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb8cd7-9d4c-4c21-acd4-689c3d529a57 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:10.358308 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa3655-0852-4e62-854f-27db22f8cf1e None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:10.397611 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338ec61-a4e8-4075-9169-1b6dd3fbbb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:10.399396 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338ec61-a4e8-4075-9169-1b6dd3fbbb2e None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:10.399893 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338ec61-a4e8-4075-9169-1b6dd3fbbb2e None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:10.400291 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338ec61-a4e8-4075-9169-1b6dd3fbbb2e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:10.401632 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a338ec61-a4e8-4075-9169-1b6dd3fbbb2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:10.403208 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a338ec61-a4e8-4075-9169-1b6dd3fbbb2e None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:10.405203 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 19/36] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:14:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:10.411050 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338ec61-a4e8-4075-9169-1b6dd3fbbb2e None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:10.446034 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:10.513914 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338ec61-a4e8-4075-9169-1b6dd3fbbb2e None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:10.515657 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 18/37] 10.222.0.62 () {60 vars in 1131 bytes} [Mon Jun 27 09:14:10 2022] POST /identity/v3/roles => generated 219 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:14:10.518985 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b4c54-a114-491d-bdf9-69a15def6436 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:10.518985 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b4c54-a114-491d-bdf9-69a15def6436 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:10.518985 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b4c54-a114-491d-bdf9-69a15def6436 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:10.518985 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 19/38] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:14:10.519590 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b4c54-a114-491d-bdf9-69a15def6436 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:10.559733 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:10.562563 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf5aff-120e-4521-b9e9-954c8ad9424c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:10.563319 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf5aff-120e-4521-b9e9-954c8ad9424c None admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:10.563746 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf5aff-120e-4521-b9e9-954c8ad9424c None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:10.564146 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf5aff-120e-4521-b9e9-954c8ad9424c None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:10.565095 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaf5aff-120e-4521-b9e9-954c8ad9424c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:10.566604 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaf5aff-120e-4521-b9e9-954c8ad9424c None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:10.651398 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b4c54-a114-491d-bdf9-69a15def6436 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:10.675422 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 20/39] 10.222.0.62 () {60 vars in 1131 bytes} [Mon Jun 27 09:14:10 2022] POST /identity/v3/roles => generated 225 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:14:10.677179 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab131203-6876-493b-9042-3a7dcbbd1077 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:10.678414 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab131203-6876-493b-9042-3a7dcbbd1077 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:10.678816 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab131203-6876-493b-9042-3a7dcbbd1077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:10.692607 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995edcd0-49c7-4d10-be3d-ef8939232689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:10.693530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995edcd0-49c7-4d10-be3d-ef8939232689 None admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:10.693813 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995edcd0-49c7-4d10-be3d-ef8939232689 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:10.694092 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995edcd0-49c7-4d10-be3d-ef8939232689 None admin] PATH_INFO: `/v3/domains/default/users/a46ad49f063c49cdb572468399714ea8/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:10.697965 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995edcd0-49c7-4d10-be3d-ef8939232689 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=a46ad49f063c49cdb572468399714ea8, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:10.698850 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995edcd0-49c7-4d10-be3d-ef8939232689 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:10.810336 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-ab131203-6876-493b-9042-3a7dcbbd1077 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:10.811939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-ab131203-6876-493b-9042-3a7dcbbd1077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:10.830662 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 20/40] 10.222.0.62 () {58 vars in 1361 bytes} [Mon Jun 27 09:14:10 2022] PUT /identity/v3/domains/default/users/a46ad49f063c49cdb572468399714ea8/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:14:10.842824 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77d967-9b79-4c26-9940-438e87e94a46 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:10.842824 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77d967-9b79-4c26-9940-438e87e94a46 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:10.842824 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77d967-9b79-4c26-9940-438e87e94a46 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:10.843130 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 21/41] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:10 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:14:10.850148 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac16d1-953a-4179-a42a-c202fadd0db9 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:10.850438 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac16d1-953a-4179-a42a-c202fadd0db9 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:10.850772 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac16d1-953a-4179-a42a-c202fadd0db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:10.876911 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-2cac16d1-953a-4179-a42a-c202fadd0db9 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:10.878217 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-2cac16d1-953a-4179-a42a-c202fadd0db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:10.910893 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 21/42] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:14:10.937415 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab131203-6876-493b-9042-3a7dcbbd1077 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:10.969178 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 22/43] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 09:14:10.974041 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:10.994988 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac16d1-953a-4179-a42a-c202fadd0db9 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:11.016017 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:11.055138 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab131203-6876-493b-9042-3a7dcbbd1077 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:11.091317 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c5e9e3-d041-4a16-8975-c3a2f863de64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:11.091910 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5e9e3-d041-4a16-8975-c3a2f863de64 None admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:11.092286 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5e9e3-d041-4a16-8975-c3a2f863de64 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:11.092512 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5e9e3-d041-4a16-8975-c3a2f863de64 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:11.093271 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c5e9e3-d041-4a16-8975-c3a2f863de64 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:11.094756 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c5e9e3-d041-4a16-8975-c3a2f863de64 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:11.101719 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac16d1-953a-4179-a42a-c202fadd0db9 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:11.136877 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78bb3f0-d687-48a1-91b2-9c8dee68d6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:11.137670 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78bb3f0-d687-48a1-91b2-9c8dee68d6fa None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:11.137952 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78bb3f0-d687-48a1-91b2-9c8dee68d6fa None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:11.138226 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78bb3f0-d687-48a1-91b2-9c8dee68d6fa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:11.139379 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78bb3f0-d687-48a1-91b2-9c8dee68d6fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:11.140857 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78bb3f0-d687-48a1-91b2-9c8dee68d6fa None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:11.142644 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 23/44] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:14:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:14:11.148029 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78bb3f0-d687-48a1-91b2-9c8dee68d6fa None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:11.173915 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 22/45] 10.222.0.62 () {60 vars in 1131 bytes} [Mon Jun 27 09:14:10 2022] POST /identity/v3/roles => generated 223 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 09:14:11.255711 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:11.274485 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78bb3f0-d687-48a1-91b2-9c8dee68d6fa None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:11.313741 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d64a77-7612-43b5-bfbf-58912fcdb76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:11.314428 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d64a77-7612-43b5-bfbf-58912fcdb76f None admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:11.314712 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d64a77-7612-43b5-bfbf-58912fcdb76f None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:11.314990 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d64a77-7612-43b5-bfbf-58912fcdb76f None admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:11.315760 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d64a77-7612-43b5-bfbf-58912fcdb76f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:11.318214 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d64a77-7612-43b5-bfbf-58912fcdb76f None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:11.420969 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 24/46] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Jun 27 09:14:11 2022] POST /identity/v3/projects => generated 312 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 09:14:12.903936 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca8669-f124-4b23-bbbf-eba64e81c125 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:12.904744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca8669-f124-4b23-bbbf-eba64e81c125 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:12.904848 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca8669-f124-4b23-bbbf-eba64e81c125 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:12.906217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 23/47] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:14:12.911695 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6018f-46a6-4569-b17c-65ea2eef92f4 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:12.912149 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6018f-46a6-4569-b17c-65ea2eef92f4 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:12.912270 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6018f-46a6-4569-b17c-65ea2eef92f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:13.033698 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-4ab6018f-46a6-4569-b17c-65ea2eef92f4 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:13.034902 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-4ab6018f-46a6-4569-b17c-65ea2eef92f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:13.103292 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 25/48] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:14:13.127053 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca8669-f124-4b23-bbbf-eba64e81c125 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:13.212757 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:13.231460 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca8669-f124-4b23-bbbf-eba64e81c125 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:13.267452 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998adebb-7932-4b76-8b2c-77251f48cd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:13.268279 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998adebb-7932-4b76-8b2c-77251f48cd09 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:13.268564 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998adebb-7932-4b76-8b2c-77251f48cd09 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:13.268880 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998adebb-7932-4b76-8b2c-77251f48cd09 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:13.278763 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998adebb-7932-4b76-8b2c-77251f48cd09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:14:13.287435 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-998adebb-7932-4b76-8b2c-77251f48cd09 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:14:13.287435 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:14:13.287435 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:14:13.287435 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:14:13.287435 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:14:13.287435 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:14:13.287435 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:14:13.287435 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:14:13.287435 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:14:13.287435 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:14:13.287435 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:14:13.287435 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:14:13.287435 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:14:13.287435 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:14:13.287435 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:14:13.287435 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:14:13.288343 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:14:13.288343 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:14:13.288343 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:14:13.288343 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:14:13.288343 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:14:13.288343 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:14:13.288343 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:14:13.288343 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:14:13.288343 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:14:13.288343 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:14:13.288343 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:14:13.288343 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:14:13.288343 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:14:13.288343 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:14:13.288343 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:14:13.288343 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:14:13.289896 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:14:13.289896 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:14:13.289896 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:14:13.289896 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:14:13.289896 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:14:13.289896 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:14:13.289896 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:14:13.289896 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:14:13.289896 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:14:13.289896 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:14:13.289896 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:14:13.289896 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:14:13.289896 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 24/49] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Jun 27 09:14:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:14:13.294888 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6018f-46a6-4569-b17c-65ea2eef92f4 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:13.361103 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:13.395474 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6018f-46a6-4569-b17c-65ea2eef92f4 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:13.430784 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc7d02-680c-4dd0-a1e1-b8648e22aceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:13.431455 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc7d02-680c-4dd0-a1e1-b8648e22aceb None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:13.431738 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc7d02-680c-4dd0-a1e1-b8648e22aceb None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:13.432018 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc7d02-680c-4dd0-a1e1-b8648e22aceb None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:13.432825 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc7d02-680c-4dd0-a1e1-b8648e22aceb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:13.433338 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc7d02-680c-4dd0-a1e1-b8648e22aceb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:13.434928 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc7d02-680c-4dd0-a1e1-b8648e22aceb None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:13.443812 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 26/50] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:14:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:13.449270 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998adebb-7932-4b76-8b2c-77251f48cd09 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:13.481376 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085c106-85d3-41b6-abbf-74bdae3d1aff None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:13.481593 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085c106-85d3-41b6-abbf-74bdae3d1aff None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:13.481876 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085c106-85d3-41b6-abbf-74bdae3d1aff None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:13.483255 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 27/51] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 09:14:13.488212 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18cd5b-fe3c-4117-a209-1a775e2d809b None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:13.488512 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18cd5b-fe3c-4117-a209-1a775e2d809b None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:13.488792 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18cd5b-fe3c-4117-a209-1a775e2d809b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:13.506103 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-0f18cd5b-fe3c-4117-a209-1a775e2d809b None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:13.507343 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-0f18cd5b-fe3c-4117-a209-1a775e2d809b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:13.559343 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998adebb-7932-4b76-8b2c-77251f48cd09 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:13.576936 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 28/52] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 09:14:13.592748 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f1f19-407a-4651-b618-cb14239dd2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:13.593625 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f1f19-407a-4651-b618-cb14239dd2fe None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:13.593910 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f1f19-407a-4651-b618-cb14239dd2fe None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:13.594187 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f1f19-407a-4651-b618-cb14239dd2fe None admin] PATH_INFO: `/v3/users/a46ad49f063c49cdb572468399714ea8` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:13.595498 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f1f19-407a-4651-b618-cb14239dd2fe None admin] RBAC: Authorizing `identity:get_user(user_id=a46ad49f063c49cdb572468399714ea8)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:13.596992 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f1f19-407a-4651-b618-cb14239dd2fe None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:13.598645 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 25/53] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Jun 27 09:14:13 2022] GET /identity/v3/users/a46ad49f063c49cdb572468399714ea8 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:14:13.600114 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18cd5b-fe3c-4117-a209-1a775e2d809b None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:13.605088 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f1f19-407a-4651-b618-cb14239dd2fe None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:13.622777 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:13.659651 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:13.701083 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18cd5b-fe3c-4117-a209-1a775e2d809b None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:13.711799 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f1f19-407a-4651-b618-cb14239dd2fe None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:13.736429 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcf90d1-cf2b-480a-875f-11193a2cf648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:13.737157 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf90d1-cf2b-480a-875f-11193a2cf648 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:13.737443 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf90d1-cf2b-480a-875f-11193a2cf648 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:13.737722 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf90d1-cf2b-480a-875f-11193a2cf648 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:13.738912 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcf90d1-cf2b-480a-875f-11193a2cf648 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:13.740411 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcf90d1-cf2b-480a-875f-11193a2cf648 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:13.742254 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 29/54] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:14:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:13.746446 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478dd86-c835-4887-ab4c-ead13c875c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:13.747240 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478dd86-c835-4887-ab4c-ead13c875c85 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:13.747517 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478dd86-c835-4887-ab4c-ead13c875c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:13.747675 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcf90d1-cf2b-480a-875f-11193a2cf648 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:13.747787 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478dd86-c835-4887-ab4c-ead13c875c85 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:13.748990 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a478dd86-c835-4887-ab4c-ead13c875c85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:13.750439 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a478dd86-c835-4887-ab4c-ead13c875c85 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:13.752227 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 26/55] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:14:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:13.757806 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478dd86-c835-4887-ab4c-ead13c875c85 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:13.841387 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:13.853188 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcf90d1-cf2b-480a-875f-11193a2cf648 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:13.860302 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478dd86-c835-4887-ab4c-ead13c875c85 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:13.880319 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:13.888827 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0496ecd7-f829-4a25-97dc-165dae212c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:13.889492 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496ecd7-f829-4a25-97dc-165dae212c30 None admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:13.889779 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496ecd7-f829-4a25-97dc-165dae212c30 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:13.890113 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496ecd7-f829-4a25-97dc-165dae212c30 None admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:13.890838 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0496ecd7-f829-4a25-97dc-165dae212c30 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:13.892347 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0496ecd7-f829-4a25-97dc-165dae212c30 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:13.894599 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a759c-933d-4180-9c6e-9a35cbdfa706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:13.895248 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a759c-933d-4180-9c6e-9a35cbdfa706 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:13.895534 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a759c-933d-4180-9c6e-9a35cbdfa706 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:13.895813 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a759c-933d-4180-9c6e-9a35cbdfa706 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:13.896892 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a759c-933d-4180-9c6e-9a35cbdfa706 None admin] RBAC: Adding query filter params (role.id=91c77942515d45f1ad8189c9fddf4424, scope.domain.id=default, user.id=a46ad49f063c49cdb572468399714ea8) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:13.897207 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a759c-933d-4180-9c6e-9a35cbdfa706 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:13.899243 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a759c-933d-4180-9c6e-9a35cbdfa706 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:13.905533 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 27/56] 10.222.0.62 () {56 vars in 1322 bytes} [Mon Jun 27 09:14:13 2022] GET /identity/v3/role_assignments?user.id=a46ad49f063c49cdb572468399714ea8&scope.domain.id=default&role.id=91c77942515d45f1ad8189c9fddf4424 => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:14:13.998168 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 30/57] 10.222.0.62 () {60 vars in 1140 bytes} [Mon Jun 27 09:14:13 2022] POST /identity/v3/projects => generated 298 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 09:14:16.045135 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8fbca-cdfc-415a-bbd7-9d811dc4d0eb None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:16.045661 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8fbca-cdfc-415a-bbd7-9d811dc4d0eb None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:16.045749 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8fbca-cdfc-415a-bbd7-9d811dc4d0eb None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:16.047076 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 28/58] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:14:16.052272 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fe456-7abe-4481-b93c-fcd92aecf7bc None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:16.052685 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fe456-7abe-4481-b93c-fcd92aecf7bc None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:16.052848 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fe456-7abe-4481-b93c-fcd92aecf7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:16.069505 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-660fe456-7abe-4481-b93c-fcd92aecf7bc None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:16.070721 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-660fe456-7abe-4481-b93c-fcd92aecf7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:16.138276 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 31/59] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:14:16.164478 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8fbca-cdfc-415a-bbd7-9d811dc4d0eb None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:16.275092 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8fbca-cdfc-415a-bbd7-9d811dc4d0eb None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:16.309626 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff1be6-f3a4-4957-8040-a6d0da22c688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:16.310336 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff1be6-f3a4-4957-8040-a6d0da22c688 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:16.310617 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff1be6-f3a4-4957-8040-a6d0da22c688 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:16.310888 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff1be6-f3a4-4957-8040-a6d0da22c688 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:16.312067 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff1be6-f3a4-4957-8040-a6d0da22c688 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:16.313563 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff1be6-f3a4-4957-8040-a6d0da22c688 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:16.315189 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 29/60] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:14:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:16.321272 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660fe456-7abe-4481-b93c-fcd92aecf7bc None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:16.417580 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660fe456-7abe-4481-b93c-fcd92aecf7bc None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:16.426773 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:16.450736 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2438f4d2-02f0-44bb-bd61-47500b343b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:16.451409 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438f4d2-02f0-44bb-bd61-47500b343b76 None admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:16.451692 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438f4d2-02f0-44bb-bd61-47500b343b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:16.451969 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438f4d2-02f0-44bb-bd61-47500b343b76 None admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:16.452712 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2438f4d2-02f0-44bb-bd61-47500b343b76 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:16.454189 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2438f4d2-02f0-44bb-bd61-47500b343b76 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:16.590702 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 32/61] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Jun 27 09:14:16 2022] POST /identity/v3/users => generated 275 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:14:19.630296 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d159be5-aeba-4e25-a5b9-7653e5167617 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:19.630815 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d159be5-aeba-4e25-a5b9-7653e5167617 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:19.630988 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d159be5-aeba-4e25-a5b9-7653e5167617 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:19.632909 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 30/62] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:14:19.638524 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea3777-eb54-4809-bdd2-bdd480c96ffd None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:19.639393 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea3777-eb54-4809-bdd2-bdd480c96ffd None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:19.639886 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea3777-eb54-4809-bdd2-bdd480c96ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:19.662303 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-fdea3777-eb54-4809-bdd2-bdd480c96ffd None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:19.663925 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-fdea3777-eb54-4809-bdd2-bdd480c96ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:19.750034 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 33/63] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 09:14:19.789812 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d159be5-aeba-4e25-a5b9-7653e5167617 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:19.811999 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:19.922068 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d159be5-aeba-4e25-a5b9-7653e5167617 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:19.968907 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ee6b6-d352-4712-8040-9ebda27a0b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:19.969716 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ee6b6-d352-4712-8040-9ebda27a0b1d None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:19.969999 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ee6b6-d352-4712-8040-9ebda27a0b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:19.970276 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ee6b6-d352-4712-8040-9ebda27a0b1d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:19.983190 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669ee6b6-d352-4712-8040-9ebda27a0b1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:14:19.991203 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-669ee6b6-d352-4712-8040-9ebda27a0b1d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 09:14:19.991203 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:14:19.991203 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:14:19.991203 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:14:19.991203 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:14:19.991203 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:14:19.991203 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:14:19.991203 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:14:19.991203 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:14:19.991203 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:14:19.991203 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:14:19.991203 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:14:19.991203 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:14:19.991203 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:14:19.991203 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:14:19.991203 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:14:19.992629 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:14:19.992629 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:14:19.992629 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:14:19.992629 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:14:19.992629 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:14:19.992629 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:14:19.992629 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:14:19.992629 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:14:19.992629 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:14:19.992629 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:14:19.992629 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:14:19.992629 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:14:19.992629 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:14:19.992629 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:14:19.992629 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:14:19.992629 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:14:19.993357 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:14:19.993357 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:14:19.993357 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:14:19.993357 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:14:19.993357 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:14:19.993357 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:14:19.993357 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:14:19.993357 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:14:19.993357 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:14:19.993357 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:14:19.993357 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 09:14:19.993357 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:14:19.993357 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 31/64] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:14:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:14:20.000216 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea3777-eb54-4809-bdd2-bdd480c96ffd None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:20.025883 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cdd2c1-c24e-4888-aa8b-299818d2f8b5 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:20.026202 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cdd2c1-c24e-4888-aa8b-299818d2f8b5 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:20.026448 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cdd2c1-c24e-4888-aa8b-299818d2f8b5 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:20.027836 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 32/65] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 09:14:20.033382 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0554375-240b-4014-9472-b306895ef1c1 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:20.033705 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0554375-240b-4014-9472-b306895ef1c1 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:20.033961 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0554375-240b-4014-9472-b306895ef1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:20.065336 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-f0554375-240b-4014-9472-b306895ef1c1 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:20.066607 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-f0554375-240b-4014-9472-b306895ef1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:20.125259 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:20.132897 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea3777-eb54-4809-bdd2-bdd480c96ffd None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:20.171110 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751c0d6-3f96-444f-a349-58264fe0388f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:20.172170 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751c0d6-3f96-444f-a349-58264fe0388f None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:20.172663 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751c0d6-3f96-444f-a349-58264fe0388f None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:20.173114 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751c0d6-3f96-444f-a349-58264fe0388f None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:20.173937 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 33/66] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 09:14:20.174343 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1751c0d6-3f96-444f-a349-58264fe0388f None admin] RBAC: Adding query filter params (name=member) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:20.178926 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1751c0d6-3f96-444f-a349-58264fe0388f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:20.179029 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68da7f-5980-4e3e-b319-b7aadc3a5f58 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:20.179029 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68da7f-5980-4e3e-b319-b7aadc3a5f58 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:20.179029 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68da7f-5980-4e3e-b319-b7aadc3a5f58 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:20.179283 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1751c0d6-3f96-444f-a349-58264fe0388f None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:20.179894 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 34/67] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:14:20.183850 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3a6dc-4fe5-4b4f-87cd-3343964302e8 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:20.184140 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3a6dc-4fe5-4b4f-87cd-3343964302e8 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:20.184451 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3a6dc-4fe5-4b4f-87cd-3343964302e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:20.189704 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 34/68] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Jun 27 09:14:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:20.191565 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:20.195542 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751c0d6-3f96-444f-a349-58264fe0388f None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:20.204472 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-96b3a6dc-4fe5-4b4f-87cd-3343964302e8 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:20.205403 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-96b3a6dc-4fe5-4b4f-87cd-3343964302e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:20.297007 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 35/69] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 09:14:20.297889 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3a6dc-4fe5-4b4f-87cd-3343964302e8 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:20.342212 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751c0d6-3f96-444f-a349-58264fe0388f None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:20.377950 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58223e53-7e0e-450f-98fe-b0d33718e09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:20.379166 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58223e53-7e0e-450f-98fe-b0d33718e09f None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:20.379661 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58223e53-7e0e-450f-98fe-b0d33718e09f None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:20.380244 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58223e53-7e0e-450f-98fe-b0d33718e09f None admin] PATH_INFO: `/v3/users/bc89b2dd30b74b7998bc9496e8f9bdfb` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:20.397097 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58223e53-7e0e-450f-98fe-b0d33718e09f None admin] RBAC: Authorizing `identity:get_user(user_id=bc89b2dd30b74b7998bc9496e8f9bdfb)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:20.399313 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58223e53-7e0e-450f-98fe-b0d33718e09f None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:20.406052 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 35/70] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Jun 27 09:14:20 2022] GET /identity/v3/users/bc89b2dd30b74b7998bc9496e8f9bdfb => generated 275 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:20.406052 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707e19d-2973-4d76-bcfd-2aeb26bbe49f None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:20.406052 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707e19d-2973-4d76-bcfd-2aeb26bbe49f None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:20.406052 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707e19d-2973-4d76-bcfd-2aeb26bbe49f None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:20.406052 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 36/71] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:14:20.406052 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707e19d-2973-4d76-bcfd-2aeb26bbe49f None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:20.420906 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3a6dc-4fe5-4b4f-87cd-3343964302e8 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:20.424328 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:20.458111 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a33d95f-f119-414d-a904-e46c55963c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:20.458905 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33d95f-f119-414d-a904-e46c55963c66 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:20.459189 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33d95f-f119-414d-a904-e46c55963c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:20.459465 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33d95f-f119-414d-a904-e46c55963c66 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:20.461420 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:20.471385 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a33d95f-f119-414d-a904-e46c55963c66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:14:20.481942 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-5a33d95f-f119-414d-a904-e46c55963c66 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:14:20.481942 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:14:20.481942 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:14:20.481942 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:14:20.481942 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:14:20.481942 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:14:20.481942 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:14:20.481942 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:14:20.481942 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:14:20.481942 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:14:20.481942 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:14:20.481942 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:14:20.481942 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:14:20.481942 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:14:20.481942 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:14:20.481942 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:14:20.482796 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:14:20.482796 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:14:20.482796 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:14:20.482796 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:14:20.482796 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:14:20.482796 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:14:20.482796 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:14:20.482796 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:14:20.482796 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:14:20.482796 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:14:20.482796 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:14:20.482796 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:14:20.482796 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:14:20.482796 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:14:20.482796 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:14:20.482796 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:14:20.483552 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:14:20.483552 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:14:20.483552 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:14:20.483552 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:14:20.483552 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:14:20.483552 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:14:20.483552 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:14:20.483552 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:14:20.483552 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:14:20.483552 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:14:20.483552 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:14:20.483552 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:14:20.484636 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 36/72] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Jun 27 09:14:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:14:20.488388 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a33d95f-f119-414d-a904-e46c55963c66 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:20.518124 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707e19d-2973-4d76-bcfd-2aeb26bbe49f None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:20.556151 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419960c1-1245-463e-92b0-4e9cc26064b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:20.557011 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419960c1-1245-463e-92b0-4e9cc26064b6 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:20.557296 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419960c1-1245-463e-92b0-4e9cc26064b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:20.557571 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419960c1-1245-463e-92b0-4e9cc26064b6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:20.569817 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419960c1-1245-463e-92b0-4e9cc26064b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:14:20.579776 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-419960c1-1245-463e-92b0-4e9cc26064b6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 09:14:20.579776 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:14:20.579776 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:14:20.579776 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:14:20.579776 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:14:20.579776 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:14:20.579776 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:14:20.579776 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:14:20.579776 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:14:20.579776 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:14:20.579776 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:14:20.579776 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:14:20.579776 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:14:20.579776 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:14:20.579776 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:14:20.579776 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:14:20.580657 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:14:20.580657 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:14:20.580657 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:14:20.580657 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:14:20.580657 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:14:20.580657 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:14:20.580657 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:14:20.580657 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:14:20.580657 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:14:20.580657 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:14:20.580657 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:14:20.580657 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:14:20.580657 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:14:20.580657 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:14:20.580657 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:14:20.580657 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:14:20.581434 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:14:20.581434 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:14:20.581434 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:14:20.581434 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:14:20.581434 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:14:20.581434 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:14:20.581434 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:14:20.581434 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:14:20.581434 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:14:20.581434 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:14:20.581434 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 09:14:20.581434 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:14:20.581434 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 37/73] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Jun 27 09:14:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:14:20.587218 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da74fba-88ef-4bf5-b045-37157e9b959a None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:20.587424 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da74fba-88ef-4bf5-b045-37157e9b959a None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:20.587699 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da74fba-88ef-4bf5-b045-37157e9b959a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:20.599006 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a33d95f-f119-414d-a904-e46c55963c66 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:20.604859 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-5da74fba-88ef-4bf5-b045-37157e9b959a None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:20.606321 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-5da74fba-88ef-4bf5-b045-37157e9b959a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:20.636656 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac85c73-8f10-4556-82fc-19bc044e2055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:20.637464 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac85c73-8f10-4556-82fc-19bc044e2055 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:20.637682 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac85c73-8f10-4556-82fc-19bc044e2055 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:20.637970 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac85c73-8f10-4556-82fc-19bc044e2055 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:20.676120 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 38/74] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:14:20.676934 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da74fba-88ef-4bf5-b045-37157e9b959a None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:20.681420 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:20.707763 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:20.715022 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac85c73-8f10-4556-82fc-19bc044e2055 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:20.716517 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac85c73-8f10-4556-82fc-19bc044e2055 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:20.776318 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da74fba-88ef-4bf5-b045-37157e9b959a None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:20.810746 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9526c6e-707d-4f84-a1df-bcc149051395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:20.811417 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9526c6e-707d-4f84-a1df-bcc149051395 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:20.811701 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9526c6e-707d-4f84-a1df-bcc149051395 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:20.811976 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9526c6e-707d-4f84-a1df-bcc149051395 None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:20.812754 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9526c6e-707d-4f84-a1df-bcc149051395 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:20.813058 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9526c6e-707d-4f84-a1df-bcc149051395 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:20.814441 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9526c6e-707d-4f84-a1df-bcc149051395 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:20.814630 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 37/75] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:14:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 09:14:20.815484 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac85c73-8f10-4556-82fc-19bc044e2055 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:20.822890 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 39/76] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:14:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:20.824013 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332c543-279b-4cbd-9d9e-2c777bcb36fd None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:20.824411 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332c543-279b-4cbd-9d9e-2c777bcb36fd None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:20.824690 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332c543-279b-4cbd-9d9e-2c777bcb36fd None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:20.825943 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 40/77] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:14:20.826653 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332c543-279b-4cbd-9d9e-2c777bcb36fd None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:20.892723 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:20.910583 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:20.917509 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac85c73-8f10-4556-82fc-19bc044e2055 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:20.934244 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332c543-279b-4cbd-9d9e-2c777bcb36fd None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:20.950713 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07727a4-8ca8-4fd0-b769-d8dfa03cbb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:20.951375 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07727a4-8ca8-4fd0-b769-d8dfa03cbb46 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:20.951655 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07727a4-8ca8-4fd0-b769-d8dfa03cbb46 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:20.951935 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07727a4-8ca8-4fd0-b769-d8dfa03cbb46 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:20.952704 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07727a4-8ca8-4fd0-b769-d8dfa03cbb46 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:20.953064 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07727a4-8ca8-4fd0-b769-d8dfa03cbb46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:20.955100 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07727a4-8ca8-4fd0-b769-d8dfa03cbb46 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:20.962211 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c271485b-a418-4d2f-8a96-7a971b9665d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:20.963000 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271485b-a418-4d2f-8a96-7a971b9665d9 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:20.963288 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271485b-a418-4d2f-8a96-7a971b9665d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:20.963468 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 38/78] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:14:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:20.968177 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271485b-a418-4d2f-8a96-7a971b9665d9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:20.968319 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07727a4-8ca8-4fd0-b769-d8dfa03cbb46 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:20.974376 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c271485b-a418-4d2f-8a96-7a971b9665d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:14:20.982698 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-c271485b-a418-4d2f-8a96-7a971b9665d9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 09:14:20.982698 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:14:20.982698 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:14:20.982698 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:14:20.982698 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:14:20.982698 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:14:20.982698 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:14:20.982698 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:14:20.982698 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:14:20.982698 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:14:20.982698 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:14:20.982698 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:14:20.982698 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:14:20.982698 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:14:20.982698 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:14:20.982698 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:14:20.983551 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:14:20.983551 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:14:20.983551 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:14:20.983551 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:14:20.983551 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:14:20.983551 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:14:20.983551 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:14:20.983551 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:14:20.983551 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:14:20.983551 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:14:20.983551 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:14:20.983551 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:14:20.983551 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:14:20.983551 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:14:20.983551 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:14:20.983551 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:14:20.989311 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:14:20.989311 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:14:20.989311 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:14:20.989311 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:14:20.989311 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:14:20.989311 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:14:20.989311 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:14:20.989311 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:14:20.989311 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:14:20.989311 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:14:20.989311 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 09:14:20.989311 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:14:20.989311 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 41/79] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:14:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:14:20.989311 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c271485b-a418-4d2f-8a96-7a971b9665d9 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:21.067552 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07727a4-8ca8-4fd0-b769-d8dfa03cbb46 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:21.083955 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c271485b-a418-4d2f-8a96-7a971b9665d9 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:21.100803 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80592a8f-0d94-4331-840d-3b6c6c742f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:21.104617 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80592a8f-0d94-4331-840d-3b6c6c742f96 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:21.104617 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80592a8f-0d94-4331-840d-3b6c6c742f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:21.104617 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80592a8f-0d94-4331-840d-3b6c6c742f96 None admin] PATH_INFO: `/v3/projects/7ef24b891e2145d0ac96f35d4f4c385f` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:21.104617 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80592a8f-0d94-4331-840d-3b6c6c742f96 None admin] RBAC: Authorizing `identity:get_project(project_id=7ef24b891e2145d0ac96f35d4f4c385f)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:21.105412 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80592a8f-0d94-4331-840d-3b6c6c742f96 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:21.107139 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 39/80] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:14:20 2022] GET /identity/v3/projects/7ef24b891e2145d0ac96f35d4f4c385f => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:21.109785 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35ddad-0ae7-42c7-9fe6-00f911aca2ec None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:21.110162 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35ddad-0ae7-42c7-9fe6-00f911aca2ec None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:21.110449 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35ddad-0ae7-42c7-9fe6-00f911aca2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:21.112695 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:21.121692 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b983ca-e15f-4533-86b7-617c308a2e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:21.122575 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b983ca-e15f-4533-86b7-617c308a2e6e None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:21.122859 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b983ca-e15f-4533-86b7-617c308a2e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:21.132531 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b983ca-e15f-4533-86b7-617c308a2e6e None admin] PATH_INFO: `/v3/users/a46ad49f063c49cdb572468399714ea8` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:21.132531 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b983ca-e15f-4533-86b7-617c308a2e6e None admin] RBAC: Authorizing `identity:get_user(user_id=a46ad49f063c49cdb572468399714ea8)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:21.132531 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b983ca-e15f-4533-86b7-617c308a2e6e None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:21.132531 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 42/81] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Jun 27 09:14:20 2022] GET /identity/v3/users/a46ad49f063c49cdb572468399714ea8 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:21.132531 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b983ca-e15f-4533-86b7-617c308a2e6e None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:21.132917 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-7b35ddad-0ae7-42c7-9fe6-00f911aca2ec None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:21.132917 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-7b35ddad-0ae7-42c7-9fe6-00f911aca2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:21.150366 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:21.201923 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 40/82] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:14:21.202790 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b35ddad-0ae7-42c7-9fe6-00f911aca2ec None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:21.235495 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b983ca-e15f-4533-86b7-617c308a2e6e None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:21.269894 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73219d09-2f2e-49c3-8335-022d89386110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:21.270777 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73219d09-2f2e-49c3-8335-022d89386110 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:21.271067 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73219d09-2f2e-49c3-8335-022d89386110 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:21.271345 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73219d09-2f2e-49c3-8335-022d89386110 None admin] PATH_INFO: `/v3/users/bc89b2dd30b74b7998bc9496e8f9bdfb` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:21.272588 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73219d09-2f2e-49c3-8335-022d89386110 None admin] RBAC: Authorizing `identity:get_user(user_id=bc89b2dd30b74b7998bc9496e8f9bdfb)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:21.274568 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73219d09-2f2e-49c3-8335-022d89386110 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:21.276227 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 43/83] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Jun 27 09:14:21 2022] GET /identity/v3/users/bc89b2dd30b74b7998bc9496e8f9bdfb => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:21.277087 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73219d09-2f2e-49c3-8335-022d89386110 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:21.302603 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b35ddad-0ae7-42c7-9fe6-00f911aca2ec None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:21.337656 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9484ccc6-ce61-48fb-be8a-bae4bde84a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:21.338327 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484ccc6-ce61-48fb-be8a-bae4bde84a55 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:21.338437 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:21.338617 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484ccc6-ce61-48fb-be8a-bae4bde84a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:21.339208 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484ccc6-ce61-48fb-be8a-bae4bde84a55 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:21.339823 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9484ccc6-ce61-48fb-be8a-bae4bde84a55 None admin] RBAC: Adding query filter params (name=member) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:21.339968 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9484ccc6-ce61-48fb-be8a-bae4bde84a55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:21.341419 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9484ccc6-ce61-48fb-be8a-bae4bde84a55 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:21.349761 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 41/84] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Jun 27 09:14:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:21.350683 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9484ccc6-ce61-48fb-be8a-bae4bde84a55 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:21.370924 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:21.378937 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73219d09-2f2e-49c3-8335-022d89386110 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:21.417566 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26bd97f-d97f-47be-aba1-4e9f8fdf8abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:21.418228 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bd97f-d97f-47be-aba1-4e9f8fdf8abd None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:21.418517 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bd97f-d97f-47be-aba1-4e9f8fdf8abd None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:21.418798 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bd97f-d97f-47be-aba1-4e9f8fdf8abd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:21.419641 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26bd97f-d97f-47be-aba1-4e9f8fdf8abd None admin] RBAC: Adding query filter params (role.id=b1260d153ca7497eaaaa0991f053ff89, scope.project.id=7ef24b891e2145d0ac96f35d4f4c385f, user.id=bc89b2dd30b74b7998bc9496e8f9bdfb) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:21.419957 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26bd97f-d97f-47be-aba1-4e9f8fdf8abd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:21.421465 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26bd97f-d97f-47be-aba1-4e9f8fdf8abd None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:21.429395 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 44/85] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Jun 27 09:14:21 2022] GET /identity/v3/role_assignments?user.id=bc89b2dd30b74b7998bc9496e8f9bdfb&scope.project.id=7ef24b891e2145d0ac96f35d4f4c385f&role.id=b1260d153ca7497eaaaa0991f053ff89 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:21.430208 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26bd97f-d97f-47be-aba1-4e9f8fdf8abd None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:21.458589 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9484ccc6-ce61-48fb-be8a-bae4bde84a55 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:21.498329 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247a4c6-2c6d-47ce-b702-8981931bbf64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:21.499002 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247a4c6-2c6d-47ce-b702-8981931bbf64 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:21.499828 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247a4c6-2c6d-47ce-b702-8981931bbf64 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:21.499828 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247a4c6-2c6d-47ce-b702-8981931bbf64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:21.571548 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26bd97f-d97f-47be-aba1-4e9f8fdf8abd None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:21.575939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2247a4c6-2c6d-47ce-b702-8981931bbf64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:21.577479 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2247a4c6-2c6d-47ce-b702-8981931bbf64 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:21.607893 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:21.608100 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:21.611228 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f191a6a-2e01-4cd0-8833-0d1af016e2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:21.612064 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f191a6a-2e01-4cd0-8833-0d1af016e2a8 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:21.612386 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f191a6a-2e01-4cd0-8833-0d1af016e2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:21.612671 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f191a6a-2e01-4cd0-8833-0d1af016e2a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:21.614053 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f191a6a-2e01-4cd0-8833-0d1af016e2a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:21.615527 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f191a6a-2e01-4cd0-8833-0d1af016e2a8 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:21.621768 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 45/86] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:14:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:21.621768 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f191a6a-2e01-4cd0-8833-0d1af016e2a8 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:21.697672 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 42/87] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:14:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 09:14:21.699106 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247a4c6-2c6d-47ce-b702-8981931bbf64 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:21.730513 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f191a6a-2e01-4cd0-8833-0d1af016e2a8 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:21.767161 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021291b1-8192-47b3-a36d-ba3ce4d79133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:21.767819 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021291b1-8192-47b3-a36d-ba3ce4d79133 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:21.768104 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021291b1-8192-47b3-a36d-ba3ce4d79133 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:21.768455 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021291b1-8192-47b3-a36d-ba3ce4d79133 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:21.801582 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247a4c6-2c6d-47ce-b702-8981931bbf64 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:21.820328 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:21.838438 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9b6a3-192c-4eba-94d6-56a41fbedc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:21.839310 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9b6a3-192c-4eba-94d6-56a41fbedc3e None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:21.839592 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9b6a3-192c-4eba-94d6-56a41fbedc3e None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:21.839866 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9b6a3-192c-4eba-94d6-56a41fbedc3e None admin] PATH_INFO: `/v3/users/bc89b2dd30b74b7998bc9496e8f9bdfb` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:21.840505 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:21.841375 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea9b6a3-192c-4eba-94d6-56a41fbedc3e None admin] RBAC: Authorizing `identity:get_user(user_id=bc89b2dd30b74b7998bc9496e8f9bdfb)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:21.842600 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea9b6a3-192c-4eba-94d6-56a41fbedc3e None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:21.844257 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 43/88] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Jun 27 09:14:21 2022] GET /identity/v3/users/bc89b2dd30b74b7998bc9496e8f9bdfb => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:21.848386 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9b6a3-192c-4eba-94d6-56a41fbedc3e None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:21.849317 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021291b1-8192-47b3-a36d-ba3ce4d79133 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:21.850424 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021291b1-8192-47b3-a36d-ba3ce4d79133 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:21.955224 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9b6a3-192c-4eba-94d6-56a41fbedc3e None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:21.960912 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 46/89] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:14:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 09:14:21.960912 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021291b1-8192-47b3-a36d-ba3ce4d79133 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:21.994567 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d479bea-4f7a-45da-a312-41b5327eddf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:21.995156 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d479bea-4f7a-45da-a312-41b5327eddf3 None admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:21.995441 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d479bea-4f7a-45da-a312-41b5327eddf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:21.995717 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d479bea-4f7a-45da-a312-41b5327eddf3 None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:21.996466 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d479bea-4f7a-45da-a312-41b5327eddf3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:21.997922 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d479bea-4f7a-45da-a312-41b5327eddf3 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:22.051289 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:22.058308 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021291b1-8192-47b3-a36d-ba3ce4d79133 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:22.087248 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 44/90] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Jun 27 09:14:21 2022] POST /identity/v3/users => generated 289 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:14:22.088446 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d479bea-4f7a-45da-a312-41b5327eddf3 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:22.111686 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2558e-7722-4ef0-8d3b-db1e52a4c4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:22.113058 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2558e-7722-4ef0-8d3b-db1e52a4c4cb None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:22.114025 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2558e-7722-4ef0-8d3b-db1e52a4c4cb None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:22.114025 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2558e-7722-4ef0-8d3b-db1e52a4c4cb None admin] PATH_INFO: `/v3/projects/7ef24b891e2145d0ac96f35d4f4c385f` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:22.115288 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2558e-7722-4ef0-8d3b-db1e52a4c4cb None admin] RBAC: Authorizing `identity:get_project(project_id=7ef24b891e2145d0ac96f35d4f4c385f)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:22.117459 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2558e-7722-4ef0-8d3b-db1e52a4c4cb None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:22.119882 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 47/91] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:14:21 2022] GET /identity/v3/projects/7ef24b891e2145d0ac96f35d4f4c385f => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:22.125683 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2558e-7722-4ef0-8d3b-db1e52a4c4cb None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:22.152970 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:22.233843 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d479bea-4f7a-45da-a312-41b5327eddf3 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:22.260307 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2558e-7722-4ef0-8d3b-db1e52a4c4cb None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:22.290504 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9c28f-cf03-4c98-9a9c-bdfe5ff4590f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:22.291251 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9c28f-cf03-4c98-9a9c-bdfe5ff4590f None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:22.291463 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9c28f-cf03-4c98-9a9c-bdfe5ff4590f None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:22.291952 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9c28f-cf03-4c98-9a9c-bdfe5ff4590f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:22.305546 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408e7bf-a1d4-4707-9614-14297507a314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:22.306417 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408e7bf-a1d4-4707-9614-14297507a314 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:22.307261 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408e7bf-a1d4-4707-9614-14297507a314 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:22.308520 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408e7bf-a1d4-4707-9614-14297507a314 None admin] PATH_INFO: `/v3/projects/7ef24b891e2145d0ac96f35d4f4c385f` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:22.308831 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1408e7bf-a1d4-4707-9614-14297507a314 None admin] RBAC: Authorizing `identity:get_project(project_id=7ef24b891e2145d0ac96f35d4f4c385f)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:22.310896 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1408e7bf-a1d4-4707-9614-14297507a314 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:22.313643 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 48/92] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:14:22 2022] GET /identity/v3/projects/7ef24b891e2145d0ac96f35d4f4c385f => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:22.314435 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408e7bf-a1d4-4707-9614-14297507a314 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:22.365824 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:22.395672 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d9c28f-cf03-4c98-9a9c-bdfe5ff4590f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:22.397238 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d9c28f-cf03-4c98-9a9c-bdfe5ff4590f None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:22.449797 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:22.458890 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408e7bf-a1d4-4707-9614-14297507a314 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:22.506738 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca903af2-8281-403a-98d2-20272ec5178d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:22.507426 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca903af2-8281-403a-98d2-20272ec5178d None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:22.507710 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca903af2-8281-403a-98d2-20272ec5178d None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:22.507986 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca903af2-8281-403a-98d2-20272ec5178d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:22.508862 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca903af2-8281-403a-98d2-20272ec5178d None admin] RBAC: Adding query filter params (role.id=91c77942515d45f1ad8189c9fddf4424, scope.project.id=7ef24b891e2145d0ac96f35d4f4c385f, user.id=a46ad49f063c49cdb572468399714ea8) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:22.509187 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca903af2-8281-403a-98d2-20272ec5178d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:22.510699 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca903af2-8281-403a-98d2-20272ec5178d None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:22.516923 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 49/93] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Jun 27 09:14:22 2022] GET /identity/v3/role_assignments?user.id=a46ad49f063c49cdb572468399714ea8&scope.project.id=7ef24b891e2145d0ac96f35d4f4c385f&role.id=91c77942515d45f1ad8189c9fddf4424 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:22.517748 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca903af2-8281-403a-98d2-20272ec5178d None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:22.613748 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 45/94] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:14:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 09:14:22.621027 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9c28f-cf03-4c98-9a9c-bdfe5ff4590f None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:22.762102 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:22.775580 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca903af2-8281-403a-98d2-20272ec5178d None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:22.823492 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9c28f-cf03-4c98-9a9c-bdfe5ff4590f None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:22.852983 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ab6f1-d4cb-4afe-a97a-651de2be0156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:22.853745 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ab6f1-d4cb-4afe-a97a-651de2be0156 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:22.854103 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ab6f1-d4cb-4afe-a97a-651de2be0156 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:22.854453 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ab6f1-d4cb-4afe-a97a-651de2be0156 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:22.855375 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050ab6f1-d4cb-4afe-a97a-651de2be0156 None admin] RBAC: Adding query filter params (role.id=b137366eb53b42aab629a88be737eaf9, scope.project.id=7ef24b891e2145d0ac96f35d4f4c385f, user.id=bc89b2dd30b74b7998bc9496e8f9bdfb) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:22.855783 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050ab6f1-d4cb-4afe-a97a-651de2be0156 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:22.857370 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050ab6f1-d4cb-4afe-a97a-651de2be0156 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:22.869081 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 50/95] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Jun 27 09:14:22 2022] GET /identity/v3/role_assignments?user.id=bc89b2dd30b74b7998bc9496e8f9bdfb&scope.project.id=7ef24b891e2145d0ac96f35d4f4c385f&role.id=b137366eb53b42aab629a88be737eaf9 => generated 259 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:22.880762 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870458c3-aa3c-4d69-ad78-b79aae063666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:22.881733 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870458c3-aa3c-4d69-ad78-b79aae063666 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:22.882100 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870458c3-aa3c-4d69-ad78-b79aae063666 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:22.882480 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870458c3-aa3c-4d69-ad78-b79aae063666 None admin] PATH_INFO: `/v3/projects/9b5414711ae248208d2e9269d3b0210e` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:22.883792 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870458c3-aa3c-4d69-ad78-b79aae063666 None admin] RBAC: Authorizing `identity:get_project(project_id=9b5414711ae248208d2e9269d3b0210e)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:22.885411 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870458c3-aa3c-4d69-ad78-b79aae063666 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:22.887520 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 46/96] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:14:22 2022] GET /identity/v3/projects/9b5414711ae248208d2e9269d3b0210e => generated 312 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:14:22.893144 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ab6f1-d4cb-4afe-a97a-651de2be0156 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:23.002774 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ab6f1-d4cb-4afe-a97a-651de2be0156 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:23.041197 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8de41-6a10-4a3d-a981-ff834e47f5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:23.041874 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8de41-6a10-4a3d-a981-ff834e47f5ce None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:23.042161 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8de41-6a10-4a3d-a981-ff834e47f5ce None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:23.042440 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8de41-6a10-4a3d-a981-ff834e47f5ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:23.043292 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba8de41-6a10-4a3d-a981-ff834e47f5ce None admin] RBAC: Adding query filter params (role.id=b1260d153ca7497eaaaa0991f053ff89, scope.project.id=9b5414711ae248208d2e9269d3b0210e, user.id=bc89b2dd30b74b7998bc9496e8f9bdfb) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:23.043609 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba8de41-6a10-4a3d-a981-ff834e47f5ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:23.045165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba8de41-6a10-4a3d-a981-ff834e47f5ce None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:23.051565 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 51/97] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Jun 27 09:14:22 2022] GET /identity/v3/role_assignments?user.id=bc89b2dd30b74b7998bc9496e8f9bdfb&scope.project.id=9b5414711ae248208d2e9269d3b0210e&role.id=b1260d153ca7497eaaaa0991f053ff89 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:23.882239 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777872db-3c46-4404-a70b-c148169abce2 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:23.882769 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777872db-3c46-4404-a70b-c148169abce2 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:23.882863 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777872db-3c46-4404-a70b-c148169abce2 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:23.884462 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 47/98] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:14:23.889856 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d09b50-76b7-4748-aa97-482546085417 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:23.890269 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d09b50-76b7-4748-aa97-482546085417 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:23.890457 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d09b50-76b7-4748-aa97-482546085417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:23.907852 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-33d09b50-76b7-4748-aa97-482546085417 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:23.909107 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-33d09b50-76b7-4748-aa97-482546085417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:23.928914 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:23.984572 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 52/99] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:14:24.007115 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777872db-3c46-4404-a70b-c148169abce2 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:24.018955 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:24.145129 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777872db-3c46-4404-a70b-c148169abce2 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:24.197336 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6656e9-3f29-4429-a333-af5d8dbda385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:24.198144 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6656e9-3f29-4429-a333-af5d8dbda385 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:24.198438 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6656e9-3f29-4429-a333-af5d8dbda385 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:24.198756 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6656e9-3f29-4429-a333-af5d8dbda385 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:24.213005 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6656e9-3f29-4429-a333-af5d8dbda385 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:14:24.221062 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-dd6656e9-3f29-4429-a333-af5d8dbda385 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 09:14:24.221062 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:14:24.221062 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:14:24.221062 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:14:24.221062 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:14:24.221062 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:14:24.221062 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:14:24.221062 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:14:24.221062 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:14:24.221062 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:14:24.221062 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:14:24.221062 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:14:24.221062 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:14:24.221062 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:14:24.221062 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:14:24.221062 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:14:24.221963 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:14:24.221963 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:14:24.221963 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:14:24.221963 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:14:24.221963 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:14:24.221963 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:14:24.221963 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:14:24.221963 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:14:24.221963 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:14:24.221963 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:14:24.221963 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:14:24.221963 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:14:24.221963 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:14:24.221963 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:14:24.221963 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:14:24.221963 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:14:24.223156 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:14:24.223156 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:14:24.223156 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:14:24.223156 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:14:24.223156 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:14:24.223156 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:14:24.223156 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:14:24.223156 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:14:24.223156 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:14:24.223156 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:14:24.223156 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 09:14:24.223156 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:14:24.223156 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 48/100] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:14:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:14:24.228550 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d09b50-76b7-4748-aa97-482546085417 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:24.343776 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d09b50-76b7-4748-aa97-482546085417 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:24.379784 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1241a4-0a77-4d1b-920a-4adcc3957d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:24.380497 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1241a4-0a77-4d1b-920a-4adcc3957d57 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:24.380786 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1241a4-0a77-4d1b-920a-4adcc3957d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:24.381066 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1241a4-0a77-4d1b-920a-4adcc3957d57 None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:24.381822 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1241a4-0a77-4d1b-920a-4adcc3957d57 None admin] RBAC: Adding query filter params (name=member) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:24.382158 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1241a4-0a77-4d1b-920a-4adcc3957d57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:24.384078 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1241a4-0a77-4d1b-920a-4adcc3957d57 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:24.393037 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 53/101] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Jun 27 09:14:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:24.398479 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6656e9-3f29-4429-a333-af5d8dbda385 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:24.487793 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:24.532328 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6656e9-3f29-4429-a333-af5d8dbda385 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:24.615606 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f018d76-1d2f-4591-b809-97c24e6d1d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:24.617117 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f018d76-1d2f-4591-b809-97c24e6d1d42 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:24.617418 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f018d76-1d2f-4591-b809-97c24e6d1d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:24.617697 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f018d76-1d2f-4591-b809-97c24e6d1d42 None admin] PATH_INFO: `/v3/users/bc89b2dd30b74b7998bc9496e8f9bdfb` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:24.619000 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f018d76-1d2f-4591-b809-97c24e6d1d42 None admin] RBAC: Authorizing `identity:get_user(user_id=bc89b2dd30b74b7998bc9496e8f9bdfb)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:24.620511 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f018d76-1d2f-4591-b809-97c24e6d1d42 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:24.622229 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 49/102] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Jun 27 09:14:24 2022] GET /identity/v3/users/bc89b2dd30b74b7998bc9496e8f9bdfb => generated 275 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:24.627961 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1241a4-0a77-4d1b-920a-4adcc3957d57 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:24.665644 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:24.806298 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1241a4-0a77-4d1b-920a-4adcc3957d57 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:24.845919 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c7f79c-9ec9-47d0-a799-877b73b43be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:24.846793 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7f79c-9ec9-47d0-a799-877b73b43be0 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:24.847078 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7f79c-9ec9-47d0-a799-877b73b43be0 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:24.847352 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7f79c-9ec9-47d0-a799-877b73b43be0 None admin] PATH_INFO: `/v3/projects/7ef24b891e2145d0ac96f35d4f4c385f` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:24.852985 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c7f79c-9ec9-47d0-a799-877b73b43be0 None admin] RBAC: Authorizing `identity:get_project(project_id=7ef24b891e2145d0ac96f35d4f4c385f)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:24.854470 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c7f79c-9ec9-47d0-a799-877b73b43be0 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:24.856492 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 54/103] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:14:24 2022] GET /identity/v3/projects/7ef24b891e2145d0ac96f35d4f4c385f => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:24.865298 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f018d76-1d2f-4591-b809-97c24e6d1d42 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:24.987218 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f018d76-1d2f-4591-b809-97c24e6d1d42 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:25.022002 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e5484-823b-4440-8d4d-c4023d86f636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:25.023436 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e5484-823b-4440-8d4d-c4023d86f636 None admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:25.023727 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e5484-823b-4440-8d4d-c4023d86f636 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:25.024010 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e5484-823b-4440-8d4d-c4023d86f636 None admin] PATH_INFO: `/v3/projects/7ef24b891e2145d0ac96f35d4f4c385f/users/bc89b2dd30b74b7998bc9496e8f9bdfb/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:25.026134 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e5484-823b-4440-8d4d-c4023d86f636 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ef24b891e2145d0ac96f35d4f4c385f, user_id=bc89b2dd30b74b7998bc9496e8f9bdfb, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:25.027626 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e5484-823b-4440-8d4d-c4023d86f636 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:25.032537 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:25.099402 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 50/104] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Jun 27 09:14:24 2022] PUT /identity/v3/projects/7ef24b891e2145d0ac96f35d4f4c385f/users/bc89b2dd30b74b7998bc9496e8f9bdfb/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:14:25.323375 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ebc9c-b363-47a1-83c7-b1dd7dfaf7bb None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:25.323892 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ebc9c-b363-47a1-83c7-b1dd7dfaf7bb None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:25.323965 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ebc9c-b363-47a1-83c7-b1dd7dfaf7bb None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:25.325386 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 55/105] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:14:25.331407 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a847676-b67e-4cd9-8e37-ab8c995782da None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:25.331694 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a847676-b67e-4cd9-8e37-ab8c995782da None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:25.331980 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a847676-b67e-4cd9-8e37-ab8c995782da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:25.359356 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-8a847676-b67e-4cd9-8e37-ab8c995782da None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:25.360632 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-8a847676-b67e-4cd9-8e37-ab8c995782da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:25.439277 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 51/106] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:14:25.458689 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea9906-d049-45ba-ba13-d9fde6526216 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:25.458990 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea9906-d049-45ba-ba13-d9fde6526216 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:25.459256 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea9906-d049-45ba-ba13-d9fde6526216 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:25.461386 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 56/107] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:14:25.469131 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66d77d-6a54-47ef-8210-ab2fa61941a5 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:25.469131 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66d77d-6a54-47ef-8210-ab2fa61941a5 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:25.469131 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66d77d-6a54-47ef-8210-ab2fa61941a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:25.476307 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bea9906-d049-45ba-ba13-d9fde6526216 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:25.487100 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-ee66d77d-6a54-47ef-8210-ab2fa61941a5 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:25.488327 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-ee66d77d-6a54-47ef-8210-ab2fa61941a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:25.617368 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:25.619917 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 52/108] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:14:25.621204 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03c762-469a-4170-a0a3-614486b6b6d9 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:25.621496 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03c762-469a-4170-a0a3-614486b6b6d9 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:25.621775 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03c762-469a-4170-a0a3-614486b6b6d9 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:25.627328 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 53/109] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:14:25.631338 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4eed19-87b4-4023-9c46-48949e0468e8 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:25.631338 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4eed19-87b4-4023-9c46-48949e0468e8 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:25.631338 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4eed19-87b4-4023-9c46-48949e0468e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:25.631558 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bea9906-d049-45ba-ba13-d9fde6526216 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:25.657382 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-3e4eed19-87b4-4023-9c46-48949e0468e8 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:25.658705 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-3e4eed19-87b4-4023-9c46-48949e0468e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:25.669583 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767e3781-5120-41c3-8bb0-3ad7cee6d0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:25.670444 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e3781-5120-41c3-8bb0-3ad7cee6d0d2 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:25.670732 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e3781-5120-41c3-8bb0-3ad7cee6d0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:25.671015 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e3781-5120-41c3-8bb0-3ad7cee6d0d2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:25.682661 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767e3781-5120-41c3-8bb0-3ad7cee6d0d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:14:25.690850 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-767e3781-5120-41c3-8bb0-3ad7cee6d0d2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 09:14:25.690850 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:14:25.690850 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:14:25.690850 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:14:25.690850 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:14:25.690850 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:14:25.690850 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:14:25.690850 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:14:25.690850 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:14:25.690850 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:14:25.690850 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:14:25.690850 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:14:25.690850 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:14:25.690850 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:14:25.690850 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:14:25.690850 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:14:25.691737 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:14:25.691737 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:14:25.691737 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:14:25.691737 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:14:25.691737 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:14:25.691737 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:14:25.691737 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:14:25.691737 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:14:25.691737 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:14:25.691737 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:14:25.691737 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:14:25.691737 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:14:25.691737 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:14:25.691737 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:14:25.691737 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:14:25.691737 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:14:25.692548 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:14:25.692548 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:14:25.692548 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:14:25.692548 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:14:25.692548 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:14:25.692548 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:14:25.692548 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:14:25.692548 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:14:25.692548 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:14:25.692548 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:14:25.692548 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 09:14:25.692548 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:14:25.692548 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 57/110] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:14:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:14:25.703822 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767e3781-5120-41c3-8bb0-3ad7cee6d0d2 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:25.740592 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:25.760231 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 54/111] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 09:14:25.761107 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4eed19-87b4-4023-9c46-48949e0468e8 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:25.817923 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767e3781-5120-41c3-8bb0-3ad7cee6d0d2 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:25.855384 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a71f44-59c4-4064-9eb7-cad111f2c551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:25.856221 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a71f44-59c4-4064-9eb7-cad111f2c551 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:25.856507 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a71f44-59c4-4064-9eb7-cad111f2c551 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:25.856788 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a71f44-59c4-4064-9eb7-cad111f2c551 None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:25.857549 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a71f44-59c4-4064-9eb7-cad111f2c551 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:25.857860 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a71f44-59c4-4064-9eb7-cad111f2c551 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:25.859520 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a71f44-59c4-4064-9eb7-cad111f2c551 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:25.869154 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4eed19-87b4-4023-9c46-48949e0468e8 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:25.869699 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 58/112] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Jun 27 09:14:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:14:25.870386 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a71f44-59c4-4064-9eb7-cad111f2c551 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:25.877741 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:25.912220 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d177a7b4-2355-419e-a9a3-e7ba4ead83ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:25.912220 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d177a7b4-2355-419e-a9a3-e7ba4ead83ed None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:25.912790 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d177a7b4-2355-419e-a9a3-e7ba4ead83ed None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:25.912790 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d177a7b4-2355-419e-a9a3-e7ba4ead83ed None admin] PATH_INFO: `/v3/domains/default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:25.920229 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d177a7b4-2355-419e-a9a3-e7ba4ead83ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:25.920229 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d177a7b4-2355-419e-a9a3-e7ba4ead83ed None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:25.920229 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 55/113] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:14:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:25.924220 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d177a7b4-2355-419e-a9a3-e7ba4ead83ed None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:25.984376 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a71f44-59c4-4064-9eb7-cad111f2c551 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:26.020845 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa7902-bc6e-46ba-b385-b3a79abe8d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:26.021656 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa7902-bc6e-46ba-b385-b3a79abe8d16 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:26.021941 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa7902-bc6e-46ba-b385-b3a79abe8d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:26.022221 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa7902-bc6e-46ba-b385-b3a79abe8d16 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:26.034436 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfa7902-bc6e-46ba-b385-b3a79abe8d16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:14:26.042476 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-4bfa7902-bc6e-46ba-b385-b3a79abe8d16 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:14:26.042476 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:14:26.042476 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:14:26.042476 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:14:26.042476 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:14:26.042476 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:14:26.042476 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:14:26.042476 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:14:26.042476 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:14:26.042476 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:14:26.042476 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:14:26.042476 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:14:26.042476 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:14:26.042476 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:14:26.042476 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:14:26.042476 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:14:26.043407 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:14:26.043407 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:14:26.043407 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:14:26.043407 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:14:26.043407 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:14:26.043407 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:14:26.043407 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:14:26.043407 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:14:26.043407 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:14:26.043407 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:14:26.043407 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:14:26.043407 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:14:26.043407 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:14:26.043407 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:14:26.043407 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:14:26.043407 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:14:26.044211 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:14:26.044211 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:14:26.044211 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:14:26.044211 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:14:26.044211 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:14:26.044211 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:14:26.044211 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:14:26.044211 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:14:26.044211 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:14:26.044211 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:14:26.044211 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:14:26.044211 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:14:26.044800 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:26.046936 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 59/114] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Jun 27 09:14:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:14:26.047874 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa7902-bc6e-46ba-b385-b3a79abe8d16 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:26.135925 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d177a7b4-2355-419e-a9a3-e7ba4ead83ed None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:26.174397 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:26.198849 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e1a61-7248-45b2-be5d-20c21a97ce61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:26.199742 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e1a61-7248-45b2-be5d-20c21a97ce61 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:26.200025 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e1a61-7248-45b2-be5d-20c21a97ce61 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:26.200334 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e1a61-7248-45b2-be5d-20c21a97ce61 None admin] PATH_INFO: `/v3/users/6d9b34bebb7c4179ac2a5751cd671bb8` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:26.220654 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa7902-bc6e-46ba-b385-b3a79abe8d16 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:26.238047 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e1a61-7248-45b2-be5d-20c21a97ce61 None admin] RBAC: Authorizing `identity:get_user(user_id=6d9b34bebb7c4179ac2a5751cd671bb8)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:26.239544 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e1a61-7248-45b2-be5d-20c21a97ce61 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:26.241538 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 56/115] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Jun 27 09:14:25 2022] GET /identity/v3/users/6d9b34bebb7c4179ac2a5751cd671bb8 => generated 289 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:26.246537 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e1a61-7248-45b2-be5d-20c21a97ce61 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:26.259155 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0091ffb-6cfe-440e-a299-27d91d885415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:26.259827 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0091ffb-6cfe-440e-a299-27d91d885415 None admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:26.260167 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0091ffb-6cfe-440e-a299-27d91d885415 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:26.260479 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0091ffb-6cfe-440e-a299-27d91d885415 None admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:26.261275 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0091ffb-6cfe-440e-a299-27d91d885415 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:26.262959 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0091ffb-6cfe-440e-a299-27d91d885415 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:26.364410 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 60/116] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Jun 27 09:14:26 2022] POST /identity/v3/projects => generated 302 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:14:26.365024 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0091ffb-6cfe-440e-a299-27d91d885415 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:26.405390 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e1a61-7248-45b2-be5d-20c21a97ce61 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:26.422531 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:26.446857 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f3cc7-1bc8-4117-b3e2-1811675ffd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:26.447644 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f3cc7-1bc8-4117-b3e2-1811675ffd2f None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:26.447934 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f3cc7-1bc8-4117-b3e2-1811675ffd2f None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:26.448242 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f3cc7-1bc8-4117-b3e2-1811675ffd2f None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:26.449043 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273f3cc7-1bc8-4117-b3e2-1811675ffd2f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:26.449373 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273f3cc7-1bc8-4117-b3e2-1811675ffd2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:26.450811 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273f3cc7-1bc8-4117-b3e2-1811675ffd2f None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:26.463920 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 57/117] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:14:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:26.463920 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0248c2ca-df22-435a-a65e-65f6714e5cb0 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:26.463920 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0248c2ca-df22-435a-a65e-65f6714e5cb0 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:26.463920 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0248c2ca-df22-435a-a65e-65f6714e5cb0 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:26.463920 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 58/118] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:14:26.465062 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43114fa7-a8dd-48ea-9a3b-8a6be06375b6 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:26.467665 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43114fa7-a8dd-48ea-9a3b-8a6be06375b6 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:26.467665 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43114fa7-a8dd-48ea-9a3b-8a6be06375b6 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:26.472769 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 59/119] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:14:26.474801 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43114fa7-a8dd-48ea-9a3b-8a6be06375b6 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:26.528395 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0091ffb-6cfe-440e-a299-27d91d885415 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:26.569508 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:26.589828 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f3bf7-e0c6-4494-a76d-9101610794c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:26.591092 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f3bf7-e0c6-4494-a76d-9101610794c0 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:26.591220 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f3bf7-e0c6-4494-a76d-9101610794c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:26.591488 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f3bf7-e0c6-4494-a76d-9101610794c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:26.648869 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43114fa7-a8dd-48ea-9a3b-8a6be06375b6 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:26.687316 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4eb8f6-88b4-4f0e-9f74-3543e11ecee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:26.688121 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4eb8f6-88b4-4f0e-9f74-3543e11ecee2 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:26.688432 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4eb8f6-88b4-4f0e-9f74-3543e11ecee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:26.688708 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4eb8f6-88b4-4f0e-9f74-3543e11ecee2 None admin] PATH_INFO: `/v3/users/a46ad49f063c49cdb572468399714ea8` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:26.689981 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4eb8f6-88b4-4f0e-9f74-3543e11ecee2 None admin] RBAC: Authorizing `identity:get_user(user_id=a46ad49f063c49cdb572468399714ea8)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:26.691508 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4eb8f6-88b4-4f0e-9f74-3543e11ecee2 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:26.694587 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 60/120] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Jun 27 09:14:26 2022] GET /identity/v3/users/a46ad49f063c49cdb572468399714ea8 => generated 247 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:26.698161 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913b830-cd41-43d0-9b6a-427729b14f6b None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:26.698161 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913b830-cd41-43d0-9b6a-427729b14f6b None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:26.698161 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913b830-cd41-43d0-9b6a-427729b14f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:26.702372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f3bf7-e0c6-4494-a76d-9101610794c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:26.703948 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f3bf7-e0c6-4494-a76d-9101610794c0 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:26.716287 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-2913b830-cd41-43d0-9b6a-427729b14f6b None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:26.718325 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-2913b830-cd41-43d0-9b6a-427729b14f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:26.757052 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:26.792855 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 61/121] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:14:26.794536 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd8a00-18d1-45bb-a38f-d643033a6cab None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:26.795021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd8a00-18d1-45bb-a38f-d643033a6cab None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:26.795470 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd8a00-18d1-45bb-a38f-d643033a6cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:26.835292 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-e0fd8a00-18d1-45bb-a38f-d643033a6cab None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:26.836863 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-e0fd8a00-18d1-45bb-a38f-d643033a6cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:26.915904 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 61/122] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:14:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 09:14:26.921130 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f3bf7-e0c6-4494-a76d-9101610794c0 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:26.924109 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 62/123] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:14:26.927145 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd8a00-18d1-45bb-a38f-d643033a6cab None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:26.963630 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:27.118996 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd8a00-18d1-45bb-a38f-d643033a6cab None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:27.120646 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:27.126535 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f3bf7-e0c6-4494-a76d-9101610794c0 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:27.156770 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be377018-591d-4a63-9a06-584f769066f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:27.157718 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be377018-591d-4a63-9a06-584f769066f4 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:27.158101 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be377018-591d-4a63-9a06-584f769066f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:27.158490 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be377018-591d-4a63-9a06-584f769066f4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:27.170103 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2690c81-d3a2-4d3a-bc5e-367d3e385357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:27.171156 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be377018-591d-4a63-9a06-584f769066f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:14:27.171458 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2690c81-d3a2-4d3a-bc5e-367d3e385357 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:27.171921 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2690c81-d3a2-4d3a-bc5e-367d3e385357 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:27.172430 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2690c81-d3a2-4d3a-bc5e-367d3e385357 None admin] PATH_INFO: `/v3/projects/7ef24b891e2145d0ac96f35d4f4c385f` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:27.173845 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2690c81-d3a2-4d3a-bc5e-367d3e385357 None admin] RBAC: Authorizing `identity:get_project(project_id=7ef24b891e2145d0ac96f35d4f4c385f)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:27.175486 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2690c81-d3a2-4d3a-bc5e-367d3e385357 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:27.181708 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-be377018-591d-4a63-9a06-584f769066f4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 09:14:27.181708 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:14:27.181708 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:14:27.181708 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:14:27.181708 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:14:27.181708 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:14:27.181708 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:14:27.181708 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:14:27.181708 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:14:27.181708 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:14:27.181708 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:14:27.181708 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:14:27.181708 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:14:27.181708 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:14:27.181708 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:14:27.181708 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:14:27.182592 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:14:27.182592 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:14:27.182592 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:14:27.182592 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:14:27.182592 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:14:27.182592 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:14:27.182592 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:14:27.182592 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:14:27.182592 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:14:27.182592 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:14:27.182592 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:14:27.182592 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:14:27.182592 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:14:27.182592 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:14:27.182592 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:14:27.182592 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:14:27.183346 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:14:27.183346 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:14:27.183346 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:14:27.183346 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:14:27.183346 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:14:27.183346 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:14:27.183346 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:14:27.183346 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:14:27.183346 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:14:27.183346 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:14:27.183346 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 09:14:27.183346 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:14:27.183346 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 63/124] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:14:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:14:27.183346 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be377018-591d-4a63-9a06-584f769066f4 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:27.185792 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 62/125] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:14:26 2022] GET /identity/v3/projects/7ef24b891e2145d0ac96f35d4f4c385f => generated 298 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:27.186909 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2690c81-d3a2-4d3a-bc5e-367d3e385357 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:27.284298 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:27.302770 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2690c81-d3a2-4d3a-bc5e-367d3e385357 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:27.317100 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be377018-591d-4a63-9a06-584f769066f4 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:27.340569 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051cef93-ded2-4003-8ff1-1126faf99062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:27.341762 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cef93-ded2-4003-8ff1-1126faf99062 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:27.342243 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cef93-ded2-4003-8ff1-1126faf99062 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:27.342692 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cef93-ded2-4003-8ff1-1126faf99062 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:27.354153 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051cef93-ded2-4003-8ff1-1126faf99062 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:14:27.355794 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d68d3d7-7908-4d31-b0c6-f98448116784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:27.356707 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68d3d7-7908-4d31-b0c6-f98448116784 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:27.357004 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68d3d7-7908-4d31-b0c6-f98448116784 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:27.357284 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68d3d7-7908-4d31-b0c6-f98448116784 None admin] PATH_INFO: `/v3/projects/7ef24b891e2145d0ac96f35d4f4c385f` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:27.358495 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d68d3d7-7908-4d31-b0c6-f98448116784 None admin] RBAC: Authorizing `identity:get_project(project_id=7ef24b891e2145d0ac96f35d4f4c385f)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:27.359963 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d68d3d7-7908-4d31-b0c6-f98448116784 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:27.366355 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 64/126] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:14:27 2022] GET /identity/v3/projects/7ef24b891e2145d0ac96f35d4f4c385f => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:27.366355 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d68d3d7-7908-4d31-b0c6-f98448116784 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:27.372372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-051cef93-ded2-4003-8ff1-1126faf99062 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 09:14:27.372372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:14:27.372372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:14:27.372372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:14:27.372372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:14:27.372372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:14:27.372372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:14:27.372372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:14:27.372372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:14:27.372372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:14:27.372372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:14:27.372372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:14:27.372372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:14:27.372372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:14:27.372372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:14:27.372372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:14:27.373636 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:14:27.373636 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:14:27.373636 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:14:27.373636 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:14:27.373636 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:14:27.373636 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:14:27.373636 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:14:27.373636 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:14:27.373636 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:14:27.373636 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:14:27.373636 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:14:27.373636 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:14:27.373636 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:14:27.373636 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:14:27.373636 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:14:27.373636 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:14:27.374387 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:14:27.374387 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:14:27.374387 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:14:27.374387 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:14:27.374387 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:14:27.374387 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:14:27.374387 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:14:27.374387 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:14:27.374387 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:14:27.374387 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:14:27.374387 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 09:14:27.374387 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:14:27.376780 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 63/127] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Jun 27 09:14:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:14:27.377806 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051cef93-ded2-4003-8ff1-1126faf99062 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:27.401725 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:27.477403 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d68d3d7-7908-4d31-b0c6-f98448116784 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:27.486402 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051cef93-ded2-4003-8ff1-1126faf99062 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:27.514456 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96664a0c-3ca8-4bbe-abe7-5d09955178b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:27.515134 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96664a0c-3ca8-4bbe-abe7-5d09955178b7 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:27.515418 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96664a0c-3ca8-4bbe-abe7-5d09955178b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:27.515694 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96664a0c-3ca8-4bbe-abe7-5d09955178b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:27.516732 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96664a0c-3ca8-4bbe-abe7-5d09955178b7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:27.516839 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96664a0c-3ca8-4bbe-abe7-5d09955178b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:27.518294 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96664a0c-3ca8-4bbe-abe7-5d09955178b7 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:27.525055 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c5658-a2ca-4b77-ba4f-02a422a0546d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:27.526258 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c5658-a2ca-4b77-ba4f-02a422a0546d None admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:27.526738 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c5658-a2ca-4b77-ba4f-02a422a0546d None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:27.527208 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c5658-a2ca-4b77-ba4f-02a422a0546d None admin] PATH_INFO: `/v3/projects/7ef24b891e2145d0ac96f35d4f4c385f/users/a46ad49f063c49cdb572468399714ea8/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:27.527793 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 65/128] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Jun 27 09:14:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:27.532693 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96664a0c-3ca8-4bbe-abe7-5d09955178b7 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:27.534582 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6c5658-a2ca-4b77-ba4f-02a422a0546d None admin] RBAC: Authorizing `identity:create_grant(project_id=7ef24b891e2145d0ac96f35d4f4c385f, user_id=a46ad49f063c49cdb572468399714ea8, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:27.536689 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6c5658-a2ca-4b77-ba4f-02a422a0546d None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:27.627003 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 64/129] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Jun 27 09:14:27 2022] PUT /identity/v3/projects/7ef24b891e2145d0ac96f35d4f4c385f/users/a46ad49f063c49cdb572468399714ea8/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:14:27.628830 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c5658-a2ca-4b77-ba4f-02a422a0546d None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:27.634119 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:27.637001 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:27.655469 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96664a0c-3ca8-4bbe-abe7-5d09955178b7 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:27.738292 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84bd56e-0e8b-4941-88a7-c6dd64e96fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:27.738966 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bd56e-0e8b-4941-88a7-c6dd64e96fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:27.739250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bd56e-0e8b-4941-88a7-c6dd64e96fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:27.739526 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bd56e-0e8b-4941-88a7-c6dd64e96fd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:27.740727 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84bd56e-0e8b-4941-88a7-c6dd64e96fd1 None admin] RBAC: Adding query filter params (role.id=90a856ad3f4b4f5db89fbf1ee0841819, scope.project.id=7ef24b891e2145d0ac96f35d4f4c385f, user.id=6d9b34bebb7c4179ac2a5751cd671bb8) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:27.741046 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84bd56e-0e8b-4941-88a7-c6dd64e96fd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:27.743131 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84bd56e-0e8b-4941-88a7-c6dd64e96fd1 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:27.755227 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 66/130] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Jun 27 09:14:27 2022] GET /identity/v3/role_assignments?user.id=6d9b34bebb7c4179ac2a5751cd671bb8&scope.project.id=7ef24b891e2145d0ac96f35d4f4c385f&role.id=90a856ad3f4b4f5db89fbf1ee0841819 => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:27.756837 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84bd56e-0e8b-4941-88a7-c6dd64e96fd1 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:27.849437 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c5658-a2ca-4b77-ba4f-02a422a0546d None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:27.904173 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84bd56e-0e8b-4941-88a7-c6dd64e96fd1 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:27.907398 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18f23e6-4249-4e46-a71e-7693577f2614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:27.908106 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f23e6-4249-4e46-a71e-7693577f2614 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:27.908466 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f23e6-4249-4e46-a71e-7693577f2614 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:27.908753 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f23e6-4249-4e46-a71e-7693577f2614 None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:27.909527 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18f23e6-4249-4e46-a71e-7693577f2614 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:27.909836 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18f23e6-4249-4e46-a71e-7693577f2614 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:27.911233 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18f23e6-4249-4e46-a71e-7693577f2614 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:27.938653 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 65/131] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:14:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:27.940047 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17d7dc-cedc-4b19-9056-f840f189bdda None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:27.940372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17d7dc-cedc-4b19-9056-f840f189bdda None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:27.940659 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17d7dc-cedc-4b19-9056-f840f189bdda None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:27.941916 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 66/132] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:14:27.942421 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd20f27-baf8-4c4a-8e32-6ba287925dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:27.943322 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd20f27-baf8-4c4a-8e32-6ba287925dcf None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:27.943618 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd20f27-baf8-4c4a-8e32-6ba287925dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:27.943905 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd20f27-baf8-4c4a-8e32-6ba287925dcf None admin] PATH_INFO: `/v3/users/bc89b2dd30b74b7998bc9496e8f9bdfb` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:27.945264 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd20f27-baf8-4c4a-8e32-6ba287925dcf None admin] RBAC: Authorizing `identity:get_user(user_id=bc89b2dd30b74b7998bc9496e8f9bdfb)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:27.946757 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd20f27-baf8-4c4a-8e32-6ba287925dcf None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:27.948559 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 67/133] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Jun 27 09:14:27 2022] GET /identity/v3/users/bc89b2dd30b74b7998bc9496e8f9bdfb => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:27.948881 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17d7dc-cedc-4b19-9056-f840f189bdda None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:27.949891 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66319e-4bd8-4b09-bcfd-324f695b3e2d None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:27.950189 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66319e-4bd8-4b09-bcfd-324f695b3e2d None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:27.950473 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66319e-4bd8-4b09-bcfd-324f695b3e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:27.968890 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-1d66319e-4bd8-4b09-bcfd-324f695b3e2d None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:27.970407 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-1d66319e-4bd8-4b09-bcfd-324f695b3e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:27.990226 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:28.049045 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 68/134] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:14:28.049994 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66319e-4bd8-4b09-bcfd-324f695b3e2d None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:28.057850 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:28.172670 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66319e-4bd8-4b09-bcfd-324f695b3e2d None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:28.200928 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17d7dc-cedc-4b19-9056-f840f189bdda None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:28.213900 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e7714-2c08-4eb9-b8b3-763e9a9a4f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:28.215160 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e7714-2c08-4eb9-b8b3-763e9a9a4f89 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:28.216533 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e7714-2c08-4eb9-b8b3-763e9a9a4f89 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:28.219103 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e7714-2c08-4eb9-b8b3-763e9a9a4f89 None admin] PATH_INFO: `/v3/projects/9b5414711ae248208d2e9269d3b0210e` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:28.220664 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e7714-2c08-4eb9-b8b3-763e9a9a4f89 None admin] RBAC: Authorizing `identity:get_project(project_id=9b5414711ae248208d2e9269d3b0210e)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:28.225032 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e7714-2c08-4eb9-b8b3-763e9a9a4f89 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:28.230999 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 69/135] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:14:28 2022] GET /identity/v3/projects/9b5414711ae248208d2e9269d3b0210e => generated 312 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:28.236221 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e7714-2c08-4eb9-b8b3-763e9a9a4f89 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:28.288641 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:28.319230 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a6480-f121-41c7-9514-1691958c564d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:28.320850 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a6480-f121-41c7-9514-1691958c564d None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:28.321232 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a6480-f121-41c7-9514-1691958c564d None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:28.321612 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a6480-f121-41c7-9514-1691958c564d None admin] PATH_INFO: `/v3/users/bc89b2dd30b74b7998bc9496e8f9bdfb` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:28.322939 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086a6480-f121-41c7-9514-1691958c564d None admin] RBAC: Authorizing `identity:get_user(user_id=bc89b2dd30b74b7998bc9496e8f9bdfb)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:28.324531 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086a6480-f121-41c7-9514-1691958c564d None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:28.332665 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 67/136] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Jun 27 09:14:27 2022] GET /identity/v3/users/bc89b2dd30b74b7998bc9496e8f9bdfb => generated 275 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:28.333950 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a6480-f121-41c7-9514-1691958c564d None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:28.365980 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e7714-2c08-4eb9-b8b3-763e9a9a4f89 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:28.417924 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8241f-1836-4b45-ad20-303bfe267486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:28.419211 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8241f-1836-4b45-ad20-303bfe267486 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:28.419830 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8241f-1836-4b45-ad20-303bfe267486 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:28.420313 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8241f-1836-4b45-ad20-303bfe267486 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:28.432267 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc8241f-1836-4b45-ad20-303bfe267486 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:14:28.440754 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-edc8241f-1836-4b45-ad20-303bfe267486 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 09:14:28.440754 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:14:28.440754 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:14:28.440754 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:14:28.440754 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:14:28.440754 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:14:28.440754 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:14:28.440754 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:14:28.440754 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:14:28.440754 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:14:28.440754 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:14:28.440754 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:14:28.440754 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:14:28.440754 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:14:28.440754 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:14:28.440754 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:14:28.441624 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:14:28.441624 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:14:28.441624 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:14:28.441624 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:14:28.441624 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:14:28.441624 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:14:28.441624 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:14:28.441624 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:14:28.441624 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:14:28.441624 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:14:28.441624 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:14:28.441624 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:14:28.441624 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:14:28.441624 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:14:28.441624 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:14:28.441624 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:14:28.442361 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:14:28.442361 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:14:28.442361 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:14:28.442361 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:14:28.442361 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:14:28.442361 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:14:28.442361 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:14:28.442361 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:14:28.442361 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:14:28.442361 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:14:28.442361 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 09:14:28.442361 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:14:28.446171 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 70/137] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:14:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:14:28.447368 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8241f-1836-4b45-ad20-303bfe267486 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:28.541222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:28.562158 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8241f-1836-4b45-ad20-303bfe267486 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:28.607651 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0378e8-93ec-4917-a090-b26eea7ba3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:28.608712 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0378e8-93ec-4917-a090-b26eea7ba3af None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:28.609202 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0378e8-93ec-4917-a090-b26eea7ba3af None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:28.609601 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0378e8-93ec-4917-a090-b26eea7ba3af None admin] PATH_INFO: `/v3/projects/7ef24b891e2145d0ac96f35d4f4c385f` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:28.614044 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0378e8-93ec-4917-a090-b26eea7ba3af None admin] RBAC: Authorizing `identity:get_project(project_id=7ef24b891e2145d0ac96f35d4f4c385f)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:28.615532 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0378e8-93ec-4917-a090-b26eea7ba3af None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:28.617984 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 71/138] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:14:28 2022] GET /identity/v3/projects/7ef24b891e2145d0ac96f35d4f4c385f => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:28.618705 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0378e8-93ec-4917-a090-b26eea7ba3af None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:28.674372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a6480-f121-41c7-9514-1691958c564d None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:28.720670 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b53ad-88a7-494d-b526-6f3382ff7db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:28.721555 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b53ad-88a7-494d-b526-6f3382ff7db0 None admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:28.721837 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b53ad-88a7-494d-b526-6f3382ff7db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:28.722109 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b53ad-88a7-494d-b526-6f3382ff7db0 None admin] PATH_INFO: `/v3/projects/9b5414711ae248208d2e9269d3b0210e/users/bc89b2dd30b74b7998bc9496e8f9bdfb/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:28.724075 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b53ad-88a7-494d-b526-6f3382ff7db0 None admin] RBAC: Authorizing `identity:create_grant(project_id=9b5414711ae248208d2e9269d3b0210e, user_id=bc89b2dd30b74b7998bc9496e8f9bdfb, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:28.725564 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b53ad-88a7-494d-b526-6f3382ff7db0 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:28.728594 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:28.748225 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0378e8-93ec-4917-a090-b26eea7ba3af None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:28.783375 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47faf2-b41a-4f3d-b599-23154f6cb786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:28.784043 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47faf2-b41a-4f3d-b599-23154f6cb786 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:28.784357 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47faf2-b41a-4f3d-b599-23154f6cb786 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:28.784706 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47faf2-b41a-4f3d-b599-23154f6cb786 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:28.785520 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be47faf2-b41a-4f3d-b599-23154f6cb786 None admin] RBAC: Adding query filter params (name=member) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:28.785831 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be47faf2-b41a-4f3d-b599-23154f6cb786 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:28.787325 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be47faf2-b41a-4f3d-b599-23154f6cb786 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:28.796414 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 72/139] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Jun 27 09:14:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:28.800979 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47faf2-b41a-4f3d-b599-23154f6cb786 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:28.813394 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 68/140] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Jun 27 09:14:28 2022] PUT /identity/v3/projects/9b5414711ae248208d2e9269d3b0210e/users/bc89b2dd30b74b7998bc9496e8f9bdfb/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:14:28.817526 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312b44b-9da2-45b1-aea8-81c7df55fe3c None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:28.817526 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312b44b-9da2-45b1-aea8-81c7df55fe3c None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:28.817526 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312b44b-9da2-45b1-aea8-81c7df55fe3c None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:28.817526 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 69/141] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:14:28.818737 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312b44b-9da2-45b1-aea8-81c7df55fe3c None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:28.823103 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:28.955338 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312b44b-9da2-45b1-aea8-81c7df55fe3c None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:28.955513 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47faf2-b41a-4f3d-b599-23154f6cb786 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:28.997946 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449045f-23dc-4414-818f-c0cd3bd74141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:28.998147 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae477c1-d0f0-4e6c-8c80-629542200b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:28.999021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae477c1-d0f0-4e6c-8c80-629542200b04 None admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:28.999307 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae477c1-d0f0-4e6c-8c80-629542200b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:28.999580 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae477c1-d0f0-4e6c-8c80-629542200b04 None admin] PATH_INFO: `/v3/projects/7ef24b891e2145d0ac96f35d4f4c385f/users/bc89b2dd30b74b7998bc9496e8f9bdfb/roles/b137366eb53b42aab629a88be737eaf9` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:28.999929 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449045f-23dc-4414-818f-c0cd3bd74141 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:29.000525 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449045f-23dc-4414-818f-c0cd3bd74141 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:29.001091 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449045f-23dc-4414-818f-c0cd3bd74141 None admin] PATH_INFO: `/v3/users/bc89b2dd30b74b7998bc9496e8f9bdfb` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:29.002099 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae477c1-d0f0-4e6c-8c80-629542200b04 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ef24b891e2145d0ac96f35d4f4c385f, user_id=bc89b2dd30b74b7998bc9496e8f9bdfb, role_id=b137366eb53b42aab629a88be737eaf9)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:29.002824 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5449045f-23dc-4414-818f-c0cd3bd74141 None admin] RBAC: Authorizing `identity:get_user(user_id=bc89b2dd30b74b7998bc9496e8f9bdfb)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:29.003842 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae477c1-d0f0-4e6c-8c80-629542200b04 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:29.004758 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5449045f-23dc-4414-818f-c0cd3bd74141 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:29.006788 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 70/142] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Jun 27 09:14:28 2022] GET /identity/v3/users/bc89b2dd30b74b7998bc9496e8f9bdfb => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:29.013633 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784be6da-718b-42b0-834a-7bcf87242b73 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:29.014345 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784be6da-718b-42b0-834a-7bcf87242b73 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:29.014636 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784be6da-718b-42b0-834a-7bcf87242b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:29.034333 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-784be6da-718b-42b0-834a-7bcf87242b73 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:29.035565 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-784be6da-718b-42b0-834a-7bcf87242b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:29.109392 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:29.121464 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 71/143] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:14:29.122428 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 73/144] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Jun 27 09:14:28 2022] PUT /identity/v3/projects/7ef24b891e2145d0ac96f35d4f4c385f/users/bc89b2dd30b74b7998bc9496e8f9bdfb/roles/b137366eb53b42aab629a88be737eaf9 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:14:29.128603 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784be6da-718b-42b0-834a-7bcf87242b73 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:29.151267 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae477c1-d0f0-4e6c-8c80-629542200b04 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:29.313380 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:29.339380 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae477c1-d0f0-4e6c-8c80-629542200b04 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:29.345946 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784be6da-718b-42b0-834a-7bcf87242b73 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:29.384740 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a39e3-4ee7-40a9-ac9c-f092ada15d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:29.385403 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a39e3-4ee7-40a9-ac9c-f092ada15d5b None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:29.385692 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a39e3-4ee7-40a9-ac9c-f092ada15d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:29.385973 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a39e3-4ee7-40a9-ac9c-f092ada15d5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:29.406233 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d95119e-6be2-4e8d-95d2-3745f4d29f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:29.407193 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95119e-6be2-4e8d-95d2-3745f4d29f1b None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:29.407572 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95119e-6be2-4e8d-95d2-3745f4d29f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:29.407961 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95119e-6be2-4e8d-95d2-3745f4d29f1b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:29.410490 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d95119e-6be2-4e8d-95d2-3745f4d29f1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:29.412229 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d95119e-6be2-4e8d-95d2-3745f4d29f1b None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:29.414828 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 74/145] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:14:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:29.433631 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d95119e-6be2-4e8d-95d2-3745f4d29f1b None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:29.465892 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a39e3-4ee7-40a9-ac9c-f092ada15d5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:29.467489 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a39e3-4ee7-40a9-ac9c-f092ada15d5b None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:29.479888 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:29.582785 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d95119e-6be2-4e8d-95d2-3745f4d29f1b None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:29.584831 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 72/146] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:14:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 09:14:29.601902 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a39e3-4ee7-40a9-ac9c-f092ada15d5b None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:29.685537 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5fbbd-568a-4649-b271-73f7fc27e309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:29.686237 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5fbbd-568a-4649-b271-73f7fc27e309 None admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:29.686504 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5fbbd-568a-4649-b271-73f7fc27e309 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:29.686779 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5fbbd-568a-4649-b271-73f7fc27e309 None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:29.687520 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e5fbbd-568a-4649-b271-73f7fc27e309 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:29.688995 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e5fbbd-568a-4649-b271-73f7fc27e309 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:29.707728 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:29.795426 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a39e3-4ee7-40a9-ac9c-f092ada15d5b None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:29.826866 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:29.839643 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 75/147] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Jun 27 09:14:29 2022] POST /identity/v3/users => generated 283 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 09:14:29.852105 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f3c53c-26bb-4ccb-9ca0-6d9fa92d584d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:29.853020 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f3c53c-26bb-4ccb-9ca0-6d9fa92d584d None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:29.853426 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f3c53c-26bb-4ccb-9ca0-6d9fa92d584d None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:29.853710 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f3c53c-26bb-4ccb-9ca0-6d9fa92d584d None admin] PATH_INFO: `/v3/projects/7ef24b891e2145d0ac96f35d4f4c385f` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:29.857242 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f3c53c-26bb-4ccb-9ca0-6d9fa92d584d None admin] RBAC: Authorizing `identity:get_project(project_id=7ef24b891e2145d0ac96f35d4f4c385f)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:29.858744 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f3c53c-26bb-4ccb-9ca0-6d9fa92d584d None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:29.861853 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 73/148] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:14:29 2022] GET /identity/v3/projects/7ef24b891e2145d0ac96f35d4f4c385f => generated 298 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:29.866862 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5fbbd-568a-4649-b271-73f7fc27e309 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:30.011837 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5fbbd-568a-4649-b271-73f7fc27e309 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:30.054180 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcaddda-f43b-43f0-88cb-68bcc0ea6199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:30.054855 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcaddda-f43b-43f0-88cb-68bcc0ea6199 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:30.055139 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcaddda-f43b-43f0-88cb-68bcc0ea6199 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:30.055417 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcaddda-f43b-43f0-88cb-68bcc0ea6199 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:30.056294 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcaddda-f43b-43f0-88cb-68bcc0ea6199 None admin] RBAC: Adding query filter params (role.id=b1260d153ca7497eaaaa0991f053ff89, scope.project.id=7ef24b891e2145d0ac96f35d4f4c385f, user.id=bc89b2dd30b74b7998bc9496e8f9bdfb) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:30.056613 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcaddda-f43b-43f0-88cb-68bcc0ea6199 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:30.058078 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcaddda-f43b-43f0-88cb-68bcc0ea6199 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:30.067236 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 76/149] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Jun 27 09:14:29 2022] GET /identity/v3/role_assignments?user.id=bc89b2dd30b74b7998bc9496e8f9bdfb&scope.project.id=7ef24b891e2145d0ac96f35d4f4c385f&role.id=b1260d153ca7497eaaaa0991f053ff89 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:30.126673 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2923d-953b-4096-a8bd-616c604d2368 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:30.126999 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2923d-953b-4096-a8bd-616c604d2368 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:30.127253 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2923d-953b-4096-a8bd-616c604d2368 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:30.128774 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 74/150] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:14:30.135277 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b78f1-c8a0-408f-9945-e44136d58639 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:30.135565 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b78f1-c8a0-408f-9945-e44136d58639 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:30.135845 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b78f1-c8a0-408f-9945-e44136d58639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:30.159499 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-582b78f1-c8a0-408f-9945-e44136d58639 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:30.159895 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-582b78f1-c8a0-408f-9945-e44136d58639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:30.252824 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:30.265495 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 77/151] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:14:30.294471 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2923d-953b-4096-a8bd-616c604d2368 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:30.424778 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2923d-953b-4096-a8bd-616c604d2368 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:30.466869 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5112ed6-6057-48a8-bdf8-cde11fd31015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:30.467990 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5112ed6-6057-48a8-bdf8-cde11fd31015 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:30.471068 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5112ed6-6057-48a8-bdf8-cde11fd31015 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:30.471068 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5112ed6-6057-48a8-bdf8-cde11fd31015 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:30.483690 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5112ed6-6057-48a8-bdf8-cde11fd31015 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:14:30.492613 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-d5112ed6-6057-48a8-bdf8-cde11fd31015 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 09:14:30.492613 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:14:30.492613 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:14:30.492613 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:14:30.492613 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:14:30.492613 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:14:30.492613 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:14:30.492613 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:14:30.492613 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:14:30.492613 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:14:30.492613 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:14:30.492613 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:14:30.492613 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:14:30.492613 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:14:30.492613 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:14:30.492613 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:14:30.493458 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:14:30.493458 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:14:30.493458 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:14:30.493458 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:14:30.493458 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:14:30.493458 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:14:30.493458 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:14:30.493458 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:14:30.493458 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:14:30.493458 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:14:30.493458 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:14:30.493458 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:14:30.493458 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:14:30.493458 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:14:30.493458 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:14:30.493458 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:14:30.494243 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:14:30.494243 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:14:30.494243 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:14:30.494243 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:14:30.494243 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:14:30.494243 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:14:30.494243 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:14:30.494243 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:14:30.494243 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:14:30.494243 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:14:30.494243 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 09:14:30.494243 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:14:30.496686 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 75/152] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:14:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:14:30.503118 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b78f1-c8a0-408f-9945-e44136d58639 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:30.612466 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b78f1-c8a0-408f-9945-e44136d58639 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:30.629819 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4c1a4-8be6-4c5f-8679-e74828dfe2eb None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:30.630140 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4c1a4-8be6-4c5f-8679-e74828dfe2eb None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:30.630657 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4c1a4-8be6-4c5f-8679-e74828dfe2eb None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:30.632417 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 76/153] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:14:30.639448 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d955e41-121b-44f5-8d4a-223f29505ab2 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:30.639733 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d955e41-121b-44f5-8d4a-223f29505ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:30.640018 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d955e41-121b-44f5-8d4a-223f29505ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:30.651468 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df48f775-98e5-4b6c-b072-db834b2b052a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:30.652726 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48f775-98e5-4b6c-b072-db834b2b052a None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:30.653210 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48f775-98e5-4b6c-b072-db834b2b052a None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:30.653959 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48f775-98e5-4b6c-b072-db834b2b052a None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:30.654921 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df48f775-98e5-4b6c-b072-db834b2b052a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:30.655418 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df48f775-98e5-4b6c-b072-db834b2b052a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:30.657035 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df48f775-98e5-4b6c-b072-db834b2b052a None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:30.667047 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 78/154] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Jun 27 09:14:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:30.671580 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-0d955e41-121b-44f5-8d4a-223f29505ab2 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:30.671580 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-0d955e41-121b-44f5-8d4a-223f29505ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:30.673040 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df48f775-98e5-4b6c-b072-db834b2b052a None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:30.688928 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:30.748610 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:30.759930 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 77/155] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:14:30.790757 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d955e41-121b-44f5-8d4a-223f29505ab2 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:30.819527 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df48f775-98e5-4b6c-b072-db834b2b052a None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:30.839001 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ecc62-44a6-433b-bea8-2b72f6a47d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:30.840414 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ecc62-44a6-433b-bea8-2b72f6a47d21 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:30.840896 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ecc62-44a6-433b-bea8-2b72f6a47d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:30.841363 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ecc62-44a6-433b-bea8-2b72f6a47d21 None admin] PATH_INFO: `/v3/users/6d9b34bebb7c4179ac2a5751cd671bb8` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:30.842854 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ecc62-44a6-433b-bea8-2b72f6a47d21 None admin] RBAC: Authorizing `identity:get_user(user_id=6d9b34bebb7c4179ac2a5751cd671bb8)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:30.844637 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ecc62-44a6-433b-bea8-2b72f6a47d21 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:30.846721 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 79/156] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Jun 27 09:14:30 2022] GET /identity/v3/users/6d9b34bebb7c4179ac2a5751cd671bb8 => generated 289 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:30.853275 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ecc62-44a6-433b-bea8-2b72f6a47d21 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:30.911021 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d955e41-121b-44f5-8d4a-223f29505ab2 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:30.953437 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f3616-cc10-4dc4-8963-d352961fc51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:30.954327 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f3616-cc10-4dc4-8963-d352961fc51e None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:30.954740 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f3616-cc10-4dc4-8963-d352961fc51e None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:30.955024 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f3616-cc10-4dc4-8963-d352961fc51e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:30.968332 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786f3616-cc10-4dc4-8963-d352961fc51e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:14:30.978875 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-786f3616-cc10-4dc4-8963-d352961fc51e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:14:30.978875 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:14:30.978875 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:14:30.978875 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:14:30.978875 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:14:30.978875 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:14:30.978875 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:14:30.978875 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:14:30.978875 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:14:30.978875 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:14:30.978875 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:14:30.978875 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:14:30.978875 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:14:30.978875 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:14:30.978875 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:14:30.978875 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:14:30.979801 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:14:30.979801 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:14:30.979801 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:14:30.979801 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:14:30.979801 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:14:30.979801 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:14:30.979801 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:14:30.979801 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:14:30.979801 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:14:30.979801 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:14:30.979801 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:14:30.979801 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:14:30.979801 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:14:30.979801 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:14:30.979801 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:14:30.979801 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:14:30.980630 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:14:30.980630 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:14:30.980630 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:14:30.980630 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:14:30.980630 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:14:30.980630 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:14:30.980630 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:14:30.980630 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:14:30.980630 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:14:30.980630 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:14:30.980630 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:14:30.980630 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:14:30.980630 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 78/157] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Jun 27 09:14:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 09:14:30.982986 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ecc62-44a6-433b-bea8-2b72f6a47d21 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:30.986095 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f3616-cc10-4dc4-8963-d352961fc51e None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:31.003871 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:31.011160 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:31.031361 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5c2e9-2f4c-4d55-9433-4240bb05d8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:31.032638 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5c2e9-2f4c-4d55-9433-4240bb05d8d8 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:31.033280 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5c2e9-2f4c-4d55-9433-4240bb05d8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:31.033749 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5c2e9-2f4c-4d55-9433-4240bb05d8d8 None admin] PATH_INFO: `/v3/projects/7ef24b891e2145d0ac96f35d4f4c385f` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:31.035227 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b5c2e9-2f4c-4d55-9433-4240bb05d8d8 None admin] RBAC: Authorizing `identity:get_project(project_id=7ef24b891e2145d0ac96f35d4f4c385f)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:31.036979 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b5c2e9-2f4c-4d55-9433-4240bb05d8d8 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:31.039556 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 80/158] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:14:30 2022] GET /identity/v3/projects/7ef24b891e2145d0ac96f35d4f4c385f => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:14:31.045055 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5c2e9-2f4c-4d55-9433-4240bb05d8d8 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:31.115094 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f3616-cc10-4dc4-8963-d352961fc51e None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:31.165096 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55711346-e41a-4452-92d9-0c5d1485f203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:31.166352 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55711346-e41a-4452-92d9-0c5d1485f203 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:31.168050 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55711346-e41a-4452-92d9-0c5d1485f203 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:31.168562 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55711346-e41a-4452-92d9-0c5d1485f203 None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:31.169871 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55711346-e41a-4452-92d9-0c5d1485f203 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:31.170944 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55711346-e41a-4452-92d9-0c5d1485f203 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:31.175272 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55711346-e41a-4452-92d9-0c5d1485f203 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:31.189313 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 79/159] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:14:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:31.201267 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55711346-e41a-4452-92d9-0c5d1485f203 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:31.203678 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5c2e9-2f4c-4d55-9433-4240bb05d8d8 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:31.271383 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07993a17-92fd-4904-b524-959274c0df1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:31.271615 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07993a17-92fd-4904-b524-959274c0df1d None admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:31.271863 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07993a17-92fd-4904-b524-959274c0df1d None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:31.272081 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07993a17-92fd-4904-b524-959274c0df1d None admin] PATH_INFO: `/v3/projects/7ef24b891e2145d0ac96f35d4f4c385f/users/6d9b34bebb7c4179ac2a5751cd671bb8/roles/90a856ad3f4b4f5db89fbf1ee0841819` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:31.274269 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07993a17-92fd-4904-b524-959274c0df1d None admin] RBAC: Authorizing `identity:create_grant(project_id=7ef24b891e2145d0ac96f35d4f4c385f, user_id=6d9b34bebb7c4179ac2a5751cd671bb8, role_id=90a856ad3f4b4f5db89fbf1ee0841819)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:31.275730 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07993a17-92fd-4904-b524-959274c0df1d None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:31.336686 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:31.342807 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55711346-e41a-4452-92d9-0c5d1485f203 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:31.381562 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12190d7-de2a-4580-bced-af2272cada91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:31.382870 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12190d7-de2a-4580-bced-af2272cada91 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:31.383349 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12190d7-de2a-4580-bced-af2272cada91 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:31.383843 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12190d7-de2a-4580-bced-af2272cada91 None admin] PATH_INFO: `/v3/users/a46ad49f063c49cdb572468399714ea8` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:31.385596 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12190d7-de2a-4580-bced-af2272cada91 None admin] RBAC: Authorizing `identity:get_user(user_id=a46ad49f063c49cdb572468399714ea8)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:31.387264 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12190d7-de2a-4580-bced-af2272cada91 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:31.390615 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 81/161] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Jun 27 09:14:31 2022] PUT /identity/v3/projects/7ef24b891e2145d0ac96f35d4f4c385f/users/6d9b34bebb7c4179ac2a5751cd671bb8/roles/90a856ad3f4b4f5db89fbf1ee0841819 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:14:31.390957 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 80/161] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Jun 27 09:14:31 2022] GET /identity/v3/users/a46ad49f063c49cdb572468399714ea8 => generated 247 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:31.396192 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07993a17-92fd-4904-b524-959274c0df1d None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:31.463592 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:31.529868 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07993a17-92fd-4904-b524-959274c0df1d None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:31.571465 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b4393-03a9-4812-b0a4-ab99fd8aaf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:31.572820 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b4393-03a9-4812-b0a4-ab99fd8aaf3e None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:31.573673 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b4393-03a9-4812-b0a4-ab99fd8aaf3e None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:31.574731 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b4393-03a9-4812-b0a4-ab99fd8aaf3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:31.651886 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b4393-03a9-4812-b0a4-ab99fd8aaf3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:31.653450 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b4393-03a9-4812-b0a4-ab99fd8aaf3e None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:31.708606 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:31.764107 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 82/162] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:14:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 09:14:31.769447 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12190d7-de2a-4580-bced-af2272cada91 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:31.887220 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12190d7-de2a-4580-bced-af2272cada91 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:31.929618 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9fd98-dde7-4ef2-bb4d-7ab2e13fd277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:31.930541 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9fd98-dde7-4ef2-bb4d-7ab2e13fd277 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:31.930827 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9fd98-dde7-4ef2-bb4d-7ab2e13fd277 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:31.931101 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9fd98-dde7-4ef2-bb4d-7ab2e13fd277 None admin] PATH_INFO: `/v3/projects/7ef24b891e2145d0ac96f35d4f4c385f` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:31.932361 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e9fd98-dde7-4ef2-bb4d-7ab2e13fd277 None admin] RBAC: Authorizing `identity:get_project(project_id=7ef24b891e2145d0ac96f35d4f4c385f)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:31.933885 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e9fd98-dde7-4ef2-bb4d-7ab2e13fd277 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:31.935807 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 81/163] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:14:31 2022] GET /identity/v3/projects/7ef24b891e2145d0ac96f35d4f4c385f => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:31.941660 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b4393-03a9-4812-b0a4-ab99fd8aaf3e None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:32.041111 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde66fd7-3d4a-47dc-9736-2a87bd3cc695 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:32.041524 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde66fd7-3d4a-47dc-9736-2a87bd3cc695 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:32.041673 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde66fd7-3d4a-47dc-9736-2a87bd3cc695 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:32.043294 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 82/164] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 09:14:32.048562 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2370c8a-2233-40c9-91e3-3335663e2f9c None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:32.048947 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2370c8a-2233-40c9-91e3-3335663e2f9c None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:32.049200 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2370c8a-2233-40c9-91e3-3335663e2f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:32.079211 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-c2370c8a-2233-40c9-91e3-3335663e2f9c None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:32.080453 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-c2370c8a-2233-40c9-91e3-3335663e2f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:32.089249 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:32.120680 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b4393-03a9-4812-b0a4-ab99fd8aaf3e None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:32.210622 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7069b8c-f18b-415b-94d1-c03d3b0564f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:32.211294 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7069b8c-f18b-415b-94d1-c03d3b0564f3 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:32.211574 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7069b8c-f18b-415b-94d1-c03d3b0564f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:32.211845 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7069b8c-f18b-415b-94d1-c03d3b0564f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:32.212720 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7069b8c-f18b-415b-94d1-c03d3b0564f3 None admin] RBAC: Adding query filter params (role.id=91c77942515d45f1ad8189c9fddf4424, scope.project.id=7ef24b891e2145d0ac96f35d4f4c385f, user.id=a46ad49f063c49cdb572468399714ea8) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:32.213029 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7069b8c-f18b-415b-94d1-c03d3b0564f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:32.214483 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7069b8c-f18b-415b-94d1-c03d3b0564f3 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:32.224898 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 83/165] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Jun 27 09:14:31 2022] GET /identity/v3/role_assignments?user.id=a46ad49f063c49cdb572468399714ea8&scope.project.id=7ef24b891e2145d0ac96f35d4f4c385f&role.id=91c77942515d45f1ad8189c9fddf4424 => generated 608 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:32.235402 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 83/166] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 09:14:32.291730 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7069b8c-f18b-415b-94d1-c03d3b0564f3 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:32.318485 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:32.437242 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7069b8c-f18b-415b-94d1-c03d3b0564f3 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:32.485120 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5df8b7-0b9f-4b65-bf74-cd8ad1c94344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:32.485939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5df8b7-0b9f-4b65-bf74-cd8ad1c94344 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:32.486221 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5df8b7-0b9f-4b65-bf74-cd8ad1c94344 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:32.486497 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5df8b7-0b9f-4b65-bf74-cd8ad1c94344 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:32.502302 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5df8b7-0b9f-4b65-bf74-cd8ad1c94344 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:14:32.510882 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-bf5df8b7-0b9f-4b65-bf74-cd8ad1c94344 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 09:14:32.510882 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:14:32.510882 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:14:32.510882 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:14:32.510882 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:14:32.510882 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:14:32.510882 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:14:32.510882 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:14:32.510882 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:14:32.510882 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:14:32.510882 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:14:32.510882 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:14:32.510882 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:14:32.510882 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:14:32.510882 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:14:32.510882 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:14:32.511865 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:14:32.511865 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:14:32.511865 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:14:32.511865 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:14:32.511865 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:14:32.511865 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:14:32.511865 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:14:32.511865 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:14:32.511865 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:14:32.511865 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:14:32.511865 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:14:32.511865 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:14:32.511865 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:14:32.511865 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:14:32.511865 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:14:32.511865 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:14:32.512807 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:14:32.512807 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:14:32.512807 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:14:32.512807 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:14:32.512807 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:14:32.512807 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:14:32.512807 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:14:32.512807 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:14:32.512807 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:14:32.512807 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:14:32.512807 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 09:14:32.512807 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:14:32.512807 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 84/167] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:14:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:14:32.525410 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2370c8a-2233-40c9-91e3-3335663e2f9c None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:32.679946 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2370c8a-2233-40c9-91e3-3335663e2f9c None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:32.719492 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf2497-0658-4b3d-a0f7-327fa7b4dd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:32.720364 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf2497-0658-4b3d-a0f7-327fa7b4dd32 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:32.720713 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf2497-0658-4b3d-a0f7-327fa7b4dd32 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:32.720990 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf2497-0658-4b3d-a0f7-327fa7b4dd32 None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:32.721777 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf2497-0658-4b3d-a0f7-327fa7b4dd32 None admin] RBAC: Adding query filter params (name=member) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:32.722087 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf2497-0658-4b3d-a0f7-327fa7b4dd32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:32.723544 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf2497-0658-4b3d-a0f7-327fa7b4dd32 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:32.730599 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:32.739490 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 84/168] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Jun 27 09:14:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:32.740525 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5df8b7-0b9f-4b65-bf74-cd8ad1c94344 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:32.790781 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3be141-bac8-44c6-978b-4f5d6f33baba None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:32.791297 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3be141-bac8-44c6-978b-4f5d6f33baba None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:32.791765 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3be141-bac8-44c6-978b-4f5d6f33baba None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:32.794310 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 85/169] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:14:32.799757 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897b5f0-4960-4083-a6b0-cdf1b9e77dc0 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:32.800042 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897b5f0-4960-4083-a6b0-cdf1b9e77dc0 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:32.800370 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897b5f0-4960-4083-a6b0-cdf1b9e77dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:32.829232 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-0897b5f0-4960-4083-a6b0-cdf1b9e77dc0 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:32.830450 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-0897b5f0-4960-4083-a6b0-cdf1b9e77dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:32.851982 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:32.912064 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5df8b7-0b9f-4b65-bf74-cd8ad1c94344 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:32.951490 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 86/170] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 09:14:32.975474 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0897b5f0-4960-4083-a6b0-cdf1b9e77dc0 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:32.995197 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ef04b1-2aa6-44d6-ac08-03ea98cfd9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:32.996087 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef04b1-2aa6-44d6-ac08-03ea98cfd9dd None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:32.996399 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef04b1-2aa6-44d6-ac08-03ea98cfd9dd None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:32.996669 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef04b1-2aa6-44d6-ac08-03ea98cfd9dd None admin] PATH_INFO: `/v3/users/bc89b2dd30b74b7998bc9496e8f9bdfb` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:33.001003 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ef04b1-2aa6-44d6-ac08-03ea98cfd9dd None admin] RBAC: Authorizing `identity:get_user(user_id=bc89b2dd30b74b7998bc9496e8f9bdfb)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:33.002483 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ef04b1-2aa6-44d6-ac08-03ea98cfd9dd None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:33.004406 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 85/171] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Jun 27 09:14:32 2022] GET /identity/v3/users/bc89b2dd30b74b7998bc9496e8f9bdfb => generated 275 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:33.027407 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ef04b1-2aa6-44d6-ac08-03ea98cfd9dd None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:33.098666 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0897b5f0-4960-4083-a6b0-cdf1b9e77dc0 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:33.132557 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:33.136893 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9596f-9370-4f18-b1e7-7b6cca3ef6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:33.137638 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9596f-9370-4f18-b1e7-7b6cca3ef6ed None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:33.137924 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9596f-9370-4f18-b1e7-7b6cca3ef6ed None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:33.138205 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9596f-9370-4f18-b1e7-7b6cca3ef6ed None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:33.150515 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde9596f-9370-4f18-b1e7-7b6cca3ef6ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:14:33.160058 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-fde9596f-9370-4f18-b1e7-7b6cca3ef6ed None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 09:14:33.160058 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:14:33.160058 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:14:33.160058 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:14:33.160058 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:14:33.160058 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:14:33.160058 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:14:33.160058 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:14:33.160058 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:14:33.160058 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:14:33.160058 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:14:33.160058 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:14:33.160058 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:14:33.160058 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:14:33.160058 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:14:33.160058 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:14:33.161085 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:14:33.161085 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:14:33.161085 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:14:33.161085 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:14:33.161085 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:14:33.161085 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:14:33.161085 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:14:33.161085 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:14:33.161085 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:14:33.161085 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:14:33.161085 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:14:33.161085 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:14:33.161085 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:14:33.161085 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:14:33.161085 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:14:33.161085 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:14:33.161858 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:14:33.161858 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:14:33.161858 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:14:33.161858 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:14:33.161858 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:14:33.161858 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:14:33.161858 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:14:33.161858 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:14:33.161858 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:14:33.161858 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:14:33.161858 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 09:14:33.161858 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:14:33.161858 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 87/172] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Jun 27 09:14:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 09:14:33.169769 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9596f-9370-4f18-b1e7-7b6cca3ef6ed None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:33.274856 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9596f-9370-4f18-b1e7-7b6cca3ef6ed None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:33.310308 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d5ab4-3317-4529-815b-799e48042513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:33.310989 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d5ab4-3317-4529-815b-799e48042513 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:33.311273 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d5ab4-3317-4529-815b-799e48042513 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:33.311548 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d5ab4-3317-4529-815b-799e48042513 None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:33.312329 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1d5ab4-3317-4529-815b-799e48042513 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:33.312639 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1d5ab4-3317-4529-815b-799e48042513 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:33.314148 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1d5ab4-3317-4529-815b-799e48042513 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:33.323340 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 88/173] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:14:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:33.328746 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d5ab4-3317-4529-815b-799e48042513 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:33.354253 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ef04b1-2aa6-44d6-ac08-03ea98cfd9dd None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:33.416622 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:33.441926 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d5ab4-3317-4529-815b-799e48042513 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:33.479169 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450352bb-3852-4158-b533-53c3d07a3f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:33.480095 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450352bb-3852-4158-b533-53c3d07a3f5e None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:33.480422 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450352bb-3852-4158-b533-53c3d07a3f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:33.480795 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450352bb-3852-4158-b533-53c3d07a3f5e None admin] PATH_INFO: `/v3/users/bc89b2dd30b74b7998bc9496e8f9bdfb` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:33.482080 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450352bb-3852-4158-b533-53c3d07a3f5e None admin] RBAC: Authorizing `identity:get_user(user_id=bc89b2dd30b74b7998bc9496e8f9bdfb)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:33.483661 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450352bb-3852-4158-b533-53c3d07a3f5e None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:33.488312 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 89/174] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Jun 27 09:14:33 2022] GET /identity/v3/users/bc89b2dd30b74b7998bc9496e8f9bdfb => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:33.488932 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb6fe15-d750-485b-ae13-345255b86f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:33.489609 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6fe15-d750-485b-ae13-345255b86f77 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:33.492118 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6fe15-d750-485b-ae13-345255b86f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:33.492118 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6fe15-d750-485b-ae13-345255b86f77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:33.492328 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450352bb-3852-4158-b533-53c3d07a3f5e None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:33.518388 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:33.599369 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450352bb-3852-4158-b533-53c3d07a3f5e None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:33.624558 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:33.634969 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9259a943-a4f6-4e20-af45-68fe70a70a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:33.637083 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259a943-a4f6-4e20-af45-68fe70a70a81 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:33.637083 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259a943-a4f6-4e20-af45-68fe70a70a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:33.637083 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259a943-a4f6-4e20-af45-68fe70a70a81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:33.657681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb6fe15-d750-485b-ae13-345255b86f77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:33.659487 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb6fe15-d750-485b-ae13-345255b86f77 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:33.708323 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9259a943-a4f6-4e20-af45-68fe70a70a81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:33.709799 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9259a943-a4f6-4e20-af45-68fe70a70a81 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:33.811312 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 90/175] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:14:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 27 09:14:33.816926 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5598ebb-2a7d-43de-b00b-229a5a5f2549 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:33.817214 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5598ebb-2a7d-43de-b00b-229a5a5f2549 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:33.817491 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5598ebb-2a7d-43de-b00b-229a5a5f2549 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:33.818830 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 91/176] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:14:33.820555 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5598ebb-2a7d-43de-b00b-229a5a5f2549 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:33.845473 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:33.864271 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 86/177] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:14:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 828 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 27 09:14:33.864271 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85e8f4-b133-47d2-bf42-b71ce70ab1f0 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:33.864271 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85e8f4-b133-47d2-bf42-b71ce70ab1f0 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:33.864271 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85e8f4-b133-47d2-bf42-b71ce70ab1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:33.893401 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-3b85e8f4-b133-47d2-bf42-b71ce70ab1f0 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:33.894904 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-3b85e8f4-b133-47d2-bf42-b71ce70ab1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:33.934291 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5598ebb-2a7d-43de-b00b-229a5a5f2549 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:33.968245 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca933ff-4cf3-451d-9b59-17f80b7b590b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:33.969235 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca933ff-4cf3-451d-9b59-17f80b7b590b None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:33.969519 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca933ff-4cf3-451d-9b59-17f80b7b590b None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:33.969794 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca933ff-4cf3-451d-9b59-17f80b7b590b None admin] PATH_INFO: `/v3/projects/7ef24b891e2145d0ac96f35d4f4c385f` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:33.970948 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:33.971059 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca933ff-4cf3-451d-9b59-17f80b7b590b None admin] RBAC: Authorizing `identity:get_project(project_id=7ef24b891e2145d0ac96f35d4f4c385f)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:33.972452 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca933ff-4cf3-451d-9b59-17f80b7b590b None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:33.978979 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 92/178] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:14:33 2022] GET /identity/v3/projects/7ef24b891e2145d0ac96f35d4f4c385f => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:33.979830 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca933ff-4cf3-451d-9b59-17f80b7b590b None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:34.074449 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 87/179] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:14:34.075098 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:34.075322 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b85e8f4-b133-47d2-bf42-b71ce70ab1f0 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:34.088518 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca933ff-4cf3-451d-9b59-17f80b7b590b None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:34.162277 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f710af6-88e9-4849-b616-ba8d830913e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:34.163482 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f710af6-88e9-4849-b616-ba8d830913e6 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:34.163947 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f710af6-88e9-4849-b616-ba8d830913e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:34.164418 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f710af6-88e9-4849-b616-ba8d830913e6 None admin] PATH_INFO: `/v3/projects/9b5414711ae248208d2e9269d3b0210e` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:34.167355 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f710af6-88e9-4849-b616-ba8d830913e6 None admin] RBAC: Authorizing `identity:get_project(project_id=9b5414711ae248208d2e9269d3b0210e)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:34.169030 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f710af6-88e9-4849-b616-ba8d830913e6 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:34.172216 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 93/180] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:14:33 2022] GET /identity/v3/projects/9b5414711ae248208d2e9269d3b0210e => generated 312 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:34.173867 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f710af6-88e9-4849-b616-ba8d830913e6 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:34.283361 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b85e8f4-b133-47d2-bf42-b71ce70ab1f0 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:34.352303 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f710af6-88e9-4849-b616-ba8d830913e6 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:34.358263 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5e3da-5e5e-4050-9e6d-4d35fe2be051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:34.358939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5e3da-5e5e-4050-9e6d-4d35fe2be051 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:34.359225 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5e3da-5e5e-4050-9e6d-4d35fe2be051 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:34.359507 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5e3da-5e5e-4050-9e6d-4d35fe2be051 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:34.360385 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5e3da-5e5e-4050-9e6d-4d35fe2be051 None admin] RBAC: Adding query filter params (role.id=b137366eb53b42aab629a88be737eaf9, scope.project.id=7ef24b891e2145d0ac96f35d4f4c385f, user.id=bc89b2dd30b74b7998bc9496e8f9bdfb) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:34.360756 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5e3da-5e5e-4050-9e6d-4d35fe2be051 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:34.362273 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5e3da-5e5e-4050-9e6d-4d35fe2be051 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:34.376032 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 88/181] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Jun 27 09:14:34 2022] GET /identity/v3/role_assignments?user.id=bc89b2dd30b74b7998bc9496e8f9bdfb&scope.project.id=7ef24b891e2145d0ac96f35d4f4c385f&role.id=b137366eb53b42aab629a88be737eaf9 => generated 608 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:34.376754 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5e3da-5e5e-4050-9e6d-4d35fe2be051 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:34.401357 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a91ad-f113-40ec-8477-3658b7a7f8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:34.402255 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a91ad-f113-40ec-8477-3658b7a7f8bc None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:34.402608 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a91ad-f113-40ec-8477-3658b7a7f8bc None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:34.402954 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a91ad-f113-40ec-8477-3658b7a7f8bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:34.423093 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a91ad-f113-40ec-8477-3658b7a7f8bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:14:34.444615 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-6d6a91ad-f113-40ec-8477-3658b7a7f8bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:14:34.444615 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:14:34.444615 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:14:34.444615 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:14:34.444615 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:14:34.444615 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:14:34.444615 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:14:34.444615 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:14:34.444615 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:14:34.444615 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:14:34.444615 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:14:34.444615 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:14:34.444615 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:14:34.444615 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:14:34.444615 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:14:34.444615 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:14:34.445915 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:14:34.445915 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:14:34.445915 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:14:34.445915 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:14:34.445915 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:14:34.445915 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:14:34.445915 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:14:34.445915 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:14:34.445915 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:14:34.445915 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:14:34.445915 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:14:34.445915 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:14:34.445915 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:14:34.445915 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:14:34.445915 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:14:34.445915 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:14:34.446721 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:14:34.446721 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:14:34.446721 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:14:34.446721 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:14:34.446721 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:14:34.446721 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:14:34.446721 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:14:34.446721 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:14:34.446721 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:14:34.446721 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:14:34.446721 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:14:34.446721 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:14:34.446721 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 94/182] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Jun 27 09:14:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:14:34.448508 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:34.451064 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a91ad-f113-40ec-8477-3658b7a7f8bc None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:34.512613 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:34.539116 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5e3da-5e5e-4050-9e6d-4d35fe2be051 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:34.614405 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb94a6-0fd7-481e-9597-5ba77babcd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:34.615086 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb94a6-0fd7-481e-9597-5ba77babcd0d None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:34.615425 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb94a6-0fd7-481e-9597-5ba77babcd0d None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:34.615708 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb94a6-0fd7-481e-9597-5ba77babcd0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:34.620223 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb94a6-0fd7-481e-9597-5ba77babcd0d None admin] RBAC: Adding query filter params (role.id=b1260d153ca7497eaaaa0991f053ff89, scope.project.id=9b5414711ae248208d2e9269d3b0210e, user.id=bc89b2dd30b74b7998bc9496e8f9bdfb) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:34.620223 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb94a6-0fd7-481e-9597-5ba77babcd0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:34.620223 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb94a6-0fd7-481e-9597-5ba77babcd0d None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:34.631830 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 89/183] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Jun 27 09:14:34 2022] GET /identity/v3/role_assignments?user.id=bc89b2dd30b74b7998bc9496e8f9bdfb&scope.project.id=9b5414711ae248208d2e9269d3b0210e&role.id=b1260d153ca7497eaaaa0991f053ff89 => generated 608 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:34.652705 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a91ad-f113-40ec-8477-3658b7a7f8bc None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:34.714527 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15d87d-7c72-4d9d-affb-7a9ef52962b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:34.715561 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15d87d-7c72-4d9d-affb-7a9ef52962b0 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:34.716054 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15d87d-7c72-4d9d-affb-7a9ef52962b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:34.716562 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15d87d-7c72-4d9d-affb-7a9ef52962b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:34.717518 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a15d87d-7c72-4d9d-affb-7a9ef52962b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:34.718015 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a15d87d-7c72-4d9d-affb-7a9ef52962b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:34.719611 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a15d87d-7c72-4d9d-affb-7a9ef52962b0 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:34.729939 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 95/184] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:14:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:34.735329 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2bcbb-8f1e-4a1f-a22f-3c7a5b6503d2 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:34.735623 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2bcbb-8f1e-4a1f-a22f-3c7a5b6503d2 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:34.736051 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2bcbb-8f1e-4a1f-a22f-3c7a5b6503d2 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:34.736477 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15d87d-7c72-4d9d-affb-7a9ef52962b0 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:34.737668 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 90/185] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:14:34.749889 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc76cc-bca8-42e3-9094-2b1092e5c88d None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:34.750216 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc76cc-bca8-42e3-9094-2b1092e5c88d None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:34.750450 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc76cc-bca8-42e3-9094-2b1092e5c88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:34.789804 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-43cc76cc-bca8-42e3-9094-2b1092e5c88d None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:34.791066 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-43cc76cc-bca8-42e3-9094-2b1092e5c88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:34.841558 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:34.866636 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15d87d-7c72-4d9d-affb-7a9ef52962b0 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:34.892073 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 91/186] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 09:14:34.894165 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab84b07-ec4c-4de9-b4d7-ecc833826d27 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:34.894671 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab84b07-ec4c-4de9-b4d7-ecc833826d27 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:34.895161 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab84b07-ec4c-4de9-b4d7-ecc833826d27 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:34.896725 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 92/187] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:14:34.898713 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74b732-6787-49e2-a95e-ac81cafea537 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:34.899218 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74b732-6787-49e2-a95e-ac81cafea537 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:34.899692 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74b732-6787-49e2-a95e-ac81cafea537 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:34.902110 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 93/188] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:14:34.906723 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33acf85d-4fff-4b70-ac4e-4dbc3a3aea2b None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:34.907424 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33acf85d-4fff-4b70-ac4e-4dbc3a3aea2b None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:34.907829 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33acf85d-4fff-4b70-ac4e-4dbc3a3aea2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:34.914307 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a26815-7a81-478b-9353-e48003fd93b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:34.915246 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a26815-7a81-478b-9353-e48003fd93b2 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:34.915531 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a26815-7a81-478b-9353-e48003fd93b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:34.915803 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a26815-7a81-478b-9353-e48003fd93b2 None admin] PATH_INFO: `/v3/users/a59286eafc1d45ebb3e4c3279eb1ba69` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:34.926806 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-33acf85d-4fff-4b70-ac4e-4dbc3a3aea2b None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:34.928327 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-33acf85d-4fff-4b70-ac4e-4dbc3a3aea2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:34.932729 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a26815-7a81-478b-9353-e48003fd93b2 None admin] RBAC: Authorizing `identity:get_user(user_id=a59286eafc1d45ebb3e4c3279eb1ba69)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:34.936233 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a26815-7a81-478b-9353-e48003fd93b2 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:34.936350 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 96/189] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Jun 27 09:14:34 2022] GET /identity/v3/users/a59286eafc1d45ebb3e4c3279eb1ba69 => generated 283 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:14:34.937593 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17192884-bba3-4de3-ba02-92c6b97b2702 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:34.937975 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17192884-bba3-4de3-ba02-92c6b97b2702 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:34.938074 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17192884-bba3-4de3-ba02-92c6b97b2702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:34.955919 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-17192884-bba3-4de3-ba02-92c6b97b2702 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:34.957167 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-17192884-bba3-4de3-ba02-92c6b97b2702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:34.965927 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:35.014179 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 94/190] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 09:14:35.015029 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33acf85d-4fff-4b70-ac4e-4dbc3a3aea2b None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:35.035489 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 97/191] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:14:35.036917 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17192884-bba3-4de3-ba02-92c6b97b2702 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:35.101803 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:35.127581 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33acf85d-4fff-4b70-ac4e-4dbc3a3aea2b None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:35.136549 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17192884-bba3-4de3-ba02-92c6b97b2702 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:35.162488 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb758bfd-0a39-4d62-9291-7cf5c44b2ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:35.163309 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb758bfd-0a39-4d62-9291-7cf5c44b2ec3 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:35.163588 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb758bfd-0a39-4d62-9291-7cf5c44b2ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:35.163865 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb758bfd-0a39-4d62-9291-7cf5c44b2ec3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:35.170477 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca2a9a-daa6-494b-924e-c8e5b83f6a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:35.171120 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca2a9a-daa6-494b-924e-c8e5b83f6a9e None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:35.171401 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca2a9a-daa6-494b-924e-c8e5b83f6a9e None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:35.171676 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca2a9a-daa6-494b-924e-c8e5b83f6a9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:35.174382 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb758bfd-0a39-4d62-9291-7cf5c44b2ec3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:14:35.182185 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-eb758bfd-0a39-4d62-9291-7cf5c44b2ec3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 09:14:35.182185 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:14:35.182185 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:14:35.182185 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:14:35.182185 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:14:35.182185 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:14:35.182185 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:14:35.182185 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:14:35.182185 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:14:35.182185 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:14:35.182185 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:14:35.182185 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:14:35.182185 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:14:35.182185 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:14:35.182185 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:14:35.182185 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:14:35.183163 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:14:35.183163 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:14:35.183163 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:14:35.183163 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:14:35.183163 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:14:35.183163 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:14:35.183163 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:14:35.183163 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:14:35.183163 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:14:35.183163 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:14:35.183163 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:14:35.183163 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:14:35.183163 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:14:35.183163 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:14:35.183163 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:14:35.183163 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:14:35.184173 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:14:35.184173 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:14:35.184173 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:14:35.184173 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:14:35.184173 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:14:35.184173 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:14:35.184173 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:14:35.184173 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:14:35.184173 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:14:35.184173 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:14:35.184173 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 09:14:35.184173 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:14:35.184173 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 95/192] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:14:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:14:35.186764 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb758bfd-0a39-4d62-9291-7cf5c44b2ec3 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:35.209740 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:35.246232 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eca2a9a-daa6-494b-924e-c8e5b83f6a9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:35.247648 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eca2a9a-daa6-494b-924e-c8e5b83f6a9e None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:35.291678 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb758bfd-0a39-4d62-9291-7cf5c44b2ec3 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:35.310823 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:35.326872 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dddc9d6-ae64-46c8-9b33-f7a26f05d101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:35.327654 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddc9d6-ae64-46c8-9b33-f7a26f05d101 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:35.327938 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddc9d6-ae64-46c8-9b33-f7a26f05d101 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:35.328225 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddc9d6-ae64-46c8-9b33-f7a26f05d101 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:35.329391 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dddc9d6-ae64-46c8-9b33-f7a26f05d101 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:35.330877 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dddc9d6-ae64-46c8-9b33-f7a26f05d101 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:35.332550 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 96/193] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:14:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:35.336937 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dddc9d6-ae64-46c8-9b33-f7a26f05d101 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:35.350749 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 98/194] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:14:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 09:14:35.350749 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca2a9a-daa6-494b-924e-c8e5b83f6a9e None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:35.431072 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:35.445242 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca2a9a-daa6-494b-924e-c8e5b83f6a9e None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:35.445544 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dddc9d6-ae64-46c8-9b33-f7a26f05d101 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:35.478800 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353bc68a-4adf-43bf-86f5-56c3677d92a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:35.479462 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353bc68a-4adf-43bf-86f5-56c3677d92a1 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:35.479747 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353bc68a-4adf-43bf-86f5-56c3677d92a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:35.480145 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353bc68a-4adf-43bf-86f5-56c3677d92a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:35.480323 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff4bcd6-d2ce-4eb0-9bce-d4219f85b0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:35.480997 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353bc68a-4adf-43bf-86f5-56c3677d92a1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:35.481128 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4bcd6-d2ce-4eb0-9bce-d4219f85b0bd None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:35.481307 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353bc68a-4adf-43bf-86f5-56c3677d92a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:35.481406 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4bcd6-d2ce-4eb0-9bce-d4219f85b0bd None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:35.481671 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4bcd6-d2ce-4eb0-9bce-d4219f85b0bd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:35.482679 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353bc68a-4adf-43bf-86f5-56c3677d92a1 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:35.491672 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 99/195] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Jun 27 09:14:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:35.492487 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353bc68a-4adf-43bf-86f5-56c3677d92a1 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:35.492642 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff4bcd6-d2ce-4eb0-9bce-d4219f85b0bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:14:35.500774 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-2ff4bcd6-d2ce-4eb0-9bce-d4219f85b0bd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 09:14:35.500774 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:14:35.500774 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:14:35.500774 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:14:35.500774 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:14:35.500774 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:14:35.500774 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:14:35.500774 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:14:35.500774 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:14:35.500774 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:14:35.500774 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:14:35.500774 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:14:35.500774 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:14:35.500774 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:14:35.500774 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:14:35.500774 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:14:35.501833 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:14:35.501833 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:14:35.501833 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:14:35.501833 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:14:35.501833 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:14:35.501833 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:14:35.501833 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:14:35.501833 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:14:35.501833 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:14:35.501833 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:14:35.501833 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:14:35.501833 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:14:35.501833 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:14:35.501833 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:14:35.501833 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:14:35.501833 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:14:35.502716 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:14:35.502716 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:14:35.502716 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:14:35.502716 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:14:35.502716 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:14:35.502716 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:14:35.502716 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:14:35.502716 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:14:35.502716 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:14:35.502716 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:14:35.502716 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 09:14:35.502716 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:14:35.502716 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 97/196] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Jun 27 09:14:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:14:35.503560 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff4bcd6-d2ce-4eb0-9bce-d4219f85b0bd None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:35.551903 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:35.626459 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff4bcd6-d2ce-4eb0-9bce-d4219f85b0bd None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:35.627253 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353bc68a-4adf-43bf-86f5-56c3677d92a1 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:35.662068 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2866150-5c83-49d1-8868-2842570e4d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:35.662925 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2866150-5c83-49d1-8868-2842570e4d66 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:35.663211 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2866150-5c83-49d1-8868-2842570e4d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:35.663480 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2866150-5c83-49d1-8868-2842570e4d66 None admin] PATH_INFO: `/v3/projects/7f845d06024f4ea9b859e6d0dcef1534` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:35.664322 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c32a1-3941-453f-a9d0-9e2e64f8991d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:35.664696 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2866150-5c83-49d1-8868-2842570e4d66 None admin] RBAC: Authorizing `identity:get_project(project_id=7f845d06024f4ea9b859e6d0dcef1534)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:35.664985 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c32a1-3941-453f-a9d0-9e2e64f8991d None admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:35.665264 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c32a1-3941-453f-a9d0-9e2e64f8991d None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:35.665533 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c32a1-3941-453f-a9d0-9e2e64f8991d None admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:35.666137 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2866150-5c83-49d1-8868-2842570e4d66 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:35.666226 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420c32a1-3941-453f-a9d0-9e2e64f8991d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:35.667655 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420c32a1-3941-453f-a9d0-9e2e64f8991d None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:35.668002 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 98/197] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:14:35 2022] GET /identity/v3/projects/7f845d06024f4ea9b859e6d0dcef1534 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:35.668639 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2866150-5c83-49d1-8868-2842570e4d66 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:35.686507 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:35.767817 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2866150-5c83-49d1-8868-2842570e4d66 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:35.783393 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 100/198] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Jun 27 09:14:35 2022] POST /identity/v3/users => generated 297 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:14:35.784334 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c32a1-3941-453f-a9d0-9e2e64f8991d None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:35.810960 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011efa4-42db-4ba9-b595-5fd71b790545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:35.811885 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011efa4-42db-4ba9-b595-5fd71b790545 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:35.812174 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011efa4-42db-4ba9-b595-5fd71b790545 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:35.812478 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011efa4-42db-4ba9-b595-5fd71b790545 None admin] PATH_INFO: `/v3/users/6d9b34bebb7c4179ac2a5751cd671bb8` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:35.813799 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011efa4-42db-4ba9-b595-5fd71b790545 None admin] RBAC: Authorizing `identity:get_user(user_id=6d9b34bebb7c4179ac2a5751cd671bb8)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:35.815286 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011efa4-42db-4ba9-b595-5fd71b790545 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:35.817244 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 99/199] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Jun 27 09:14:35 2022] GET /identity/v3/users/6d9b34bebb7c4179ac2a5751cd671bb8 => generated 289 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:35.817858 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011efa4-42db-4ba9-b595-5fd71b790545 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:35.893951 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:35.910956 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c32a1-3941-453f-a9d0-9e2e64f8991d None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:35.918618 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:35.946364 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011efa4-42db-4ba9-b595-5fd71b790545 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:35.956217 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169c1de-50c7-4697-aed7-1dc403454a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:35.956217 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169c1de-50c7-4697-aed7-1dc403454a31 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:35.956526 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169c1de-50c7-4697-aed7-1dc403454a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:35.956846 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169c1de-50c7-4697-aed7-1dc403454a31 None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:35.958399 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4169c1de-50c7-4697-aed7-1dc403454a31 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:35.958399 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4169c1de-50c7-4697-aed7-1dc403454a31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:35.959161 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4169c1de-50c7-4697-aed7-1dc403454a31 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:35.967669 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 101/200] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:14:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:35.972406 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169c1de-50c7-4697-aed7-1dc403454a31 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:35.996447 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1422c83-d36a-418f-98ef-f7d57014edb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:35.997123 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1422c83-d36a-418f-98ef-f7d57014edb9 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:35.997717 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1422c83-d36a-418f-98ef-f7d57014edb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:35.997717 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1422c83-d36a-418f-98ef-f7d57014edb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:35.998511 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1422c83-d36a-418f-98ef-f7d57014edb9 None admin] RBAC: Adding query filter params (role.id=91c77942515d45f1ad8189c9fddf4424, scope.project.id=7f845d06024f4ea9b859e6d0dcef1534, user.id=a59286eafc1d45ebb3e4c3279eb1ba69) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:35.998831 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1422c83-d36a-418f-98ef-f7d57014edb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:36.000381 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1422c83-d36a-418f-98ef-f7d57014edb9 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:36.007662 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 100/201] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Jun 27 09:14:35 2022] GET /identity/v3/role_assignments?user.id=a59286eafc1d45ebb3e4c3279eb1ba69&scope.project.id=7f845d06024f4ea9b859e6d0dcef1534&role.id=91c77942515d45f1ad8189c9fddf4424 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:36.009575 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1422c83-d36a-418f-98ef-f7d57014edb9 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:36.102428 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169c1de-50c7-4697-aed7-1dc403454a31 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:36.151765 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5751789-ed29-4e07-a9fc-8fb61c30bd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:36.152502 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5751789-ed29-4e07-a9fc-8fb61c30bd8b None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:36.152788 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5751789-ed29-4e07-a9fc-8fb61c30bd8b None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:36.153069 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5751789-ed29-4e07-a9fc-8fb61c30bd8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:36.160615 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1422c83-d36a-418f-98ef-f7d57014edb9 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:36.202446 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:36.211589 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80fcb3-cd6a-4c3d-82f1-0f0a299c61b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:36.212519 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80fcb3-cd6a-4c3d-82f1-0f0a299c61b6 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:36.213115 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80fcb3-cd6a-4c3d-82f1-0f0a299c61b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:36.213958 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80fcb3-cd6a-4c3d-82f1-0f0a299c61b6 None admin] PATH_INFO: `/v3/users/a59286eafc1d45ebb3e4c3279eb1ba69` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:36.214805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f80fcb3-cd6a-4c3d-82f1-0f0a299c61b6 None admin] RBAC: Authorizing `identity:get_user(user_id=a59286eafc1d45ebb3e4c3279eb1ba69)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:36.216464 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f80fcb3-cd6a-4c3d-82f1-0f0a299c61b6 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:36.218185 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 101/202] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Jun 27 09:14:36 2022] GET /identity/v3/users/a59286eafc1d45ebb3e4c3279eb1ba69 => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:36.223838 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80fcb3-cd6a-4c3d-82f1-0f0a299c61b6 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:36.244634 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:36.251789 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5751789-ed29-4e07-a9fc-8fb61c30bd8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:36.253327 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5751789-ed29-4e07-a9fc-8fb61c30bd8b None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:36.363376 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80fcb3-cd6a-4c3d-82f1-0f0a299c61b6 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:36.390620 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 102/203] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:14:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 09:14:36.399667 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5751789-ed29-4e07-a9fc-8fb61c30bd8b None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:36.403148 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c03712-cabc-4828-b402-044eb49ed5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:36.404807 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c03712-cabc-4828-b402-044eb49ed5fe None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:36.404807 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c03712-cabc-4828-b402-044eb49ed5fe None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:36.404807 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c03712-cabc-4828-b402-044eb49ed5fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:36.483668 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c03712-cabc-4828-b402-044eb49ed5fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:36.485404 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:36.485703 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c03712-cabc-4828-b402-044eb49ed5fe None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:36.504052 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:36.581823 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5751789-ed29-4e07-a9fc-8fb61c30bd8b None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:36.597158 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 102/204] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:14:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 09:14:36.603345 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c03712-cabc-4828-b402-044eb49ed5fe None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:36.655376 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3e160-511b-4ec1-bc6f-3a2c177a407b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:36.656302 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3e160-511b-4ec1-bc6f-3a2c177a407b None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:36.656587 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3e160-511b-4ec1-bc6f-3a2c177a407b None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:36.656860 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3e160-511b-4ec1-bc6f-3a2c177a407b None admin] PATH_INFO: `/v3/projects/7ef24b891e2145d0ac96f35d4f4c385f` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:36.658102 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b3e160-511b-4ec1-bc6f-3a2c177a407b None admin] RBAC: Authorizing `identity:get_project(project_id=7ef24b891e2145d0ac96f35d4f4c385f)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:36.659814 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b3e160-511b-4ec1-bc6f-3a2c177a407b None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:36.661559 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 103/205] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:14:36 2022] GET /identity/v3/projects/7ef24b891e2145d0ac96f35d4f4c385f => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:36.667160 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3e160-511b-4ec1-bc6f-3a2c177a407b None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:36.709105 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c03712-cabc-4828-b402-044eb49ed5fe None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:36.724957 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:36.745579 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d01675-d783-4c9d-ab52-4cdc5e2baa7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:36.746681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d01675-d783-4c9d-ab52-4cdc5e2baa7a None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:36.747108 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d01675-d783-4c9d-ab52-4cdc5e2baa7a None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:36.747528 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d01675-d783-4c9d-ab52-4cdc5e2baa7a None admin] PATH_INFO: `/v3/projects/7f845d06024f4ea9b859e6d0dcef1534` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:36.749178 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d01675-d783-4c9d-ab52-4cdc5e2baa7a None admin] RBAC: Authorizing `identity:get_project(project_id=7f845d06024f4ea9b859e6d0dcef1534)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:36.750860 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d01675-d783-4c9d-ab52-4cdc5e2baa7a None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:36.753005 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 103/206] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:14:36 2022] GET /identity/v3/projects/7f845d06024f4ea9b859e6d0dcef1534 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:36.760393 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d01675-d783-4c9d-ab52-4cdc5e2baa7a None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:36.855589 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3e160-511b-4ec1-bc6f-3a2c177a407b None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:36.892569 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:36.922811 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf193b-b2c1-4c3d-9120-508f885ee63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:36.923383 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf193b-b2c1-4c3d-9120-508f885ee63d None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:36.923664 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf193b-b2c1-4c3d-9120-508f885ee63d None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:36.923934 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf193b-b2c1-4c3d-9120-508f885ee63d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:36.925084 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf193b-b2c1-4c3d-9120-508f885ee63d None admin] RBAC: Adding query filter params (role.id=90a856ad3f4b4f5db89fbf1ee0841819, scope.project.id=7ef24b891e2145d0ac96f35d4f4c385f, user.id=6d9b34bebb7c4179ac2a5751cd671bb8) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:36.925402 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf193b-b2c1-4c3d-9120-508f885ee63d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:36.927476 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf193b-b2c1-4c3d-9120-508f885ee63d None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:36.935554 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 104/207] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Jun 27 09:14:36 2022] GET /identity/v3/role_assignments?user.id=6d9b34bebb7c4179ac2a5751cd671bb8&scope.project.id=7ef24b891e2145d0ac96f35d4f4c385f&role.id=90a856ad3f4b4f5db89fbf1ee0841819 => generated 608 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:14:36.954380 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d01675-d783-4c9d-ab52-4cdc5e2baa7a None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:36.994007 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0d609-a1e1-46a2-a57d-585e8c72968c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:36.994954 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0d609-a1e1-46a2-a57d-585e8c72968c None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:36.995385 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0d609-a1e1-46a2-a57d-585e8c72968c None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:36.995807 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0d609-a1e1-46a2-a57d-585e8c72968c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:36.996880 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d0d609-a1e1-46a2-a57d-585e8c72968c None admin] RBAC: Adding query filter params (role.id=b137366eb53b42aab629a88be737eaf9, scope.project.id=7f845d06024f4ea9b859e6d0dcef1534, user.id=a59286eafc1d45ebb3e4c3279eb1ba69) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:36.997356 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d0d609-a1e1-46a2-a57d-585e8c72968c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:36.998959 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d0d609-a1e1-46a2-a57d-585e8c72968c None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:37.005639 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 104/208] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Jun 27 09:14:36 2022] GET /identity/v3/role_assignments?user.id=a59286eafc1d45ebb3e4c3279eb1ba69&scope.project.id=7f845d06024f4ea9b859e6d0dcef1534&role.id=b137366eb53b42aab629a88be737eaf9 => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:38.234071 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be50424-aee3-4da4-916f-011fc1a23879 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:38.235116 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be50424-aee3-4da4-916f-011fc1a23879 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:38.235603 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be50424-aee3-4da4-916f-011fc1a23879 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:38.237238 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 105/209] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:14:38.242970 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022dc3e3-f713-48ff-b124-05bfabc79ae6 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:38.243942 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022dc3e3-f713-48ff-b124-05bfabc79ae6 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:38.244477 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022dc3e3-f713-48ff-b124-05bfabc79ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:38.262851 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-022dc3e3-f713-48ff-b124-05bfabc79ae6 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:38.264465 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-022dc3e3-f713-48ff-b124-05bfabc79ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:38.310827 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:38.315490 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb7808-e8a6-4620-8d53-ab4c3dfd45e4 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:38.315784 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb7808-e8a6-4620-8d53-ab4c3dfd45e4 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:38.316067 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb7808-e8a6-4620-8d53-ab4c3dfd45e4 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:38.317603 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 106/210] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:14:38.323976 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974286a-ef56-444a-890f-e1c426bbeb39 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:38.324302 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974286a-ef56-444a-890f-e1c426bbeb39 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:38.324579 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974286a-ef56-444a-890f-e1c426bbeb39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:38.340294 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 105/211] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:14:38.348715 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-1974286a-ef56-444a-890f-e1c426bbeb39 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:38.349938 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-1974286a-ef56-444a-890f-e1c426bbeb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:38.363754 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022dc3e3-f713-48ff-b124-05bfabc79ae6 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:38.440585 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 107/212] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 09:14:38.442230 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39355a7-b347-44a8-94fe-a6c56ae17a00 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:38.442519 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39355a7-b347-44a8-94fe-a6c56ae17a00 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:38.442798 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39355a7-b347-44a8-94fe-a6c56ae17a00 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:38.444813 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 108/213] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:14:38.450319 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b0738-ca69-4360-9250-189b1ef0e046 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:38.450607 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b0738-ca69-4360-9250-189b1ef0e046 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:38.450884 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b0738-ca69-4360-9250-189b1ef0e046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:38.472078 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-1f8b0738-ca69-4360-9250-189b1ef0e046 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:38.473655 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-1f8b0738-ca69-4360-9250-189b1ef0e046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:38.488148 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022dc3e3-f713-48ff-b124-05bfabc79ae6 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:38.563667 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f68d09-50f9-4884-abc5-6af901743ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:38.564492 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f68d09-50f9-4884-abc5-6af901743ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:38.564772 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f68d09-50f9-4884-abc5-6af901743ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:38.565043 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f68d09-50f9-4884-abc5-6af901743ea9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:38.571980 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 109/214] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:14:38.573426 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b0738-ca69-4360-9250-189b1ef0e046 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:38.576928 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f68d09-50f9-4884-abc5-6af901743ea9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:14:38.584562 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-10f68d09-50f9-4884-abc5-6af901743ea9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:14:38.584562 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:14:38.584562 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:14:38.584562 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:14:38.584562 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:14:38.584562 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:14:38.584562 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:14:38.584562 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:14:38.584562 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:14:38.584562 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:14:38.584562 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:14:38.584562 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:14:38.584562 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:14:38.584562 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:14:38.584562 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:14:38.584562 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:14:38.585455 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:14:38.585455 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:14:38.585455 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:14:38.585455 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:14:38.585455 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:14:38.585455 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:14:38.585455 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:14:38.585455 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:14:38.585455 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:14:38.585455 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:14:38.585455 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:14:38.585455 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:14:38.585455 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:14:38.585455 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:14:38.585455 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:14:38.585455 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:14:38.586216 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:14:38.586216 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:14:38.586216 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:14:38.586216 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:14:38.586216 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:14:38.586216 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:14:38.586216 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:14:38.586216 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:14:38.586216 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:14:38.586216 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:14:38.586216 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:14:38.586216 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:14:38.590676 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 106/215] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Jun 27 09:14:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 09:14:38.591543 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f68d09-50f9-4884-abc5-6af901743ea9 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:38.625754 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:38.629915 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:38.688660 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b0738-ca69-4360-9250-189b1ef0e046 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:38.698349 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f68d09-50f9-4884-abc5-6af901743ea9 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:38.724367 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d98eed-2212-4a28-9435-0abc7ff701bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:38.726001 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d98eed-2212-4a28-9435-0abc7ff701bd None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:38.726428 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d98eed-2212-4a28-9435-0abc7ff701bd None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:38.726841 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d98eed-2212-4a28-9435-0abc7ff701bd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:38.736164 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ad669-bb02-491a-b52d-48a24931aaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:38.736867 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ad669-bb02-491a-b52d-48a24931aaaf None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:38.737130 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ad669-bb02-491a-b52d-48a24931aaaf None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:38.737308 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d98eed-2212-4a28-9435-0abc7ff701bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:14:38.737406 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ad669-bb02-491a-b52d-48a24931aaaf None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:38.738141 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ad669-bb02-491a-b52d-48a24931aaaf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:38.738450 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ad669-bb02-491a-b52d-48a24931aaaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:38.739928 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ad669-bb02-491a-b52d-48a24931aaaf None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:38.745018 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-f3d98eed-2212-4a28-9435-0abc7ff701bd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 09:14:38.745018 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:14:38.745018 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:14:38.745018 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:14:38.745018 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:14:38.745018 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:14:38.745018 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:14:38.745018 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:14:38.745018 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:14:38.745018 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:14:38.745018 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:14:38.745018 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:14:38.745018 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:14:38.745018 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:14:38.745018 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:14:38.745018 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:14:38.745872 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:14:38.745872 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:14:38.745872 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:14:38.745872 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:14:38.745872 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:14:38.745872 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:14:38.745872 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:14:38.745872 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:14:38.745872 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:14:38.745872 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:14:38.745872 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:14:38.745872 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:14:38.745872 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:14:38.745872 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:14:38.745872 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:14:38.745872 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:14:38.746662 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:14:38.746662 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:14:38.746662 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:14:38.746662 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:14:38.746662 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:14:38.746662 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:14:38.746662 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:14:38.746662 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:14:38.746662 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:14:38.746662 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:14:38.746662 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 09:14:38.746662 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:14:38.746662 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 110/216] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:14:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:14:38.748715 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d98eed-2212-4a28-9435-0abc7ff701bd None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:38.755302 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 107/217] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:14:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:38.755302 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ad669-bb02-491a-b52d-48a24931aaaf None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:38.854697 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:38.858531 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:38.858898 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d98eed-2212-4a28-9435-0abc7ff701bd None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:38.862506 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ad669-bb02-491a-b52d-48a24931aaaf None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:38.895028 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c71af9-b9f6-43bf-b8a9-a2d00e3eb3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:38.895745 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c71af9-b9f6-43bf-b8a9-a2d00e3eb3a9 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:38.895991 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c6124-b74d-4ed4-8e57-7e53c2358b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:38.896102 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c71af9-b9f6-43bf-b8a9-a2d00e3eb3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:38.896377 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c71af9-b9f6-43bf-b8a9-a2d00e3eb3a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:38.896715 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c6124-b74d-4ed4-8e57-7e53c2358b04 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:38.897001 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c6124-b74d-4ed4-8e57-7e53c2358b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:38.897832 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c6124-b74d-4ed4-8e57-7e53c2358b04 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:38.898174 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c71af9-b9f6-43bf-b8a9-a2d00e3eb3a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:38.898580 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c6124-b74d-4ed4-8e57-7e53c2358b04 None admin] RBAC: Adding query filter params (name=member) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:38.898907 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c6124-b74d-4ed4-8e57-7e53c2358b04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:38.900024 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c71af9-b9f6-43bf-b8a9-a2d00e3eb3a9 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:38.900295 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c6124-b74d-4ed4-8e57-7e53c2358b04 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:38.902604 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 111/218] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:14:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:38.903493 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c71af9-b9f6-43bf-b8a9-a2d00e3eb3a9 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:38.912090 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 108/219] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Jun 27 09:14:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:38.913817 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c6124-b74d-4ed4-8e57-7e53c2358b04 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:39.003784 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c71af9-b9f6-43bf-b8a9-a2d00e3eb3a9 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:39.026251 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c6124-b74d-4ed4-8e57-7e53c2358b04 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:39.038783 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb5d118-ca4b-4cec-86e1-e515ff68b79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:39.039655 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb5d118-ca4b-4cec-86e1-e515ff68b79b None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:39.039940 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb5d118-ca4b-4cec-86e1-e515ff68b79b None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:39.040229 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb5d118-ca4b-4cec-86e1-e515ff68b79b None admin] PATH_INFO: `/v3/users/a59286eafc1d45ebb3e4c3279eb1ba69` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:39.041453 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb5d118-ca4b-4cec-86e1-e515ff68b79b None admin] RBAC: Authorizing `identity:get_user(user_id=a59286eafc1d45ebb3e4c3279eb1ba69)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:39.042905 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb5d118-ca4b-4cec-86e1-e515ff68b79b None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:39.044602 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 112/220] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Jun 27 09:14:38 2022] GET /identity/v3/users/a59286eafc1d45ebb3e4c3279eb1ba69 => generated 283 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:39.048441 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb5d118-ca4b-4cec-86e1-e515ff68b79b None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:39.067064 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda17b4d-432c-4e57-b96c-b7cc6d433a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:39.067737 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda17b4d-432c-4e57-b96c-b7cc6d433a22 None admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:39.068018 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda17b4d-432c-4e57-b96c-b7cc6d433a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:39.068326 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda17b4d-432c-4e57-b96c-b7cc6d433a22 None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:39.069563 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda17b4d-432c-4e57-b96c-b7cc6d433a22 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:39.071015 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda17b4d-432c-4e57-b96c-b7cc6d433a22 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:39.084188 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:39.152041 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb5d118-ca4b-4cec-86e1-e515ff68b79b None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:39.177496 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 109/221] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Jun 27 09:14:38 2022] POST /identity/v3/users => generated 297 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:14:39.178328 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda17b4d-432c-4e57-b96c-b7cc6d433a22 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:39.186552 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a674d4b-c8e2-4cd4-8262-182c6fae0384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:39.187375 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a674d4b-c8e2-4cd4-8262-182c6fae0384 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:39.187653 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a674d4b-c8e2-4cd4-8262-182c6fae0384 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:39.187924 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a674d4b-c8e2-4cd4-8262-182c6fae0384 None admin] PATH_INFO: `/v3/users/320c8ba2b86747de96bf56f4aec52e84` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:39.209797 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a674d4b-c8e2-4cd4-8262-182c6fae0384 None admin] RBAC: Authorizing `identity:get_user(user_id=320c8ba2b86747de96bf56f4aec52e84)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:39.211209 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:39.212059 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a674d4b-c8e2-4cd4-8262-182c6fae0384 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:39.214134 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 113/222] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Jun 27 09:14:39 2022] GET /identity/v3/users/320c8ba2b86747de96bf56f4aec52e84 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:39.215834 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1c927-d8d9-4817-a0bd-6a72c243bdbf None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:39.216213 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1c927-d8d9-4817-a0bd-6a72c243bdbf None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:39.216493 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1c927-d8d9-4817-a0bd-6a72c243bdbf None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:39.217738 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 114/223] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:14:39.221338 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1c927-d8d9-4817-a0bd-6a72c243bdbf None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:39.309763 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda17b4d-432c-4e57-b96c-b7cc6d433a22 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:39.329320 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:39.339990 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1c927-d8d9-4817-a0bd-6a72c243bdbf None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:39.355350 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4699caa4-1789-4bc8-a5ca-59f6a6237045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:39.356454 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699caa4-1789-4bc8-a5ca-59f6a6237045 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:39.356630 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699caa4-1789-4bc8-a5ca-59f6a6237045 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:39.356904 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699caa4-1789-4bc8-a5ca-59f6a6237045 None admin] PATH_INFO: `/v3/projects/7f845d06024f4ea9b859e6d0dcef1534` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:39.358111 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4699caa4-1789-4bc8-a5ca-59f6a6237045 None admin] RBAC: Authorizing `identity:get_project(project_id=7f845d06024f4ea9b859e6d0dcef1534)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:39.359566 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4699caa4-1789-4bc8-a5ca-59f6a6237045 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:39.362210 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 110/224] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:14:39 2022] GET /identity/v3/projects/7f845d06024f4ea9b859e6d0dcef1534 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:39.363183 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9f913-e875-4271-8d3e-04fcc17bef53 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:39.363461 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9f913-e875-4271-8d3e-04fcc17bef53 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:39.363794 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9f913-e875-4271-8d3e-04fcc17bef53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:39.378769 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b15ff5-072c-4a48-a534-28db202f2076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:39.379442 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b15ff5-072c-4a48-a534-28db202f2076 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:39.379705 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b15ff5-072c-4a48-a534-28db202f2076 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:39.379977 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b15ff5-072c-4a48-a534-28db202f2076 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:39.388229 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-83f9f913-e875-4271-8d3e-04fcc17bef53 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:39.388229 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-83f9f913-e875-4271-8d3e-04fcc17bef53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:39.480310 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 111/225] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:14:39.481164 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9f913-e875-4271-8d3e-04fcc17bef53 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:39.481420 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b15ff5-072c-4a48-a534-28db202f2076 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:39.483132 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b15ff5-072c-4a48-a534-28db202f2076 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:39.505677 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:39.594061 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9f913-e875-4271-8d3e-04fcc17bef53 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:39.626161 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 115/226] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:14:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 09:14:39.626161 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:39.627646 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b15ff5-072c-4a48-a534-28db202f2076 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:39.630870 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2125296-6703-4c85-a702-fefc70bea97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:39.632224 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2125296-6703-4c85-a702-fefc70bea97f None admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:39.632224 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2125296-6703-4c85-a702-fefc70bea97f None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:39.632417 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2125296-6703-4c85-a702-fefc70bea97f None admin] PATH_INFO: `/v3/projects/7f845d06024f4ea9b859e6d0dcef1534/users/a59286eafc1d45ebb3e4c3279eb1ba69/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:39.634383 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2125296-6703-4c85-a702-fefc70bea97f None admin] RBAC: Authorizing `identity:create_grant(project_id=7f845d06024f4ea9b859e6d0dcef1534, user_id=a59286eafc1d45ebb3e4c3279eb1ba69, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:39.635842 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2125296-6703-4c85-a702-fefc70bea97f None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:39.706874 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 112/227] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Jun 27 09:14:39 2022] PUT /identity/v3/projects/7f845d06024f4ea9b859e6d0dcef1534/users/a59286eafc1d45ebb3e4c3279eb1ba69/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:14:39.708135 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2125296-6703-4c85-a702-fefc70bea97f None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:39.743347 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b15ff5-072c-4a48-a534-28db202f2076 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:39.783353 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8be616-f93f-445a-bbeb-addd4505d2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:39.784579 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8be616-f93f-445a-bbeb-addd4505d2d7 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:39.785044 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8be616-f93f-445a-bbeb-addd4505d2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:39.785499 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8be616-f93f-445a-bbeb-addd4505d2d7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:39.805981 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8be616-f93f-445a-bbeb-addd4505d2d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:14:39.817196 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:39.818783 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-dc8be616-f93f-445a-bbeb-addd4505d2d7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 09:14:39.818783 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:14:39.818783 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:14:39.818783 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:14:39.818783 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:14:39.818783 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:14:39.818783 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:14:39.818783 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:14:39.818783 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:14:39.818783 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:14:39.818783 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:14:39.818783 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:14:39.818783 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:14:39.818783 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:14:39.818783 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:14:39.818783 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:14:39.819760 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:14:39.819760 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:14:39.819760 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:14:39.819760 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:14:39.819760 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:14:39.819760 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:14:39.819760 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:14:39.819760 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:14:39.819760 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:14:39.819760 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:14:39.819760 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:14:39.819760 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:14:39.819760 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:14:39.819760 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:14:39.819760 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:14:39.819760 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:14:39.820591 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:14:39.820591 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:14:39.820591 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:14:39.820591 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:14:39.820591 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:14:39.820591 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:14:39.820591 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:14:39.820591 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:14:39.820591 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:14:39.820591 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:14:39.820591 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 09:14:39.820591 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:14:39.821188 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 116/228] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Jun 27 09:14:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:14:39.829493 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8be616-f93f-445a-bbeb-addd4505d2d7 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:39.852378 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2125296-6703-4c85-a702-fefc70bea97f None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:39.891418 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1adf02-5f10-4e4a-8a1e-ce4314915f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:39.892511 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1adf02-5f10-4e4a-8a1e-ce4314915f20 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:39.892905 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1adf02-5f10-4e4a-8a1e-ce4314915f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:39.893277 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1adf02-5f10-4e4a-8a1e-ce4314915f20 None admin] PATH_INFO: `/v3/projects/7f845d06024f4ea9b859e6d0dcef1534` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:39.895094 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1adf02-5f10-4e4a-8a1e-ce4314915f20 None admin] RBAC: Authorizing `identity:get_project(project_id=7f845d06024f4ea9b859e6d0dcef1534)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:39.896897 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1adf02-5f10-4e4a-8a1e-ce4314915f20 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:39.904357 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 113/229] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:14:39 2022] GET /identity/v3/projects/7f845d06024f4ea9b859e6d0dcef1534 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:39.906667 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1adf02-5f10-4e4a-8a1e-ce4314915f20 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:39.910500 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:39.979377 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8be616-f93f-445a-bbeb-addd4505d2d7 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:40.018253 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec9f86b-6d5b-4a76-b94a-e0d9efe3b73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:40.018911 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9f86b-6d5b-4a76-b94a-e0d9efe3b73f None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:40.019194 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9f86b-6d5b-4a76-b94a-e0d9efe3b73f None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:40.019469 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9f86b-6d5b-4a76-b94a-e0d9efe3b73f None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:40.020254 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec9f86b-6d5b-4a76-b94a-e0d9efe3b73f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:40.020569 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec9f86b-6d5b-4a76-b94a-e0d9efe3b73f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:40.021964 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec9f86b-6d5b-4a76-b94a-e0d9efe3b73f None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:40.031707 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 117/230] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:14:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:14:40.037038 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec9f86b-6d5b-4a76-b94a-e0d9efe3b73f None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:40.054932 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1adf02-5f10-4e4a-8a1e-ce4314915f20 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:40.093145 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8231fba-0369-4e61-ac54-56bb827f3510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:40.094153 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8231fba-0369-4e61-ac54-56bb827f3510 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:40.094776 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8231fba-0369-4e61-ac54-56bb827f3510 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:40.095273 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8231fba-0369-4e61-ac54-56bb827f3510 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:40.096435 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8231fba-0369-4e61-ac54-56bb827f3510 None admin] RBAC: Adding query filter params (role.id=b1260d153ca7497eaaaa0991f053ff89, scope.project.id=7f845d06024f4ea9b859e6d0dcef1534, user.id=320c8ba2b86747de96bf56f4aec52e84) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:40.096952 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8231fba-0369-4e61-ac54-56bb827f3510 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:40.098868 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8231fba-0369-4e61-ac54-56bb827f3510 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:40.117207 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 114/231] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Jun 27 09:14:39 2022] GET /identity/v3/role_assignments?user.id=320c8ba2b86747de96bf56f4aec52e84&scope.project.id=7f845d06024f4ea9b859e6d0dcef1534&role.id=b1260d153ca7497eaaaa0991f053ff89 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:40.156189 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec9f86b-6d5b-4a76-b94a-e0d9efe3b73f None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:40.172598 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:40.194825 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96797018-88ba-4ec3-90b6-867699a79dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:40.195729 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96797018-88ba-4ec3-90b6-867699a79dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:40.196011 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96797018-88ba-4ec3-90b6-867699a79dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:40.196310 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96797018-88ba-4ec3-90b6-867699a79dd6 None admin] PATH_INFO: `/v3/users/a59286eafc1d45ebb3e4c3279eb1ba69` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:40.197618 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96797018-88ba-4ec3-90b6-867699a79dd6 None admin] RBAC: Authorizing `identity:get_user(user_id=a59286eafc1d45ebb3e4c3279eb1ba69)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:40.199108 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96797018-88ba-4ec3-90b6-867699a79dd6 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:40.201093 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 118/232] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Jun 27 09:14:40 2022] GET /identity/v3/users/a59286eafc1d45ebb3e4c3279eb1ba69 => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:14:40.206578 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8231fba-0369-4e61-ac54-56bb827f3510 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:40.216825 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:40.339426 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8231fba-0369-4e61-ac54-56bb827f3510 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:40.373172 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243a41e-ed75-4628-b3f2-53de3dcab51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:40.374042 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243a41e-ed75-4628-b3f2-53de3dcab51e None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:40.374324 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243a41e-ed75-4628-b3f2-53de3dcab51e None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:40.374636 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243a41e-ed75-4628-b3f2-53de3dcab51e None admin] PATH_INFO: `/v3/projects/7f845d06024f4ea9b859e6d0dcef1534` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:40.375903 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0243a41e-ed75-4628-b3f2-53de3dcab51e None admin] RBAC: Authorizing `identity:get_project(project_id=7f845d06024f4ea9b859e6d0dcef1534)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:40.377375 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0243a41e-ed75-4628-b3f2-53de3dcab51e None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:40.379411 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 115/233] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:14:40 2022] GET /identity/v3/projects/7f845d06024f4ea9b859e6d0dcef1534 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:40.385822 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96797018-88ba-4ec3-90b6-867699a79dd6 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:40.505594 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96797018-88ba-4ec3-90b6-867699a79dd6 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:40.545186 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94def42-abbb-4129-9efe-086eabdcd674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:40.546084 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94def42-abbb-4129-9efe-086eabdcd674 None admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:40.546360 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94def42-abbb-4129-9efe-086eabdcd674 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:40.546632 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94def42-abbb-4129-9efe-086eabdcd674 None admin] PATH_INFO: `/v3/projects/7f845d06024f4ea9b859e6d0dcef1534/users/a59286eafc1d45ebb3e4c3279eb1ba69/roles/b137366eb53b42aab629a88be737eaf9` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:40.549025 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94def42-abbb-4129-9efe-086eabdcd674 None admin] RBAC: Authorizing `identity:create_grant(project_id=7f845d06024f4ea9b859e6d0dcef1534, user_id=a59286eafc1d45ebb3e4c3279eb1ba69, role_id=b137366eb53b42aab629a88be737eaf9)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:40.550481 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94def42-abbb-4129-9efe-086eabdcd674 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:40.676243 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 119/234] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Jun 27 09:14:40 2022] PUT /identity/v3/projects/7f845d06024f4ea9b859e6d0dcef1534/users/a59286eafc1d45ebb3e4c3279eb1ba69/roles/b137366eb53b42aab629a88be737eaf9 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:14:41.641802 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80aac92-544a-4f50-b312-0520ff5c8da7 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:41.642352 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80aac92-544a-4f50-b312-0520ff5c8da7 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:41.642352 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80aac92-544a-4f50-b312-0520ff5c8da7 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:41.644003 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 116/235] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:14:41.650271 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a16035-c731-4b4c-9e00-b53e0b2d5870 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:41.651174 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a16035-c731-4b4c-9e00-b53e0b2d5870 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:41.651664 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a16035-c731-4b4c-9e00-b53e0b2d5870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:41.678408 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-89a16035-c731-4b4c-9e00-b53e0b2d5870 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:41.679981 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-89a16035-c731-4b4c-9e00-b53e0b2d5870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:41.733250 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:41.777820 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 120/236] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:14:41.812719 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80aac92-544a-4f50-b312-0520ff5c8da7 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:41.902768 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:41.933870 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80aac92-544a-4f50-b312-0520ff5c8da7 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:41.979852 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf4b23a-2ebd-4721-ad3a-9605d7eef942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:41.980681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4b23a-2ebd-4721-ad3a-9605d7eef942 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:41.980968 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4b23a-2ebd-4721-ad3a-9605d7eef942 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:41.981250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4b23a-2ebd-4721-ad3a-9605d7eef942 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:41.999931 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfa6a4-a956-4857-b0e5-c60764f87ead None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:42.000106 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf4b23a-2ebd-4721-ad3a-9605d7eef942 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:14:42.000339 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfa6a4-a956-4857-b0e5-c60764f87ead None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:42.000526 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfa6a4-a956-4857-b0e5-c60764f87ead None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:42.002167 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 121/237] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:14:42.007658 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0949e0-3a21-4d72-a38a-37d156de0595 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:42.007971 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0949e0-3a21-4d72-a38a-37d156de0595 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:42.008228 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0949e0-3a21-4d72-a38a-37d156de0595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:42.008699 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-9cf4b23a-2ebd-4721-ad3a-9605d7eef942 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 09:14:42.008699 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:14:42.008699 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:14:42.008699 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:14:42.008699 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:14:42.008699 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:14:42.008699 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:14:42.008699 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:14:42.008699 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:14:42.008699 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:14:42.008699 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:14:42.008699 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:14:42.008699 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:14:42.008699 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:14:42.008699 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:14:42.008699 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:14:42.009536 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:14:42.009536 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:14:42.009536 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:14:42.009536 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:14:42.009536 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:14:42.009536 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:14:42.009536 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:14:42.009536 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:14:42.009536 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:14:42.009536 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:14:42.009536 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:14:42.009536 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:14:42.009536 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:14:42.009536 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:14:42.009536 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:14:42.009536 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:14:42.010311 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:14:42.010311 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:14:42.010311 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:14:42.010311 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:14:42.010311 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:14:42.010311 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:14:42.010311 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:14:42.010311 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:14:42.010311 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:14:42.010311 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:14:42.010311 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 09:14:42.010311 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:14:42.010311 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 117/238] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:14:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:14:42.019106 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf4b23a-2ebd-4721-ad3a-9605d7eef942 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:42.031099 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-5a0949e0-3a21-4d72-a38a-37d156de0595 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:42.043619 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-5a0949e0-3a21-4d72-a38a-37d156de0595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:42.150690 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf4b23a-2ebd-4721-ad3a-9605d7eef942 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:42.193449 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bbc5d7-7ef8-454b-a5a3-02ef674a5ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:42.194659 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbc5d7-7ef8-454b-a5a3-02ef674a5ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:42.194948 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbc5d7-7ef8-454b-a5a3-02ef674a5ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:42.195226 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbc5d7-7ef8-454b-a5a3-02ef674a5ac9 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:42.196043 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bbc5d7-7ef8-454b-a5a3-02ef674a5ac9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:42.196379 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bbc5d7-7ef8-454b-a5a3-02ef674a5ac9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:42.197772 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bbc5d7-7ef8-454b-a5a3-02ef674a5ac9 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:42.200502 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:42.221643 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 122/239] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 09:14:42.222394 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 118/240] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Jun 27 09:14:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:14:42.227743 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0949e0-3a21-4d72-a38a-37d156de0595 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:42.274632 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bbc5d7-7ef8-454b-a5a3-02ef674a5ac9 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:42.427671 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0949e0-3a21-4d72-a38a-37d156de0595 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:42.430113 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:42.455258 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bbc5d7-7ef8-454b-a5a3-02ef674a5ac9 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:42.476509 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d182b-450a-44b1-9b27-b4ee1dd80497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:42.478723 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d182b-450a-44b1-9b27-b4ee1dd80497 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:42.479354 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d182b-450a-44b1-9b27-b4ee1dd80497 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:42.480005 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d182b-450a-44b1-9b27-b4ee1dd80497 None admin] PATH_INFO: `/v3/users/2be9d96248164d18a6815da7ecb9c22a` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:42.497856 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c24073-306b-4190-873f-4ce7fe69ed66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:42.498184 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060d182b-450a-44b1-9b27-b4ee1dd80497 None admin] RBAC: Authorizing `identity:get_user(user_id=2be9d96248164d18a6815da7ecb9c22a)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:42.498903 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c24073-306b-4190-873f-4ce7fe69ed66 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:42.499283 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c24073-306b-4190-873f-4ce7fe69ed66 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:42.499650 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c24073-306b-4190-873f-4ce7fe69ed66 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:42.500325 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060d182b-450a-44b1-9b27-b4ee1dd80497 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:42.501059 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c24073-306b-4190-873f-4ce7fe69ed66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:42.502642 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c24073-306b-4190-873f-4ce7fe69ed66 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:42.502904 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 123/241] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Jun 27 09:14:42 2022] GET /identity/v3/users/2be9d96248164d18a6815da7ecb9c22a => generated 297 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:14:42.504425 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d81967-82f3-4843-ae4a-7b7eea54991f None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:42.504881 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d81967-82f3-4843-ae4a-7b7eea54991f None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:42.505371 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d81967-82f3-4843-ae4a-7b7eea54991f None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:42.507577 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 124/242] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:14:42.508834 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 119/243] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:14:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:14:42.517499 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d81967-82f3-4843-ae4a-7b7eea54991f None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:42.518339 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69524362-db1e-4572-9a4b-f85910ed34da None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:42.518979 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69524362-db1e-4572-9a4b-f85910ed34da None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:42.519458 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69524362-db1e-4572-9a4b-f85910ed34da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:42.540925 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-69524362-db1e-4572-9a4b-f85910ed34da None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:42.542984 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-69524362-db1e-4572-9a4b-f85910ed34da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:42.618823 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:42.630621 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 120/244] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:14:42.632223 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69524362-db1e-4572-9a4b-f85910ed34da None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:42.669173 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d81967-82f3-4843-ae4a-7b7eea54991f None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:42.715943 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd13a20-92e6-42b3-ba3a-76d2b1389199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:42.716622 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd13a20-92e6-42b3-ba3a-76d2b1389199 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:42.716907 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd13a20-92e6-42b3-ba3a-76d2b1389199 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:42.717184 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd13a20-92e6-42b3-ba3a-76d2b1389199 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:42.754108 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:42.763586 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69524362-db1e-4572-9a4b-f85910ed34da None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:42.796517 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd13a20-92e6-42b3-ba3a-76d2b1389199 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:42.797997 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd13a20-92e6-42b3-ba3a-76d2b1389199 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:42.800687 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e62f12-4112-4aa9-bdef-71cee6141044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:42.801428 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e62f12-4112-4aa9-bdef-71cee6141044 None admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:42.801773 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e62f12-4112-4aa9-bdef-71cee6141044 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:42.802114 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e62f12-4112-4aa9-bdef-71cee6141044 None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:42.802890 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e62f12-4112-4aa9-bdef-71cee6141044 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:42.805079 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e62f12-4112-4aa9-bdef-71cee6141044 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:42.898982 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 125/245] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:14:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 09:14:42.900007 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd13a20-92e6-42b3-ba3a-76d2b1389199 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:42.913679 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 121/246] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Jun 27 09:14:42 2022] POST /identity/v3/users => generated 293 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:14:42.915144 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a49cc2-be16-4de0-b836-20827d56d8dd None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:42.915638 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a49cc2-be16-4de0-b836-20827d56d8dd None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:42.921697 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a49cc2-be16-4de0-b836-20827d56d8dd None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:42.921697 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 122/247] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:14:42.921697 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a49cc2-be16-4de0-b836-20827d56d8dd None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:43.021853 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:43.029737 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:43.105231 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd13a20-92e6-42b3-ba3a-76d2b1389199 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:43.117722 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a49cc2-be16-4de0-b836-20827d56d8dd None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:43.156992 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817909f3-2797-4e97-854e-775e104acfbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:43.158116 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817909f3-2797-4e97-854e-775e104acfbd None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:43.158620 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817909f3-2797-4e97-854e-775e104acfbd None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:43.159107 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817909f3-2797-4e97-854e-775e104acfbd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:43.172030 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f676a-5c84-4d29-bbc3-b429643b301e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:43.172714 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817909f3-2797-4e97-854e-775e104acfbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:14:43.173194 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f676a-5c84-4d29-bbc3-b429643b301e None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:43.173477 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f676a-5c84-4d29-bbc3-b429643b301e None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:43.173752 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f676a-5c84-4d29-bbc3-b429643b301e None admin] PATH_INFO: `/v3/projects/7f845d06024f4ea9b859e6d0dcef1534` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:43.174949 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312f676a-5c84-4d29-bbc3-b429643b301e None admin] RBAC: Authorizing `identity:get_project(project_id=7f845d06024f4ea9b859e6d0dcef1534)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:43.176452 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312f676a-5c84-4d29-bbc3-b429643b301e None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:43.178348 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 123/248] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:14:42 2022] GET /identity/v3/projects/7f845d06024f4ea9b859e6d0dcef1534 => generated 302 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:43.179347 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c1da3-98ed-44f3-bd1a-d00127d97247 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:43.179711 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c1da3-98ed-44f3-bd1a-d00127d97247 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:43.179897 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c1da3-98ed-44f3-bd1a-d00127d97247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:43.183010 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-817909f3-2797-4e97-854e-775e104acfbd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:14:43.183010 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:14:43.183010 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:14:43.183010 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:14:43.183010 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:14:43.183010 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:14:43.183010 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:14:43.183010 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:14:43.183010 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:14:43.183010 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:14:43.183010 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:14:43.183010 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:14:43.183010 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:14:43.183010 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:14:43.183010 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:14:43.183010 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:14:43.183984 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:14:43.183984 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:14:43.183984 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:14:43.183984 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:14:43.183984 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:14:43.183984 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:14:43.183984 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:14:43.183984 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:14:43.183984 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:14:43.183984 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:14:43.183984 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:14:43.183984 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:14:43.183984 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:14:43.183984 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:14:43.183984 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:14:43.183984 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:14:43.184804 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:14:43.184804 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:14:43.184804 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:14:43.184804 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:14:43.184804 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:14:43.184804 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:14:43.184804 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:14:43.184804 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:14:43.184804 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:14:43.184804 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:14:43.184804 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:14:43.184804 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:14:43.184804 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 126/249] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Jun 27 09:14:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:14:43.191285 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817909f3-2797-4e97-854e-775e104acfbd None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:43.204300 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-242c1da3-98ed-44f3-bd1a-d00127d97247 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:43.206495 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-242c1da3-98ed-44f3-bd1a-d00127d97247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:43.296888 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 124/250] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:14:43.297748 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c1da3-98ed-44f3-bd1a-d00127d97247 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:43.324900 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817909f3-2797-4e97-854e-775e104acfbd None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:43.347921 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:43.362917 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:43.367757 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114d22e-d016-4784-b3e2-99a8c0de114f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:43.368733 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114d22e-d016-4784-b3e2-99a8c0de114f None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:43.369209 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114d22e-d016-4784-b3e2-99a8c0de114f None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:43.369772 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114d22e-d016-4784-b3e2-99a8c0de114f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:43.371350 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9114d22e-d016-4784-b3e2-99a8c0de114f None admin] RBAC: Adding query filter params (role.id=90a856ad3f4b4f5db89fbf1ee0841819, scope.project.id=7f845d06024f4ea9b859e6d0dcef1534, user.id=2be9d96248164d18a6815da7ecb9c22a) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:43.372101 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9114d22e-d016-4784-b3e2-99a8c0de114f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:43.373803 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9114d22e-d016-4784-b3e2-99a8c0de114f None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:43.380840 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 127/251] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Jun 27 09:14:43 2022] GET /identity/v3/role_assignments?user.id=2be9d96248164d18a6815da7ecb9c22a&scope.project.id=7f845d06024f4ea9b859e6d0dcef1534&role.id=90a856ad3f4b4f5db89fbf1ee0841819 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:43.383725 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277a5b7-1d32-4e92-ab5b-634f2635584f None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:43.384574 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277a5b7-1d32-4e92-ab5b-634f2635584f None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:43.385085 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277a5b7-1d32-4e92-ab5b-634f2635584f None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:43.386960 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 128/252] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:14:43.388093 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1277a5b7-1d32-4e92-ab5b-634f2635584f None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:43.443636 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c1da3-98ed-44f3-bd1a-d00127d97247 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:43.494623 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e29f8c-c203-4359-aafe-3d0121e1e972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:43.495650 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e29f8c-c203-4359-aafe-3d0121e1e972 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:43.495940 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e29f8c-c203-4359-aafe-3d0121e1e972 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:43.496237 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e29f8c-c203-4359-aafe-3d0121e1e972 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:43.497042 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e29f8c-c203-4359-aafe-3d0121e1e972 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:43.498000 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e29f8c-c203-4359-aafe-3d0121e1e972 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:43.499442 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e29f8c-c203-4359-aafe-3d0121e1e972 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:43.512873 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 125/253] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:14:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:43.514772 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c31af0-6fa5-4dd2-ae7c-c9fbd5059b9b None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:43.515073 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c31af0-6fa5-4dd2-ae7c-c9fbd5059b9b None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:43.515350 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c31af0-6fa5-4dd2-ae7c-c9fbd5059b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:43.526194 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1277a5b7-1d32-4e92-ab5b-634f2635584f None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:43.541266 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-32c31af0-6fa5-4dd2-ae7c-c9fbd5059b9b None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:43.544862 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-32c31af0-6fa5-4dd2-ae7c-c9fbd5059b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:43.586756 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d1545-3494-47a9-bf49-3d9b8ef052a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:43.587483 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d1545-3494-47a9-bf49-3d9b8ef052a2 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:43.587761 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d1545-3494-47a9-bf49-3d9b8ef052a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:43.588049 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d1545-3494-47a9-bf49-3d9b8ef052a2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:43.603007 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307d1545-3494-47a9-bf49-3d9b8ef052a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:14:43.612219 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-307d1545-3494-47a9-bf49-3d9b8ef052a2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 09:14:43.612219 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:14:43.612219 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:14:43.612219 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:14:43.612219 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:14:43.612219 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:14:43.612219 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:14:43.612219 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:14:43.612219 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:14:43.612219 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:14:43.612219 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:14:43.612219 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:14:43.612219 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:14:43.612219 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:14:43.612219 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:14:43.612219 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:14:43.613216 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:14:43.613216 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:14:43.613216 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:14:43.613216 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:14:43.613216 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:14:43.613216 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:14:43.613216 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:14:43.613216 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:14:43.613216 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:14:43.613216 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:14:43.613216 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:14:43.613216 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:14:43.613216 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:14:43.613216 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:14:43.613216 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:14:43.613216 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:14:43.613982 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:14:43.613982 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:14:43.613982 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:14:43.613982 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:14:43.613982 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:14:43.613982 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:14:43.613982 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:14:43.613982 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:14:43.613982 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:14:43.613982 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:14:43.613982 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 09:14:43.613982 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:14:43.613982 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 129/254] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:14:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:14:43.614760 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d1545-3494-47a9-bf49-3d9b8ef052a2 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:43.645217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 126/255] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:14:43.646423 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c31af0-6fa5-4dd2-ae7c-c9fbd5059b9b None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:43.693312 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:43.718127 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:43.770068 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d1545-3494-47a9-bf49-3d9b8ef052a2 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:43.796917 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c31af0-6fa5-4dd2-ae7c-c9fbd5059b9b None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:43.818042 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f1842-091c-4447-b241-642c9f19976c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:43.818952 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f1842-091c-4447-b241-642c9f19976c None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:43.819236 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f1842-091c-4447-b241-642c9f19976c None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:43.819512 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f1842-091c-4447-b241-642c9f19976c None admin] PATH_INFO: `/v3/users/a59286eafc1d45ebb3e4c3279eb1ba69` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:43.825804 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057f1842-091c-4447-b241-642c9f19976c None admin] RBAC: Authorizing `identity:get_user(user_id=a59286eafc1d45ebb3e4c3279eb1ba69)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:43.827286 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057f1842-091c-4447-b241-642c9f19976c None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:43.834114 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 130/256] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Jun 27 09:14:43 2022] GET /identity/v3/users/a59286eafc1d45ebb3e4c3279eb1ba69 => generated 283 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:43.835489 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f1842-091c-4447-b241-642c9f19976c None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:43.865848 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0873df95-5e3a-412a-8ae0-8eafee1565a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:43.866448 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873df95-5e3a-412a-8ae0-8eafee1565a7 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:43.866734 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873df95-5e3a-412a-8ae0-8eafee1565a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:43.867010 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873df95-5e3a-412a-8ae0-8eafee1565a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:43.868111 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0873df95-5e3a-412a-8ae0-8eafee1565a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:43.868479 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0873df95-5e3a-412a-8ae0-8eafee1565a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:43.869842 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0873df95-5e3a-412a-8ae0-8eafee1565a7 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:43.892537 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 127/257] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Jun 27 09:14:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:43.893231 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0873df95-5e3a-412a-8ae0-8eafee1565a7 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:44.013404 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f1842-091c-4447-b241-642c9f19976c None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:44.029043 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:44.055252 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257ea68-34ec-48bc-be85-d2de9f9b23c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:44.056223 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257ea68-34ec-48bc-be85-d2de9f9b23c6 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:44.056504 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257ea68-34ec-48bc-be85-d2de9f9b23c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:44.056780 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257ea68-34ec-48bc-be85-d2de9f9b23c6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:44.069972 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e257ea68-34ec-48bc-be85-d2de9f9b23c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:14:44.079816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-e257ea68-34ec-48bc-be85-d2de9f9b23c6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 09:14:44.079816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:14:44.079816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:14:44.079816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:14:44.079816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:14:44.079816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:14:44.079816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:14:44.079816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:14:44.079816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:14:44.079816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:14:44.079816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:14:44.079816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:14:44.079816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:14:44.079816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:14:44.079816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:14:44.079816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:14:44.081412 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:14:44.081412 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:14:44.081412 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:14:44.081412 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:14:44.081412 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:14:44.081412 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:14:44.081412 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:14:44.081412 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:14:44.081412 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:14:44.081412 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:14:44.081412 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:14:44.081412 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:14:44.081412 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:14:44.081412 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:14:44.081412 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:14:44.081412 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:14:44.082567 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:14:44.082567 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:14:44.082567 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:14:44.082567 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:14:44.082567 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:14:44.082567 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:14:44.082567 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:14:44.082567 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:14:44.082567 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:14:44.082567 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:14:44.082567 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 09:14:44.082567 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:14:44.082567 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 131/258] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Jun 27 09:14:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:14:44.082567 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257ea68-34ec-48bc-be85-d2de9f9b23c6 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:44.107884 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0873df95-5e3a-412a-8ae0-8eafee1565a7 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:44.108312 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:44.207302 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257ea68-34ec-48bc-be85-d2de9f9b23c6 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:44.212563 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839e2c7-94e0-465d-b3fd-644db448a3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:44.213227 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839e2c7-94e0-465d-b3fd-644db448a3a9 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:44.213511 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839e2c7-94e0-465d-b3fd-644db448a3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:44.213790 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839e2c7-94e0-465d-b3fd-644db448a3a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:44.286212 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4bfe0a-c5ea-4d8f-976c-cab1efef5d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:44.288412 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4bfe0a-c5ea-4d8f-976c-cab1efef5d41 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:44.288694 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4bfe0a-c5ea-4d8f-976c-cab1efef5d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:44.288968 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4bfe0a-c5ea-4d8f-976c-cab1efef5d41 None admin] PATH_INFO: `/v3/users/320c8ba2b86747de96bf56f4aec52e84` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:44.294281 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4bfe0a-c5ea-4d8f-976c-cab1efef5d41 None admin] RBAC: Authorizing `identity:get_user(user_id=320c8ba2b86747de96bf56f4aec52e84)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:44.295820 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4bfe0a-c5ea-4d8f-976c-cab1efef5d41 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:44.301487 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 132/259] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Jun 27 09:14:44 2022] GET /identity/v3/users/320c8ba2b86747de96bf56f4aec52e84 => generated 297 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:44.304700 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4bfe0a-c5ea-4d8f-976c-cab1efef5d41 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:44.346719 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2839e2c7-94e0-465d-b3fd-644db448a3a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:44.348215 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2839e2c7-94e0-465d-b3fd-644db448a3a9 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:44.384634 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:44.456762 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 128/260] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:14:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 09:14:44.462674 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839e2c7-94e0-465d-b3fd-644db448a3a9 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:44.465172 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:44.540648 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4bfe0a-c5ea-4d8f-976c-cab1efef5d41 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:44.604357 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc1c9e-8833-42eb-9f43-b57005e1f5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:44.606076 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc1c9e-8833-42eb-9f43-b57005e1f5f6 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:44.607100 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc1c9e-8833-42eb-9f43-b57005e1f5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:44.607721 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc1c9e-8833-42eb-9f43-b57005e1f5f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:44.609847 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839e2c7-94e0-465d-b3fd-644db448a3a9 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:44.611277 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efc1c9e-8833-42eb-9f43-b57005e1f5f6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:44.611791 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efc1c9e-8833-42eb-9f43-b57005e1f5f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:44.614904 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efc1c9e-8833-42eb-9f43-b57005e1f5f6 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:44.634307 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 133/261] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:14:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:44.635567 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc1c9e-8833-42eb-9f43-b57005e1f5f6 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:44.678201 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824f00f-3b1b-4dc8-b45b-cecc6f0fb71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:44.679570 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824f00f-3b1b-4dc8-b45b-cecc6f0fb71c None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:44.680605 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824f00f-3b1b-4dc8-b45b-cecc6f0fb71c None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:44.680899 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824f00f-3b1b-4dc8-b45b-cecc6f0fb71c None admin] PATH_INFO: `/v3/projects/7f845d06024f4ea9b859e6d0dcef1534` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:44.684941 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6824f00f-3b1b-4dc8-b45b-cecc6f0fb71c None admin] RBAC: Authorizing `identity:get_project(project_id=7f845d06024f4ea9b859e6d0dcef1534)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:44.686422 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6824f00f-3b1b-4dc8-b45b-cecc6f0fb71c None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:44.688161 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 129/262] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:14:44 2022] GET /identity/v3/projects/7f845d06024f4ea9b859e6d0dcef1534 => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:44.688953 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824f00f-3b1b-4dc8-b45b-cecc6f0fb71c None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:44.796602 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:44.825136 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc1c9e-8833-42eb-9f43-b57005e1f5f6 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:44.826841 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:44.844642 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824f00f-3b1b-4dc8-b45b-cecc6f0fb71c None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:44.885924 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85ebd57-3249-4fe4-88ad-8a6fea3d6e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:44.887062 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ebd57-3249-4fe4-88ad-8a6fea3d6e99 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:44.887621 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ebd57-3249-4fe4-88ad-8a6fea3d6e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:44.888081 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ebd57-3249-4fe4-88ad-8a6fea3d6e99 None admin] PATH_INFO: `/v3/projects/7f845d06024f4ea9b859e6d0dcef1534` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:44.889543 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85ebd57-3249-4fe4-88ad-8a6fea3d6e99 None admin] RBAC: Authorizing `identity:get_project(project_id=7f845d06024f4ea9b859e6d0dcef1534)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:44.900039 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85ebd57-3249-4fe4-88ad-8a6fea3d6e99 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:44.900039 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 134/263] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:14:44 2022] GET /identity/v3/projects/7f845d06024f4ea9b859e6d0dcef1534 => generated 302 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:44.900039 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85ebd57-3249-4fe4-88ad-8a6fea3d6e99 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:44.904969 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fd255-ee1e-416c-9d87-0ba5866ca12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:44.906096 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fd255-ee1e-416c-9d87-0ba5866ca12a None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:44.906578 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fd255-ee1e-416c-9d87-0ba5866ca12a None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:44.907048 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fd255-ee1e-416c-9d87-0ba5866ca12a None admin] PATH_INFO: `/v3/users/a59286eafc1d45ebb3e4c3279eb1ba69` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:44.909237 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112fd255-ee1e-416c-9d87-0ba5866ca12a None admin] RBAC: Authorizing `identity:get_user(user_id=a59286eafc1d45ebb3e4c3279eb1ba69)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:44.912717 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112fd255-ee1e-416c-9d87-0ba5866ca12a None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:44.915856 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 130/264] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Jun 27 09:14:44 2022] GET /identity/v3/users/a59286eafc1d45ebb3e4c3279eb1ba69 => generated 283 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:44.918234 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fd255-ee1e-416c-9d87-0ba5866ca12a None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:45.086957 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85ebd57-3249-4fe4-88ad-8a6fea3d6e99 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:45.092424 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fd255-ee1e-416c-9d87-0ba5866ca12a None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:45.138219 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4728c5d5-2e33-460a-9ba6-d277c9b3b5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:45.139492 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728c5d5-2e33-460a-9ba6-d277c9b3b5cb None admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:45.139780 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728c5d5-2e33-460a-9ba6-d277c9b3b5cb None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:45.140059 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728c5d5-2e33-460a-9ba6-d277c9b3b5cb None admin] PATH_INFO: `/v3/projects/7f845d06024f4ea9b859e6d0dcef1534/users/320c8ba2b86747de96bf56f4aec52e84/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:45.142436 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4728c5d5-2e33-460a-9ba6-d277c9b3b5cb None admin] RBAC: Authorizing `identity:create_grant(project_id=7f845d06024f4ea9b859e6d0dcef1534, user_id=320c8ba2b86747de96bf56f4aec52e84, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:45.143920 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4728c5d5-2e33-460a-9ba6-d277c9b3b5cb None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:45.164605 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c8382-3dd1-49e3-a179-311cbf9f3ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:45.165273 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c8382-3dd1-49e3-a179-311cbf9f3ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:45.165557 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c8382-3dd1-49e3-a179-311cbf9f3ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:45.165841 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c8382-3dd1-49e3-a179-311cbf9f3ce3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:45.166682 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12c8382-3dd1-49e3-a179-311cbf9f3ce3 None admin] RBAC: Adding query filter params (role.id=91c77942515d45f1ad8189c9fddf4424, scope.project.id=7f845d06024f4ea9b859e6d0dcef1534, user.id=a59286eafc1d45ebb3e4c3279eb1ba69) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:45.166995 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12c8382-3dd1-49e3-a179-311cbf9f3ce3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:45.168470 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12c8382-3dd1-49e3-a179-311cbf9f3ce3 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:45.175129 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 131/265] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Jun 27 09:14:44 2022] GET /identity/v3/role_assignments?user.id=a59286eafc1d45ebb3e4c3279eb1ba69&scope.project.id=7f845d06024f4ea9b859e6d0dcef1534&role.id=91c77942515d45f1ad8189c9fddf4424 => generated 608 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:45.175726 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c8382-3dd1-49e3-a179-311cbf9f3ce3 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:45.180573 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:45.230499 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 135/266] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Jun 27 09:14:44 2022] PUT /identity/v3/projects/7f845d06024f4ea9b859e6d0dcef1534/users/320c8ba2b86747de96bf56f4aec52e84/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:14:45.326466 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c8382-3dd1-49e3-a179-311cbf9f3ce3 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:45.376974 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f16719-7b2d-4cb4-8129-a1d7aa7dd1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:45.377643 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f16719-7b2d-4cb4-8129-a1d7aa7dd1a9 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:45.377920 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f16719-7b2d-4cb4-8129-a1d7aa7dd1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:45.378192 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f16719-7b2d-4cb4-8129-a1d7aa7dd1a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:45.471821 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f16719-7b2d-4cb4-8129-a1d7aa7dd1a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:45.471821 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f16719-7b2d-4cb4-8129-a1d7aa7dd1a9 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:45.471821 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:45.586236 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 132/267] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:14:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 09:14:45.591935 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4728c5d5-2e33-460a-9ba6-d277c9b3b5cb None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:45.608501 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783440a0-0df9-458e-98c9-adf2ef6aebd4 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:45.609111 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783440a0-0df9-458e-98c9-adf2ef6aebd4 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:45.609616 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783440a0-0df9-458e-98c9-adf2ef6aebd4 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:45.611243 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 133/268] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:14:45.623000 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57448f2-7a86-4802-8185-251922bc7c24 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:45.623289 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57448f2-7a86-4802-8185-251922bc7c24 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:45.623545 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57448f2-7a86-4802-8185-251922bc7c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:45.651658 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:45.654872 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-d57448f2-7a86-4802-8185-251922bc7c24 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:45.656078 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-d57448f2-7a86-4802-8185-251922bc7c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:45.764596 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 134/269] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 09:14:45.792225 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4728c5d5-2e33-460a-9ba6-d277c9b3b5cb None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:45.796238 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57448f2-7a86-4802-8185-251922bc7c24 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:45.836019 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:45.863871 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a701bd-9ea1-4e77-9d85-eb1810fc3ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:45.865071 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a701bd-9ea1-4e77-9d85-eb1810fc3ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:45.865353 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a701bd-9ea1-4e77-9d85-eb1810fc3ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:45.865728 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a701bd-9ea1-4e77-9d85-eb1810fc3ac3 None admin] PATH_INFO: `/v3/projects/7f845d06024f4ea9b859e6d0dcef1534` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:45.867882 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a701bd-9ea1-4e77-9d85-eb1810fc3ac3 None admin] RBAC: Authorizing `identity:get_project(project_id=7f845d06024f4ea9b859e6d0dcef1534)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:45.869761 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a701bd-9ea1-4e77-9d85-eb1810fc3ac3 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:45.872662 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 136/270] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:14:45 2022] GET /identity/v3/projects/7f845d06024f4ea9b859e6d0dcef1534 => generated 302 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:45.874452 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c6d2c-665a-4f92-a8d6-c692820a79be None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:45.875005 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c6d2c-665a-4f92-a8d6-c692820a79be None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:45.875290 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c6d2c-665a-4f92-a8d6-c692820a79be None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:45.877331 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 137/271] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:14:45.878263 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c6d2c-665a-4f92-a8d6-c692820a79be None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:45.926158 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57448f2-7a86-4802-8185-251922bc7c24 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:45.972706 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc4102-8e19-4897-95f6-ebe480374245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:45.973673 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc4102-8e19-4897-95f6-ebe480374245 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:45.973959 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc4102-8e19-4897-95f6-ebe480374245 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:45.974586 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc4102-8e19-4897-95f6-ebe480374245 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:45.988267 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdc4102-8e19-4897-95f6-ebe480374245 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:14:45.990844 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:45.994652 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c6d2c-665a-4f92-a8d6-c692820a79be None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:45.997967 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-fcdc4102-8e19-4897-95f6-ebe480374245 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 09:14:45.997967 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:14:45.997967 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:14:45.997967 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:14:45.997967 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:14:45.997967 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:14:45.997967 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:14:45.997967 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:14:45.997967 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:14:45.997967 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:14:45.997967 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:14:45.997967 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:14:45.997967 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:14:45.997967 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:14:45.997967 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:14:45.997967 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:14:46.013340 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:14:46.013340 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:14:46.013340 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:14:46.013340 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:14:46.013340 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:14:46.013340 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:14:46.013340 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:14:46.013340 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:14:46.013340 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:14:46.013340 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:14:46.013340 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:14:46.013340 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:14:46.013340 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:14:46.013340 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:14:46.013340 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:14:46.013340 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:14:46.014156 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:14:46.014156 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:14:46.014156 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:14:46.014156 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:14:46.014156 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:14:46.014156 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:14:46.014156 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:14:46.014156 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:14:46.014156 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:14:46.014156 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:14:46.014156 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 09:14:46.014156 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:14:46.014156 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 135/272] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:14:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 09:14:46.014156 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e687b1a-ef1e-42a0-814c-e8c934b00eab None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:46.014937 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e687b1a-ef1e-42a0-814c-e8c934b00eab None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:46.014937 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e687b1a-ef1e-42a0-814c-e8c934b00eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:46.024784 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-7e687b1a-ef1e-42a0-814c-e8c934b00eab None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:46.026063 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-7e687b1a-ef1e-42a0-814c-e8c934b00eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:46.046621 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44388eb1-6f78-44ae-bf05-7bec3c7595ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:46.047635 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44388eb1-6f78-44ae-bf05-7bec3c7595ed None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:46.048113 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44388eb1-6f78-44ae-bf05-7bec3c7595ed None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:46.049044 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44388eb1-6f78-44ae-bf05-7bec3c7595ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:46.050361 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44388eb1-6f78-44ae-bf05-7bec3c7595ed None admin] RBAC: Adding query filter params (role.id=b137366eb53b42aab629a88be737eaf9, scope.project.id=7f845d06024f4ea9b859e6d0dcef1534, user.id=a59286eafc1d45ebb3e4c3279eb1ba69) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:46.050877 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44388eb1-6f78-44ae-bf05-7bec3c7595ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:46.053233 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44388eb1-6f78-44ae-bf05-7bec3c7595ed None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:46.062011 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 138/273] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Jun 27 09:14:45 2022] GET /identity/v3/role_assignments?user.id=a59286eafc1d45ebb3e4c3279eb1ba69&scope.project.id=7f845d06024f4ea9b859e6d0dcef1534&role.id=b137366eb53b42aab629a88be737eaf9 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:46.063207 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44388eb1-6f78-44ae-bf05-7bec3c7595ed None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:46.152323 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 136/274] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:14:46.198252 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e687b1a-ef1e-42a0-814c-e8c934b00eab None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:46.200917 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44388eb1-6f78-44ae-bf05-7bec3c7595ed None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:46.246973 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132d968-3eeb-4303-b625-e24875cc979a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:46.248365 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132d968-3eeb-4303-b625-e24875cc979a None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:46.248833 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132d968-3eeb-4303-b625-e24875cc979a None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:46.249314 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132d968-3eeb-4303-b625-e24875cc979a None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:46.250742 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6132d968-3eeb-4303-b625-e24875cc979a None admin] RBAC: Adding query filter params (name=member) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:46.251527 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6132d968-3eeb-4303-b625-e24875cc979a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:46.252885 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:46.253220 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6132d968-3eeb-4303-b625-e24875cc979a None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:46.264733 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 139/275] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Jun 27 09:14:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:46.266418 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e8d78-93a6-4577-ba68-2fe9cfaf6c4b None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:46.266839 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e8d78-93a6-4577-ba68-2fe9cfaf6c4b None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:46.267244 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e8d78-93a6-4577-ba68-2fe9cfaf6c4b None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:46.268893 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 140/276] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:14:46.274167 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e8d78-93a6-4577-ba68-2fe9cfaf6c4b None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:46.303398 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:46.365974 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e687b1a-ef1e-42a0-814c-e8c934b00eab None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:46.399523 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e8d78-93a6-4577-ba68-2fe9cfaf6c4b None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:46.404706 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e538aca-c1e5-4b53-9661-bfeea629c2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:46.405721 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e538aca-c1e5-4b53-9661-bfeea629c2a3 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:46.406176 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e538aca-c1e5-4b53-9661-bfeea629c2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:46.406583 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e538aca-c1e5-4b53-9661-bfeea629c2a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:46.407956 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e538aca-c1e5-4b53-9661-bfeea629c2a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:46.409650 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e538aca-c1e5-4b53-9661-bfeea629c2a3 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:46.411687 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 137/277] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:14:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:14:46.413270 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e3f59-0e7f-45e3-878b-c992a83a9c05 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:46.413971 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e3f59-0e7f-45e3-878b-c992a83a9c05 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:46.414421 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e3f59-0e7f-45e3-878b-c992a83a9c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:46.431399 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-ec2e3f59-0e7f-45e3-878b-c992a83a9c05 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:46.432631 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-ec2e3f59-0e7f-45e3-878b-c992a83a9c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:46.440351 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2384b9-788e-4a2f-8647-345e961250c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:46.441221 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2384b9-788e-4a2f-8647-345e961250c9 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:46.441495 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2384b9-788e-4a2f-8647-345e961250c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:46.441761 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2384b9-788e-4a2f-8647-345e961250c9 None admin] PATH_INFO: `/v3/users/274c0c2c9d094d55939b8618feb0a90f` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:46.457710 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2384b9-788e-4a2f-8647-345e961250c9 None admin] RBAC: Authorizing `identity:get_user(user_id=274c0c2c9d094d55939b8618feb0a90f)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:46.459648 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2384b9-788e-4a2f-8647-345e961250c9 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:46.462371 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 141/278] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Jun 27 09:14:46 2022] GET /identity/v3/users/274c0c2c9d094d55939b8618feb0a90f => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:14:46.462993 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2384b9-788e-4a2f-8647-345e961250c9 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:46.507523 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 138/279] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:14:46.508467 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e3f59-0e7f-45e3-878b-c992a83a9c05 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:46.537632 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:46.560753 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:46.581945 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2384b9-788e-4a2f-8647-345e961250c9 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:46.619110 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03e6a1a-a6f7-4cd4-8537-8c2ba2bf4996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:46.619792 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e6a1a-a6f7-4cd4-8537-8c2ba2bf4996 None admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:46.620073 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e6a1a-a6f7-4cd4-8537-8c2ba2bf4996 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:46.620376 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e6a1a-a6f7-4cd4-8537-8c2ba2bf4996 None admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:46.621113 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03e6a1a-a6f7-4cd4-8537-8c2ba2bf4996 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:46.622606 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03e6a1a-a6f7-4cd4-8537-8c2ba2bf4996 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:46.635406 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e3f59-0e7f-45e3-878b-c992a83a9c05 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:46.670848 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33dff8-203f-4078-87f3-8723c274c61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:46.671495 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33dff8-203f-4078-87f3-8723c274c61a None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:46.671843 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33dff8-203f-4078-87f3-8723c274c61a None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:46.672116 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33dff8-203f-4078-87f3-8723c274c61a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:46.672984 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33dff8-203f-4078-87f3-8723c274c61a None admin] RBAC: Adding query filter params (role.id=b1260d153ca7497eaaaa0991f053ff89, user.id=274c0c2c9d094d55939b8618feb0a90f, scope.system=all) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:46.673278 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33dff8-203f-4078-87f3-8723c274c61a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:46.674706 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33dff8-203f-4078-87f3-8723c274c61a None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:46.680467 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 139/280] 10.222.0.62 () {56 vars in 1308 bytes} [Mon Jun 27 09:14:46 2022] GET /identity/v3/role_assignments?user.id=274c0c2c9d094d55939b8618feb0a90f&scope.system=all&role.id=b1260d153ca7497eaaaa0991f053ff89 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:46.681415 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33dff8-203f-4078-87f3-8723c274c61a None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:46.732585 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 142/281] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Jun 27 09:14:46 2022] POST /identity/v3/users => generated 293 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:14:46.797915 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:46.818800 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33dff8-203f-4078-87f3-8723c274c61a None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:46.860568 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeacddfb-b3a5-4916-a575-ff74d3be7710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:46.861658 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacddfb-b3a5-4916-a575-ff74d3be7710 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:46.862128 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacddfb-b3a5-4916-a575-ff74d3be7710 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:46.862594 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacddfb-b3a5-4916-a575-ff74d3be7710 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:46.875889 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeacddfb-b3a5-4916-a575-ff74d3be7710 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:14:46.884975 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-eeacddfb-b3a5-4916-a575-ff74d3be7710 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 09:14:46.884975 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:14:46.884975 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:14:46.884975 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:14:46.884975 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:14:46.884975 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:14:46.884975 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:14:46.884975 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:14:46.884975 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:14:46.884975 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:14:46.884975 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:14:46.884975 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:14:46.884975 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:14:46.884975 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:14:46.884975 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:14:46.884975 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:14:46.886087 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:14:46.886087 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:14:46.886087 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:14:46.886087 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:14:46.886087 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:14:46.886087 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:14:46.886087 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:14:46.886087 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:14:46.886087 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:14:46.886087 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:14:46.886087 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:14:46.886087 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:14:46.886087 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:14:46.886087 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:14:46.886087 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:14:46.886087 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:14:46.887055 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:14:46.887055 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:14:46.887055 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:14:46.887055 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:14:46.887055 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:14:46.887055 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:14:46.887055 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:14:46.887055 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:14:46.887055 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:14:46.887055 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:14:46.887055 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 09:14:46.887055 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:14:46.889240 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 140/282] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:14:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:14:46.897445 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03e6a1a-a6f7-4cd4-8537-8c2ba2bf4996 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:47.014349 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03e6a1a-a6f7-4cd4-8537-8c2ba2bf4996 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:47.051087 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea260e-8ac4-4957-a155-98188792bfb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:47.051687 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea260e-8ac4-4957-a155-98188792bfb7 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:47.051967 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea260e-8ac4-4957-a155-98188792bfb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:47.052297 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea260e-8ac4-4957-a155-98188792bfb7 None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:47.053108 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea260e-8ac4-4957-a155-98188792bfb7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:47.054007 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea260e-8ac4-4957-a155-98188792bfb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:47.055402 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea260e-8ac4-4957-a155-98188792bfb7 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:47.062995 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:47.068739 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 143/283] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Jun 27 09:14:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:47.075778 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeacddfb-b3a5-4916-a575-ff74d3be7710 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:47.203830 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeacddfb-b3a5-4916-a575-ff74d3be7710 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:47.247111 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c393b0-54f2-4b30-b9ef-823ec3cdeb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:47.248101 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c393b0-54f2-4b30-b9ef-823ec3cdeb45 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:47.248415 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c393b0-54f2-4b30-b9ef-823ec3cdeb45 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:47.248691 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c393b0-54f2-4b30-b9ef-823ec3cdeb45 None admin] PATH_INFO: `/v3/users/2be9d96248164d18a6815da7ecb9c22a` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:47.249978 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c393b0-54f2-4b30-b9ef-823ec3cdeb45 None admin] RBAC: Authorizing `identity:get_user(user_id=2be9d96248164d18a6815da7ecb9c22a)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:47.251438 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c393b0-54f2-4b30-b9ef-823ec3cdeb45 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:47.253425 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 141/284] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Jun 27 09:14:47 2022] GET /identity/v3/users/2be9d96248164d18a6815da7ecb9c22a => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:47.258598 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea260e-8ac4-4957-a155-98188792bfb7 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:47.430400 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea260e-8ac4-4957-a155-98188792bfb7 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:47.479382 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bff06c-10ce-44f3-9e26-6c9791e3e21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:47.480277 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bff06c-10ce-44f3-9e26-6c9791e3e21c None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:47.480563 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bff06c-10ce-44f3-9e26-6c9791e3e21c None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:47.480840 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bff06c-10ce-44f3-9e26-6c9791e3e21c None admin] PATH_INFO: `/v3/projects/7f845d06024f4ea9b859e6d0dcef1534` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:47.482076 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bff06c-10ce-44f3-9e26-6c9791e3e21c None admin] RBAC: Authorizing `identity:get_project(project_id=7f845d06024f4ea9b859e6d0dcef1534)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:47.483529 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bff06c-10ce-44f3-9e26-6c9791e3e21c None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:47.485499 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 144/285] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:14:47 2022] GET /identity/v3/projects/7f845d06024f4ea9b859e6d0dcef1534 => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:47.490893 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c393b0-54f2-4b30-b9ef-823ec3cdeb45 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:47.510218 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:47.607531 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c393b0-54f2-4b30-b9ef-823ec3cdeb45 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:47.624001 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5485f-e5f2-49e7-8fc2-2ad754f04d32 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:47.624332 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5485f-e5f2-49e7-8fc2-2ad754f04d32 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:47.624598 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5485f-e5f2-49e7-8fc2-2ad754f04d32 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:47.626188 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 145/286] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 09:14:47.633371 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600e3a4-a355-40cf-803d-6e725ec55357 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:47.633814 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600e3a4-a355-40cf-803d-6e725ec55357 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:47.634202 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600e3a4-a355-40cf-803d-6e725ec55357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:47.658829 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-1600e3a4-a355-40cf-803d-6e725ec55357 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:47.659698 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844042b7-3179-4c3a-8f83-856d044d7ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:47.660835 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844042b7-3179-4c3a-8f83-856d044d7ab4 None admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:47.661262 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844042b7-3179-4c3a-8f83-856d044d7ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:47.661630 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844042b7-3179-4c3a-8f83-856d044d7ab4 None admin] PATH_INFO: `/v3/projects/7f845d06024f4ea9b859e6d0dcef1534/users/2be9d96248164d18a6815da7ecb9c22a/roles/90a856ad3f4b4f5db89fbf1ee0841819` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:47.664391 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-1600e3a4-a355-40cf-803d-6e725ec55357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:47.667855 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844042b7-3179-4c3a-8f83-856d044d7ab4 None admin] RBAC: Authorizing `identity:create_grant(project_id=7f845d06024f4ea9b859e6d0dcef1534, user_id=2be9d96248164d18a6815da7ecb9c22a, role_id=90a856ad3f4b4f5db89fbf1ee0841819)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:47.669628 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844042b7-3179-4c3a-8f83-856d044d7ab4 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:47.745958 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:47.754951 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 142/287] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Jun 27 09:14:47 2022] PUT /identity/v3/projects/7f845d06024f4ea9b859e6d0dcef1534/users/2be9d96248164d18a6815da7ecb9c22a/roles/90a856ad3f4b4f5db89fbf1ee0841819 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:14:47.759848 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 146/288] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 09:14:47.784643 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844042b7-3179-4c3a-8f83-856d044d7ab4 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:47.867327 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:47.915287 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844042b7-3179-4c3a-8f83-856d044d7ab4 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:47.965234 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5144ff78-02a9-4a9d-84b9-a085457312a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:47.966041 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144ff78-02a9-4a9d-84b9-a085457312a9 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:47.966326 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144ff78-02a9-4a9d-84b9-a085457312a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:47.966595 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144ff78-02a9-4a9d-84b9-a085457312a9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:47.985034 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5144ff78-02a9-4a9d-84b9-a085457312a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:14:47.997456 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-5144ff78-02a9-4a9d-84b9-a085457312a9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 09:14:47.997456 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:14:47.997456 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:14:47.997456 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:14:47.997456 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:14:47.997456 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:14:47.997456 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:14:47.997456 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:14:47.997456 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:14:47.997456 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:14:47.997456 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:14:47.997456 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:14:47.997456 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:14:47.997456 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:14:47.997456 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:14:47.997456 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:14:47.999575 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:14:47.999575 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:14:47.999575 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:14:47.999575 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:14:47.999575 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:14:47.999575 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:14:47.999575 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:14:47.999575 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:14:47.999575 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:14:47.999575 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:14:47.999575 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:14:47.999575 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:14:47.999575 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:14:47.999575 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:14:47.999575 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:14:47.999575 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:14:48.001528 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:14:48.001528 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:14:48.001528 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:14:48.001528 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:14:48.001528 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:14:48.001528 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:14:48.001528 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:14:48.001528 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:14:48.001528 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:14:48.001528 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:14:48.001528 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 09:14:48.001528 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:14:48.001528 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 143/289] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:14:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:14:48.004779 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600e3a4-a355-40cf-803d-6e725ec55357 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:48.140186 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600e3a4-a355-40cf-803d-6e725ec55357 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:48.179998 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a3548-f956-4bde-909f-f32b8459a619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:48.180767 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a3548-f956-4bde-909f-f32b8459a619 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:48.181056 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a3548-f956-4bde-909f-f32b8459a619 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:48.181330 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a3548-f956-4bde-909f-f32b8459a619 None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:48.182084 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a3548-f956-4bde-909f-f32b8459a619 None admin] RBAC: Adding query filter params (name=member) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:48.182396 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a3548-f956-4bde-909f-f32b8459a619 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:48.183785 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a3548-f956-4bde-909f-f32b8459a619 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:48.192919 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 147/290] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Jun 27 09:14:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:48.198915 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5144ff78-02a9-4a9d-84b9-a085457312a9 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:48.323845 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5144ff78-02a9-4a9d-84b9-a085457312a9 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:48.355558 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:48.367756 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b88468b-359a-4db2-98ce-f42e3f4fb727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:48.368670 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88468b-359a-4db2-98ce-f42e3f4fb727 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:48.368957 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88468b-359a-4db2-98ce-f42e3f4fb727 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:48.369788 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88468b-359a-4db2-98ce-f42e3f4fb727 None admin] PATH_INFO: `/v3/users/320c8ba2b86747de96bf56f4aec52e84` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:48.370534 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b88468b-359a-4db2-98ce-f42e3f4fb727 None admin] RBAC: Authorizing `identity:get_user(user_id=320c8ba2b86747de96bf56f4aec52e84)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:48.372004 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b88468b-359a-4db2-98ce-f42e3f4fb727 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:48.374124 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 144/291] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Jun 27 09:14:48 2022] GET /identity/v3/users/320c8ba2b86747de96bf56f4aec52e84 => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:48.379358 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a3548-f956-4bde-909f-f32b8459a619 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:48.448608 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:48.499259 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a3548-f956-4bde-909f-f32b8459a619 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:48.549290 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1d497-aecd-4236-a22c-31a3c41d62ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:48.549961 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1d497-aecd-4236-a22c-31a3c41d62ac None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:48.550247 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1d497-aecd-4236-a22c-31a3c41d62ac None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:48.550525 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1d497-aecd-4236-a22c-31a3c41d62ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:48.654799 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf1d497-aecd-4236-a22c-31a3c41d62ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:48.656214 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf1d497-aecd-4236-a22c-31a3c41d62ac None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:48.732588 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:48.782911 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 148/292] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:14:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 09:14:48.788456 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b88468b-359a-4db2-98ce-f42e3f4fb727 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:48.894439 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b88468b-359a-4db2-98ce-f42e3f4fb727 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:48.939797 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607182bc-5836-47a2-b827-badd0c66bd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:48.940620 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607182bc-5836-47a2-b827-badd0c66bd89 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:48.940905 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607182bc-5836-47a2-b827-badd0c66bd89 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:48.941182 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607182bc-5836-47a2-b827-badd0c66bd89 None admin] PATH_INFO: `/v3/projects/7f845d06024f4ea9b859e6d0dcef1534` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:48.942399 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607182bc-5836-47a2-b827-badd0c66bd89 None admin] RBAC: Authorizing `identity:get_project(project_id=7f845d06024f4ea9b859e6d0dcef1534)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:48.944431 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607182bc-5836-47a2-b827-badd0c66bd89 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:48.946473 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 145/293] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:14:48 2022] GET /identity/v3/projects/7f845d06024f4ea9b859e6d0dcef1534 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:48.952009 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1d497-aecd-4236-a22c-31a3c41d62ac None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:49.033835 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581c992-0d71-4405-967a-5b8bf4d94d9a None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:49.034147 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581c992-0d71-4405-967a-5b8bf4d94d9a None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:49.034381 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581c992-0d71-4405-967a-5b8bf4d94d9a None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:49.036020 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 146/294] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:14:49.042271 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf6671-755c-4ac8-ada2-7d5a59d9bd11 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:49.042554 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf6671-755c-4ac8-ada2-7d5a59d9bd11 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:49.042826 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf6671-755c-4ac8-ada2-7d5a59d9bd11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:49.063123 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-31bf6671-755c-4ac8-ada2-7d5a59d9bd11 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:49.064400 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-31bf6671-755c-4ac8-ada2-7d5a59d9bd11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:49.108832 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1d497-aecd-4236-a22c-31a3c41d62ac None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:49.167600 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:49.180019 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 147/295] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 09:14:49.198609 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88bad3e-1273-4bb3-b2be-1f87f131509f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:49.198609 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88bad3e-1273-4bb3-b2be-1f87f131509f None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:49.198609 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88bad3e-1273-4bb3-b2be-1f87f131509f None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:49.198609 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88bad3e-1273-4bb3-b2be-1f87f131509f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:49.199003 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88bad3e-1273-4bb3-b2be-1f87f131509f None admin] RBAC: Adding query filter params (role.id=b1260d153ca7497eaaaa0991f053ff89, scope.project.id=7f845d06024f4ea9b859e6d0dcef1534, user.id=320c8ba2b86747de96bf56f4aec52e84) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:49.199003 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88bad3e-1273-4bb3-b2be-1f87f131509f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:49.199003 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88bad3e-1273-4bb3-b2be-1f87f131509f None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:49.204728 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 149/296] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Jun 27 09:14:48 2022] GET /identity/v3/role_assignments?user.id=320c8ba2b86747de96bf56f4aec52e84&scope.project.id=7f845d06024f4ea9b859e6d0dcef1534&role.id=b1260d153ca7497eaaaa0991f053ff89 => generated 608 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:49.239588 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf6671-755c-4ac8-ada2-7d5a59d9bd11 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:49.372417 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf6671-755c-4ac8-ada2-7d5a59d9bd11 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:49.411798 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ff260-93c1-4ca1-ba5b-a877b2bef529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:49.413287 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ff260-93c1-4ca1-ba5b-a877b2bef529 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:49.413569 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ff260-93c1-4ca1-ba5b-a877b2bef529 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:49.413837 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ff260-93c1-4ca1-ba5b-a877b2bef529 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:49.435677 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ff260-93c1-4ca1-ba5b-a877b2bef529 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:14:49.443744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-c94ff260-93c1-4ca1-ba5b-a877b2bef529 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 09:14:49.443744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:14:49.443744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:14:49.443744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:14:49.443744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:14:49.443744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:14:49.443744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:14:49.443744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:14:49.443744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:14:49.443744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:14:49.443744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:14:49.443744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:14:49.443744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:14:49.443744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:14:49.443744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:14:49.443744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:14:49.444668 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:14:49.444668 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:14:49.444668 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:14:49.444668 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:14:49.444668 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:14:49.444668 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:14:49.444668 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:14:49.444668 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:14:49.444668 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:14:49.444668 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:14:49.444668 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:14:49.444668 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:14:49.444668 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:14:49.444668 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:14:49.444668 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:14:49.444668 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:14:49.445459 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:14:49.445459 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:14:49.445459 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:14:49.445459 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:14:49.445459 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:14:49.445459 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:14:49.445459 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:14:49.445459 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:14:49.445459 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:14:49.445459 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:14:49.445459 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 09:14:49.445459 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:14:49.445459 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 148/297] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:14:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:14:49.451245 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88bad3e-1273-4bb3-b2be-1f87f131509f None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:49.484689 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:49.551058 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f362ae-9ed9-44c9-8256-444d18ae3a00 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:49.551403 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f362ae-9ed9-44c9-8256-444d18ae3a00 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:49.551612 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f362ae-9ed9-44c9-8256-444d18ae3a00 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:49.553955 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 149/298] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:14:49.561645 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021f60c-e578-4584-8f9d-f91504c87de5 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:49.561933 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021f60c-e578-4584-8f9d-f91504c87de5 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:49.562213 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021f60c-e578-4584-8f9d-f91504c87de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:49.566980 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88bad3e-1273-4bb3-b2be-1f87f131509f None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:49.582862 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-5021f60c-e578-4584-8f9d-f91504c87de5 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:49.584064 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-5021f60c-e578-4584-8f9d-f91504c87de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:49.613141 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b085793-0da5-4a9d-b6d8-3432b0238143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:49.614086 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b085793-0da5-4a9d-b6d8-3432b0238143 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:49.614383 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b085793-0da5-4a9d-b6d8-3432b0238143 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:49.614663 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b085793-0da5-4a9d-b6d8-3432b0238143 None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:49.616277 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b085793-0da5-4a9d-b6d8-3432b0238143 None admin] RBAC: Adding query filter params (name=member) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:49.617024 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b085793-0da5-4a9d-b6d8-3432b0238143 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:49.618675 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b085793-0da5-4a9d-b6d8-3432b0238143 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:49.633957 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 150/299] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Jun 27 09:14:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:49.639991 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b085793-0da5-4a9d-b6d8-3432b0238143 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:49.657004 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:49.676843 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 150/300] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:14:49.703458 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f1416-4e9e-4859-8f96-3dfb7ed83639 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:49.703741 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f1416-4e9e-4859-8f96-3dfb7ed83639 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:49.703936 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f1416-4e9e-4859-8f96-3dfb7ed83639 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:49.705839 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 151/301] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 09:14:49.706885 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f1416-4e9e-4859-8f96-3dfb7ed83639 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:49.739311 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:49.754808 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b085793-0da5-4a9d-b6d8-3432b0238143 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:49.793790 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f8183-462d-4672-99de-4372e593eb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:49.794661 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f8183-462d-4672-99de-4372e593eb50 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:49.795353 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f8183-462d-4672-99de-4372e593eb50 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:49.795629 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f8183-462d-4672-99de-4372e593eb50 None admin] PATH_INFO: `/v3/users/274c0c2c9d094d55939b8618feb0a90f` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:49.797204 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876f8183-462d-4672-99de-4372e593eb50 None admin] RBAC: Authorizing `identity:get_user(user_id=274c0c2c9d094d55939b8618feb0a90f)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:49.799064 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876f8183-462d-4672-99de-4372e593eb50 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:49.801000 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 151/302] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Jun 27 09:14:49 2022] GET /identity/v3/users/274c0c2c9d094d55939b8618feb0a90f => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:49.802175 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefeceb-32eb-4a14-b260-52440b79b12f None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:49.802456 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefeceb-32eb-4a14-b260-52440b79b12f None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:49.802728 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefeceb-32eb-4a14-b260-52440b79b12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:49.819348 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-6aefeceb-32eb-4a14-b260-52440b79b12f None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:49.820549 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-6aefeceb-32eb-4a14-b260-52440b79b12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:49.826736 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f1416-4e9e-4859-8f96-3dfb7ed83639 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:49.864603 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7314bd83-c37a-4054-8fb7-fe1ee8b0ce1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:49.865404 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314bd83-c37a-4054-8fb7-fe1ee8b0ce1f None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:49.865743 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314bd83-c37a-4054-8fb7-fe1ee8b0ce1f None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:49.866020 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314bd83-c37a-4054-8fb7-fe1ee8b0ce1f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:49.879312 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7314bd83-c37a-4054-8fb7-fe1ee8b0ce1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:14:49.887250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-7314bd83-c37a-4054-8fb7-fe1ee8b0ce1f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 09:14:49.887250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:14:49.887250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:14:49.887250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:14:49.887250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:14:49.887250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:14:49.887250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:14:49.887250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:14:49.887250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:14:49.887250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:14:49.887250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:14:49.887250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:14:49.887250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:14:49.887250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:14:49.887250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:14:49.887250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:14:49.889021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:14:49.889021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:14:49.889021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:14:49.889021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:14:49.889021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:14:49.889021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:14:49.889021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:14:49.889021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:14:49.889021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:14:49.889021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:14:49.889021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:14:49.889021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:14:49.889021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:14:49.889021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:14:49.889021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:14:49.889021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:14:49.890604 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:14:49.890604 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:14:49.890604 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:14:49.890604 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:14:49.890604 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:14:49.890604 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:14:49.890604 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:14:49.890604 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:14:49.890604 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:14:49.890604 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:14:49.890604 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 09:14:49.890604 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:14:49.890604 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 152/303] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:14:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:14:49.890604 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7314bd83-c37a-4054-8fb7-fe1ee8b0ce1f None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:49.900045 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 152/304] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:14:49.900800 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aefeceb-32eb-4a14-b260-52440b79b12f None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:49.967015 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:49.994084 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:50.013437 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aefeceb-32eb-4a14-b260-52440b79b12f None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:50.023530 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7314bd83-c37a-4054-8fb7-fe1ee8b0ce1f None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:50.052120 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a837a-4b38-4bba-85cc-c961a56bbedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:50.052818 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a837a-4b38-4bba-85cc-c961a56bbedd None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:50.053127 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a837a-4b38-4bba-85cc-c961a56bbedd None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:50.053405 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a837a-4b38-4bba-85cc-c961a56bbedd None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:50.054152 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a837a-4b38-4bba-85cc-c961a56bbedd None admin] RBAC: Adding query filter params (name=reader) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:50.054456 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a837a-4b38-4bba-85cc-c961a56bbedd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:50.055831 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a837a-4b38-4bba-85cc-c961a56bbedd None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:50.062009 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b64754-3966-4dd9-9679-1ade6e9bd99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:50.063238 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b64754-3966-4dd9-9679-1ade6e9bd99c None admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:50.063533 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b64754-3966-4dd9-9679-1ade6e9bd99c None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:50.063790 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b64754-3966-4dd9-9679-1ade6e9bd99c None admin] PATH_INFO: `/v3/system/users/274c0c2c9d094d55939b8618feb0a90f/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:50.065341 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b64754-3966-4dd9-9679-1ade6e9bd99c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=274c0c2c9d094d55939b8618feb0a90f, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:50.066801 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b64754-3966-4dd9-9679-1ade6e9bd99c None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:50.068456 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 153/305] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Jun 27 09:14:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:50.071590 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a837a-4b38-4bba-85cc-c961a56bbedd None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:50.159563 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 153/306] 10.222.0.62 () {58 vars in 1334 bytes} [Mon Jun 27 09:14:49 2022] PUT /identity/v3/system/users/274c0c2c9d094d55939b8618feb0a90f/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:14:50.160766 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b64754-3966-4dd9-9679-1ade6e9bd99c None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:50.184004 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a837a-4b38-4bba-85cc-c961a56bbedd None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:50.229746 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ac196-932d-420d-ab27-b9ad4a9ac46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:50.230898 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ac196-932d-420d-ab27-b9ad4a9ac46c None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:50.231345 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ac196-932d-420d-ab27-b9ad4a9ac46c None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:50.231765 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ac196-932d-420d-ab27-b9ad4a9ac46c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:50.233328 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724ac196-932d-420d-ab27-b9ad4a9ac46c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:50.235198 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724ac196-932d-420d-ab27-b9ad4a9ac46c None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:50.242384 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 154/307] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:14:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:50.243771 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ac196-932d-420d-ab27-b9ad4a9ac46c None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:50.263741 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:50.319712 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b64754-3966-4dd9-9679-1ade6e9bd99c None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:50.337924 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:50.364799 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d297dd3-fe23-4f94-80af-6c23cc1babc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:50.365867 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ac196-932d-420d-ab27-b9ad4a9ac46c None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:50.366322 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d297dd3-fe23-4f94-80af-6c23cc1babc0 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:50.366823 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d297dd3-fe23-4f94-80af-6c23cc1babc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:50.367285 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d297dd3-fe23-4f94-80af-6c23cc1babc0 None admin] PATH_INFO: `/v3/users/df2ae689d8a9485e91bbd47ca8ae1336` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:50.386620 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d297dd3-fe23-4f94-80af-6c23cc1babc0 None admin] RBAC: Authorizing `identity:get_user(user_id=df2ae689d8a9485e91bbd47ca8ae1336)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:50.388700 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d297dd3-fe23-4f94-80af-6c23cc1babc0 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:50.391781 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 154/308] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Jun 27 09:14:50 2022] GET /identity/v3/users/df2ae689d8a9485e91bbd47ca8ae1336 => generated 293 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:50.398201 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d297dd3-fe23-4f94-80af-6c23cc1babc0 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:50.415410 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa623d-fb33-44a0-b766-eccea3afcf64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:50.417072 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa623d-fb33-44a0-b766-eccea3afcf64 None admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:50.417838 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa623d-fb33-44a0-b766-eccea3afcf64 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:50.418427 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa623d-fb33-44a0-b766-eccea3afcf64 None admin] PATH_INFO: `/v3/groups` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:50.419335 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aa623d-fb33-44a0-b766-eccea3afcf64 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:50.421099 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aa623d-fb33-44a0-b766-eccea3afcf64 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:50.498661 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 155/309] 10.222.0.62 () {60 vars in 1134 bytes} [Mon Jun 27 09:14:50 2022] POST /identity/v3/groups => generated 229 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:14:50.500039 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f262c-f54b-4a13-a24a-881cf9b1a639 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:50.500367 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f262c-f54b-4a13-a24a-881cf9b1a639 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:50.500863 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f262c-f54b-4a13-a24a-881cf9b1a639 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:50.502245 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 156/310] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:14:50.508969 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015fb3bf-8d05-4063-b0b8-9d3680cfd606 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:50.509190 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015fb3bf-8d05-4063-b0b8-9d3680cfd606 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:50.509410 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015fb3bf-8d05-4063-b0b8-9d3680cfd606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:50.527676 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d297dd3-fe23-4f94-80af-6c23cc1babc0 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:50.528133 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-015fb3bf-8d05-4063-b0b8-9d3680cfd606 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:50.529347 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-015fb3bf-8d05-4063-b0b8-9d3680cfd606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:50.585753 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9340c-fc59-424f-9c20-70b5633f65a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:50.587372 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9340c-fc59-424f-9c20-70b5633f65a9 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:50.588157 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9340c-fc59-424f-9c20-70b5633f65a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:50.588694 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9340c-fc59-424f-9c20-70b5633f65a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:50.590070 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e9340c-fc59-424f-9c20-70b5633f65a9 None admin] RBAC: Adding query filter params (role.id=90a856ad3f4b4f5db89fbf1ee0841819, user.id=df2ae689d8a9485e91bbd47ca8ae1336, scope.system=all) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:50.591073 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e9340c-fc59-424f-9c20-70b5633f65a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:50.593015 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e9340c-fc59-424f-9c20-70b5633f65a9 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:50.608797 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 155/311] 10.222.0.62 () {56 vars in 1308 bytes} [Mon Jun 27 09:14:50 2022] GET /identity/v3/role_assignments?user.id=df2ae689d8a9485e91bbd47ca8ae1336&scope.system=all&role.id=90a856ad3f4b4f5db89fbf1ee0841819 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:14:50.621543 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 157/312] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 09:14:50.649892 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9340c-fc59-424f-9c20-70b5633f65a9 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:50.691266 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:50.769707 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9340c-fc59-424f-9c20-70b5633f65a9 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:50.807395 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec0c4c-3aaf-42f8-95c7-1b094f066f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:50.808230 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec0c4c-3aaf-42f8-95c7-1b094f066f3a None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:50.808501 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec0c4c-3aaf-42f8-95c7-1b094f066f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:50.808779 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec0c4c-3aaf-42f8-95c7-1b094f066f3a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:50.819681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec0c4c-3aaf-42f8-95c7-1b094f066f3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:14:50.827517 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-faec0c4c-3aaf-42f8-95c7-1b094f066f3a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 09:14:50.827517 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:14:50.827517 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:14:50.827517 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:14:50.827517 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:14:50.827517 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:14:50.827517 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:14:50.827517 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:14:50.827517 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:14:50.827517 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:14:50.827517 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:14:50.827517 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:14:50.827517 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:14:50.827517 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:14:50.827517 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:14:50.827517 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:14:50.828469 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:14:50.828469 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:14:50.828469 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:14:50.828469 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:14:50.828469 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:14:50.828469 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:14:50.828469 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:14:50.828469 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:14:50.828469 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:14:50.828469 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:14:50.828469 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:14:50.828469 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:14:50.828469 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:14:50.828469 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:14:50.828469 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:14:50.828469 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:14:50.829238 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:14:50.829238 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:14:50.829238 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:14:50.829238 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:14:50.829238 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:14:50.829238 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:14:50.829238 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:14:50.829238 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:14:50.829238 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:14:50.829238 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:14:50.829238 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 09:14:50.829238 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:14:50.829238 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 156/313] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:14:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:14:50.834695 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015fb3bf-8d05-4063-b0b8-9d3680cfd606 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:50.838063 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:50.945041 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015fb3bf-8d05-4063-b0b8-9d3680cfd606 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:50.981872 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d15992-485f-42cd-bf04-d98ea1f001fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:50.982547 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d15992-485f-42cd-bf04-d98ea1f001fc None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:50.982830 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d15992-485f-42cd-bf04-d98ea1f001fc None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:50.983102 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d15992-485f-42cd-bf04-d98ea1f001fc None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:50.983853 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d15992-485f-42cd-bf04-d98ea1f001fc None admin] RBAC: Adding query filter params (name=reader) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:50.984160 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d15992-485f-42cd-bf04-d98ea1f001fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:50.985572 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d15992-485f-42cd-bf04-d98ea1f001fc None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:50.995606 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 158/314] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Jun 27 09:14:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:14:51.001292 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec0c4c-3aaf-42f8-95c7-1b094f066f3a None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:51.113362 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:51.123253 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec0c4c-3aaf-42f8-95c7-1b094f066f3a None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:51.159736 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5dc38-47fd-46ab-a447-ce3885dcfe06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:51.160777 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5dc38-47fd-46ab-a447-ce3885dcfe06 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:51.161060 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5dc38-47fd-46ab-a447-ce3885dcfe06 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:51.161334 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5dc38-47fd-46ab-a447-ce3885dcfe06 None admin] PATH_INFO: `/v3/users/2be9d96248164d18a6815da7ecb9c22a` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:51.163086 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf5dc38-47fd-46ab-a447-ce3885dcfe06 None admin] RBAC: Authorizing `identity:get_user(user_id=2be9d96248164d18a6815da7ecb9c22a)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:51.164566 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf5dc38-47fd-46ab-a447-ce3885dcfe06 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:51.166511 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 157/315] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Jun 27 09:14:51 2022] GET /identity/v3/users/2be9d96248164d18a6815da7ecb9c22a => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:51.171937 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d15992-485f-42cd-bf04-d98ea1f001fc None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:51.240703 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:51.276720 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d15992-485f-42cd-bf04-d98ea1f001fc None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:51.317052 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f7e46a-34cb-4e05-8681-2b3ad1888318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:51.317730 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f7e46a-34cb-4e05-8681-2b3ad1888318 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:51.318020 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f7e46a-34cb-4e05-8681-2b3ad1888318 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:51.318299 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f7e46a-34cb-4e05-8681-2b3ad1888318 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:51.391957 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f7e46a-34cb-4e05-8681-2b3ad1888318 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:51.393390 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f7e46a-34cb-4e05-8681-2b3ad1888318 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:51.459798 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:51.495310 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 159/316] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:14:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 09:14:51.500939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5dc38-47fd-46ab-a447-ce3885dcfe06 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:51.608690 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5dc38-47fd-46ab-a447-ce3885dcfe06 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:51.645508 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b0899-e62a-452a-bc54-6e40937dbb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:51.646297 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b0899-e62a-452a-bc54-6e40937dbb5b None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:51.646579 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b0899-e62a-452a-bc54-6e40937dbb5b None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:51.647431 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b0899-e62a-452a-bc54-6e40937dbb5b None admin] PATH_INFO: `/v3/projects/7f845d06024f4ea9b859e6d0dcef1534` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:51.648677 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b0899-e62a-452a-bc54-6e40937dbb5b None admin] RBAC: Authorizing `identity:get_project(project_id=7f845d06024f4ea9b859e6d0dcef1534)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:51.650193 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b0899-e62a-452a-bc54-6e40937dbb5b None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:51.652280 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 158/317] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:14:51 2022] GET /identity/v3/projects/7f845d06024f4ea9b859e6d0dcef1534 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:51.658191 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f7e46a-34cb-4e05-8681-2b3ad1888318 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:51.763006 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f7e46a-34cb-4e05-8681-2b3ad1888318 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:51.798660 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d6081-a9fb-43f1-b3c6-94a9a68d8be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:51.799317 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d6081-a9fb-43f1-b3c6-94a9a68d8be0 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:51.799600 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d6081-a9fb-43f1-b3c6-94a9a68d8be0 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:51.799875 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d6081-a9fb-43f1-b3c6-94a9a68d8be0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:51.800745 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d6081-a9fb-43f1-b3c6-94a9a68d8be0 None admin] RBAC: Adding query filter params (role.id=90a856ad3f4b4f5db89fbf1ee0841819, scope.project.id=7f845d06024f4ea9b859e6d0dcef1534, user.id=2be9d96248164d18a6815da7ecb9c22a) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:51.801057 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d6081-a9fb-43f1-b3c6-94a9a68d8be0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:51.802506 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d6081-a9fb-43f1-b3c6-94a9a68d8be0 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:51.813371 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 160/318] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Jun 27 09:14:51 2022] GET /identity/v3/role_assignments?user.id=2be9d96248164d18a6815da7ecb9c22a&scope.project.id=7f845d06024f4ea9b859e6d0dcef1534&role.id=90a856ad3f4b4f5db89fbf1ee0841819 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:52.257640 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827461c-d1fc-4637-86e1-340f135c7a64 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:52.258002 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827461c-d1fc-4637-86e1-340f135c7a64 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:52.258177 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827461c-d1fc-4637-86e1-340f135c7a64 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:52.259720 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 159/319] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:14:52.264803 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c60a3-9533-4fbf-8082-8efa50066b3a None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:52.265253 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c60a3-9533-4fbf-8082-8efa50066b3a None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:52.265436 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c60a3-9533-4fbf-8082-8efa50066b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:52.283435 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-9c5c60a3-9533-4fbf-8082-8efa50066b3a None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:52.284669 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-9c5c60a3-9533-4fbf-8082-8efa50066b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:52.310633 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:52.356815 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 161/320] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:14:52.380372 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827461c-d1fc-4637-86e1-340f135c7a64 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:52.411977 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:52.485803 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827461c-d1fc-4637-86e1-340f135c7a64 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:52.520947 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4827bf-0f88-48c9-ac70-feecdb570a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:52.521883 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4827bf-0f88-48c9-ac70-feecdb570a65 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:52.522054 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4827bf-0f88-48c9-ac70-feecdb570a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:52.522310 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4827bf-0f88-48c9-ac70-feecdb570a65 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:52.533162 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4827bf-0f88-48c9-ac70-feecdb570a65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:14:52.541405 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-5c4827bf-0f88-48c9-ac70-feecdb570a65 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 09:14:52.541405 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:14:52.541405 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:14:52.541405 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:14:52.541405 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:14:52.541405 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:14:52.541405 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:14:52.541405 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:14:52.541405 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:14:52.541405 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:14:52.541405 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:14:52.541405 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:14:52.541405 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:14:52.541405 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:14:52.541405 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:14:52.541405 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:14:52.542394 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:14:52.542394 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:14:52.542394 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:14:52.542394 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:14:52.542394 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:14:52.542394 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:14:52.542394 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:14:52.542394 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:14:52.542394 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:14:52.542394 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:14:52.542394 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:14:52.542394 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:14:52.542394 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:14:52.542394 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:14:52.542394 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:14:52.542394 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:14:52.543409 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:14:52.543409 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:14:52.543409 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:14:52.543409 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:14:52.543409 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:14:52.543409 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:14:52.543409 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:14:52.543409 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:14:52.543409 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:14:52.543409 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:14:52.543409 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 09:14:52.543409 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:14:52.543409 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 160/321] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:14:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:14:52.548428 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c60a3-9533-4fbf-8082-8efa50066b3a None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:52.646107 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ae924-2f3a-4421-95f8-30119c17d1f5 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:52.646400 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ae924-2f3a-4421-95f8-30119c17d1f5 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:52.647116 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ae924-2f3a-4421-95f8-30119c17d1f5 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:52.649303 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 161/322] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 09:14:52.655181 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262975e-4457-468c-bdc2-f896afde5d9a None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:52.655465 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262975e-4457-468c-bdc2-f896afde5d9a None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:52.655743 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262975e-4457-468c-bdc2-f896afde5d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:52.659076 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c60a3-9533-4fbf-8082-8efa50066b3a None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:52.673578 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-8262975e-4457-468c-bdc2-f896afde5d9a None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:52.674749 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-8262975e-4457-468c-bdc2-f896afde5d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:52.696761 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf4f11-f1ad-4e10-a05b-cb710f2aec11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:52.697847 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf4f11-f1ad-4e10-a05b-cb710f2aec11 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:52.698360 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf4f11-f1ad-4e10-a05b-cb710f2aec11 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:52.698855 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf4f11-f1ad-4e10-a05b-cb710f2aec11 None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:52.699966 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bf4f11-f1ad-4e10-a05b-cb710f2aec11 None admin] RBAC: Adding query filter params (name=member) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:52.700403 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bf4f11-f1ad-4e10-a05b-cb710f2aec11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:52.702025 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bf4f11-f1ad-4e10-a05b-cb710f2aec11 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:52.711994 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 162/323] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Jun 27 09:14:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:14:52.717467 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf4f11-f1ad-4e10-a05b-cb710f2aec11 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:52.744264 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:52.748333 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 162/324] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 09:14:52.768393 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85dacf-3600-4cfd-b7d8-72be2ca0bcd5 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:52.768696 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85dacf-3600-4cfd-b7d8-72be2ca0bcd5 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:52.768959 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85dacf-3600-4cfd-b7d8-72be2ca0bcd5 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:52.770397 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 163/325] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 09:14:52.771268 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa85dacf-3600-4cfd-b7d8-72be2ca0bcd5 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:52.794684 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:52.820697 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf4f11-f1ad-4e10-a05b-cb710f2aec11 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:52.855741 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c54ae-8c68-4b1a-b56e-b04b6e06e90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:52.856638 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c54ae-8c68-4b1a-b56e-b04b6e06e90e None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:52.856913 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c54ae-8c68-4b1a-b56e-b04b6e06e90e None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:52.857187 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c54ae-8c68-4b1a-b56e-b04b6e06e90e None admin] PATH_INFO: `/v3/users/274c0c2c9d094d55939b8618feb0a90f` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:52.858367 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c54ae-8c68-4b1a-b56e-b04b6e06e90e None admin] RBAC: Authorizing `identity:get_user(user_id=274c0c2c9d094d55939b8618feb0a90f)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:52.859815 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c54ae-8c68-4b1a-b56e-b04b6e06e90e None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:52.861486 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 163/326] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Jun 27 09:14:52 2022] GET /identity/v3/users/274c0c2c9d094d55939b8618feb0a90f => generated 293 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:14:52.862699 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3e3f3-91f4-41bf-bdd0-2044da7324db None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:52.862986 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3e3f3-91f4-41bf-bdd0-2044da7324db None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:52.863258 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3e3f3-91f4-41bf-bdd0-2044da7324db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:52.877587 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa85dacf-3600-4cfd-b7d8-72be2ca0bcd5 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:52.880762 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-c7b3e3f3-91f4-41bf-bdd0-2044da7324db None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:52.882003 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-c7b3e3f3-91f4-41bf-bdd0-2044da7324db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:52.915260 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807c2c9-08c0-4de7-aae1-5156cd5bcfe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:52.915967 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807c2c9-08c0-4de7-aae1-5156cd5bcfe4 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:52.916273 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807c2c9-08c0-4de7-aae1-5156cd5bcfe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:52.916552 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807c2c9-08c0-4de7-aae1-5156cd5bcfe4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:52.917724 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9807c2c9-08c0-4de7-aae1-5156cd5bcfe4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:52.919353 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9807c2c9-08c0-4de7-aae1-5156cd5bcfe4 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:52.921012 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 164/327] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:14:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:52.921796 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807c2c9-08c0-4de7-aae1-5156cd5bcfe4 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:52.953876 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 164/328] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:14:52.954715 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3e3f3-91f4-41bf-bdd0-2044da7324db None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:52.982971 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:53.012144 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:53.024939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807c2c9-08c0-4de7-aae1-5156cd5bcfe4 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:53.058258 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d44347-5764-4a1e-aeac-e51ea9743aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:53.058902 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d44347-5764-4a1e-aeac-e51ea9743aff None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:53.059178 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d44347-5764-4a1e-aeac-e51ea9743aff None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:53.059450 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d44347-5764-4a1e-aeac-e51ea9743aff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:53.060298 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d44347-5764-4a1e-aeac-e51ea9743aff None admin] RBAC: Adding query filter params (role.id=b1260d153ca7497eaaaa0991f053ff89, user.id=274c0c2c9d094d55939b8618feb0a90f, scope.system=all) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:53.060604 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d44347-5764-4a1e-aeac-e51ea9743aff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:53.061286 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3e3f3-91f4-41bf-bdd0-2044da7324db None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:53.062039 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d44347-5764-4a1e-aeac-e51ea9743aff None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:53.074240 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 165/329] 10.222.0.62 () {56 vars in 1308 bytes} [Mon Jun 27 09:14:52 2022] GET /identity/v3/role_assignments?user.id=274c0c2c9d094d55939b8618feb0a90f&scope.system=all&role.id=b1260d153ca7497eaaaa0991f053ff89 => generated 510 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:53.075039 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d44347-5764-4a1e-aeac-e51ea9743aff None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:53.100097 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5fcde-b118-46a2-9ada-7a73fb7ecba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:53.100892 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5fcde-b118-46a2-9ada-7a73fb7ecba9 None admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:53.101204 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5fcde-b118-46a2-9ada-7a73fb7ecba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:53.101474 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5fcde-b118-46a2-9ada-7a73fb7ecba9 None admin] PATH_INFO: `/v3/groups` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:53.104638 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d5fcde-b118-46a2-9ada-7a73fb7ecba9 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:53.104638 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d5fcde-b118-46a2-9ada-7a73fb7ecba9 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:53.194081 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d44347-5764-4a1e-aeac-e51ea9743aff None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:53.201877 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 165/330] 10.222.0.62 () {60 vars in 1134 bytes} [Mon Jun 27 09:14:52 2022] POST /identity/v3/groups => generated 226 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:14:53.237794 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24162b76-34da-4864-a104-7adf46f05cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:53.238037 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24162b76-34da-4864-a104-7adf46f05cfb None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:53.238282 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24162b76-34da-4864-a104-7adf46f05cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:53.238628 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24162b76-34da-4864-a104-7adf46f05cfb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:53.250846 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24162b76-34da-4864-a104-7adf46f05cfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:14:53.259506 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-24162b76-34da-4864-a104-7adf46f05cfb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 09:14:53.259506 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:14:53.259506 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:14:53.259506 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:14:53.259506 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:14:53.259506 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:14:53.259506 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:14:53.259506 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:14:53.259506 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:14:53.259506 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:14:53.259506 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:14:53.259506 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:14:53.259506 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:14:53.259506 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:14:53.259506 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:14:53.259506 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:14:53.261639 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:14:53.261639 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:14:53.261639 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:14:53.261639 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:14:53.261639 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:14:53.261639 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:14:53.261639 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:14:53.261639 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:14:53.261639 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:14:53.261639 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:14:53.261639 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:14:53.261639 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:14:53.261639 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:14:53.261639 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:14:53.261639 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:14:53.261639 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:14:53.262652 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:14:53.262652 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:14:53.262652 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:14:53.262652 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:14:53.262652 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:14:53.262652 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:14:53.262652 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:14:53.262652 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:14:53.262652 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:14:53.262652 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:14:53.262652 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 09:14:53.262652 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:14:53.262652 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 166/331] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:14:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:14:53.269864 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5fcde-b118-46a2-9ada-7a73fb7ecba9 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:53.365488 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:53.388136 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5fcde-b118-46a2-9ada-7a73fb7ecba9 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:53.424056 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21880b8-bc9c-4b2e-9e7c-a67b24e40d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:53.424787 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21880b8-bc9c-4b2e-9e7c-a67b24e40d65 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:53.425073 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21880b8-bc9c-4b2e-9e7c-a67b24e40d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:53.425355 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21880b8-bc9c-4b2e-9e7c-a67b24e40d65 None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:53.426109 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21880b8-bc9c-4b2e-9e7c-a67b24e40d65 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:53.426418 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21880b8-bc9c-4b2e-9e7c-a67b24e40d65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:53.428427 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21880b8-bc9c-4b2e-9e7c-a67b24e40d65 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:53.437120 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 166/332] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Jun 27 09:14:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:53.443116 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24162b76-34da-4864-a104-7adf46f05cfb None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:53.453975 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:53.557784 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24162b76-34da-4864-a104-7adf46f05cfb None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:53.594742 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34964326-ef51-4065-821a-334166493e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:53.595943 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34964326-ef51-4065-821a-334166493e19 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:53.596447 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34964326-ef51-4065-821a-334166493e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:53.596871 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34964326-ef51-4065-821a-334166493e19 None admin] PATH_INFO: `/v3/users/df2ae689d8a9485e91bbd47ca8ae1336` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:53.598286 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34964326-ef51-4065-821a-334166493e19 None admin] RBAC: Authorizing `identity:get_user(user_id=df2ae689d8a9485e91bbd47ca8ae1336)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:53.599918 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34964326-ef51-4065-821a-334166493e19 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:53.601843 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 167/333] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Jun 27 09:14:53 2022] GET /identity/v3/users/df2ae689d8a9485e91bbd47ca8ae1336 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:14:53.608168 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21880b8-bc9c-4b2e-9e7c-a67b24e40d65 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:53.718223 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21880b8-bc9c-4b2e-9e7c-a67b24e40d65 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:53.756886 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8e64e-fb47-467e-8641-8014456d2816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:53.757874 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8e64e-fb47-467e-8641-8014456d2816 None admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:53.758109 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8e64e-fb47-467e-8641-8014456d2816 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:53.758385 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8e64e-fb47-467e-8641-8014456d2816 None admin] PATH_INFO: `/v3/system/users/df2ae689d8a9485e91bbd47ca8ae1336/roles/90a856ad3f4b4f5db89fbf1ee0841819` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:53.760062 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba8e64e-fb47-467e-8641-8014456d2816 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=df2ae689d8a9485e91bbd47ca8ae1336, role_id=90a856ad3f4b4f5db89fbf1ee0841819)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:53.761544 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba8e64e-fb47-467e-8641-8014456d2816 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:53.835554 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 167/334] 10.222.0.62 () {58 vars in 1334 bytes} [Mon Jun 27 09:14:53 2022] PUT /identity/v3/system/users/df2ae689d8a9485e91bbd47ca8ae1336/roles/90a856ad3f4b4f5db89fbf1ee0841819 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:14:55.701405 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849808a-2e1c-42c8-924a-29c6db49e47e None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:55.701951 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849808a-2e1c-42c8-924a-29c6db49e47e None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:55.701951 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849808a-2e1c-42c8-924a-29c6db49e47e None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:55.703483 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 168/335] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:14:55.717932 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b65517-a456-4dae-ae71-fa86a9cc5225 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:55.718469 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b65517-a456-4dae-ae71-fa86a9cc5225 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:55.718469 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b65517-a456-4dae-ae71-fa86a9cc5225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:55.731654 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:55.737419 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-f9b65517-a456-4dae-ae71-fa86a9cc5225 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:55.738612 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-f9b65517-a456-4dae-ae71-fa86a9cc5225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:55.823394 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 168/336] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 09:14:55.847538 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849808a-2e1c-42c8-924a-29c6db49e47e None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:55.902250 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b60f4b-707c-4091-a365-a08d9eea5158 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:55.902544 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b60f4b-707c-4091-a365-a08d9eea5158 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:55.903111 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b60f4b-707c-4091-a365-a08d9eea5158 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:55.904576 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 169/337] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 09:14:55.914587 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ce3cb-181c-4900-9101-de250120d0c4 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:55.914859 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ce3cb-181c-4900-9101-de250120d0c4 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:55.915138 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ce3cb-181c-4900-9101-de250120d0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:55.937900 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-523ce3cb-181c-4900-9101-de250120d0c4 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:55.939093 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-523ce3cb-181c-4900-9101-de250120d0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:55.968299 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:56.019015 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849808a-2e1c-42c8-924a-29c6db49e47e None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:56.066149 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 170/338] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:14:56.078891 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded2681-899e-4663-a839-3e9954580ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:56.079723 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded2681-899e-4663-a839-3e9954580ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:56.080003 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded2681-899e-4663-a839-3e9954580ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:56.080306 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded2681-899e-4663-a839-3e9954580ee5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:56.092050 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ce3cb-181c-4900-9101-de250120d0c4 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:56.092616 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eded2681-899e-4663-a839-3e9954580ee5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:14:56.100372 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-eded2681-899e-4663-a839-3e9954580ee5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 09:14:56.100372 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:14:56.100372 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:14:56.100372 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:14:56.100372 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:14:56.100372 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:14:56.100372 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:14:56.100372 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:14:56.100372 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:14:56.100372 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:14:56.100372 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:14:56.100372 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:14:56.100372 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:14:56.100372 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:14:56.100372 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:14:56.100372 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:14:56.101308 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:14:56.101308 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:14:56.101308 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:14:56.101308 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:14:56.101308 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:14:56.101308 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:14:56.101308 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:14:56.101308 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:14:56.101308 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:14:56.101308 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:14:56.101308 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:14:56.101308 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:14:56.101308 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:14:56.101308 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:14:56.101308 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:14:56.101308 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:14:56.102123 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:14:56.102123 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:14:56.102123 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:14:56.102123 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:14:56.102123 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:14:56.102123 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:14:56.102123 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:14:56.102123 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:14:56.102123 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:14:56.102123 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:14:56.102123 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 09:14:56.102123 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:14:56.106987 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 169/339] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:14:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:14:56.117287 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded2681-899e-4663-a839-3e9954580ee5 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:56.180146 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:56.225201 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ce3cb-181c-4900-9101-de250120d0c4 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:56.262503 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56fa64-6b81-444d-a6a8-bc2640bb8ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:56.263306 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56fa64-6b81-444d-a6a8-bc2640bb8ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:56.263589 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56fa64-6b81-444d-a6a8-bc2640bb8ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:56.263871 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56fa64-6b81-444d-a6a8-bc2640bb8ee9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:56.276106 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa56fa64-6b81-444d-a6a8-bc2640bb8ee9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:14:56.284447 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-fa56fa64-6b81-444d-a6a8-bc2640bb8ee9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 09:14:56.284447 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:14:56.284447 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:14:56.284447 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:14:56.284447 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:14:56.284447 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:14:56.284447 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:14:56.284447 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:14:56.284447 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:14:56.284447 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:14:56.284447 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:14:56.284447 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:14:56.284447 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:14:56.284447 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:14:56.284447 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:14:56.284447 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:14:56.286708 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:14:56.286708 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:14:56.286708 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:14:56.286708 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:14:56.286708 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:14:56.286708 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:14:56.286708 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:14:56.286708 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:14:56.286708 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:14:56.286708 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:14:56.286708 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:14:56.286708 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:14:56.286708 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:14:56.286708 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:14:56.286708 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:14:56.286708 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:14:56.288751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:14:56.288751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:14:56.288751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:14:56.288751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:14:56.288751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:14:56.288751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:14:56.288751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:14:56.288751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:14:56.288751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:14:56.288751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:14:56.288751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 09:14:56.288751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:14:56.288751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 171/340] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:14:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:14:56.295786 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56fa64-6b81-444d-a6a8-bc2640bb8ee9 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:56.347104 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded2681-899e-4663-a839-3e9954580ee5 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:56.388400 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c3057-e291-416e-9772-750ccfed2aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:56.389088 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c3057-e291-416e-9772-750ccfed2aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:56.389373 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c3057-e291-416e-9772-750ccfed2aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:56.389650 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c3057-e291-416e-9772-750ccfed2aa0 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:56.390573 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c3057-e291-416e-9772-750ccfed2aa0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:56.390899 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c3057-e291-416e-9772-750ccfed2aa0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:56.392450 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c3057-e291-416e-9772-750ccfed2aa0 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:56.394245 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:56.406622 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 170/341] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Jun 27 09:14:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:56.413058 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c3057-e291-416e-9772-750ccfed2aa0 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:56.527223 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56fa64-6b81-444d-a6a8-bc2640bb8ee9 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:56.560542 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:56.574212 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b0b5fd-93d6-424f-a19f-19508425486a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:56.575183 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0b5fd-93d6-424f-a19f-19508425486a None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:56.575494 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0b5fd-93d6-424f-a19f-19508425486a None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:56.575796 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0b5fd-93d6-424f-a19f-19508425486a None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:56.576729 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b0b5fd-93d6-424f-a19f-19508425486a None admin] RBAC: Adding query filter params (name=member) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:56.582199 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b0b5fd-93d6-424f-a19f-19508425486a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:56.582199 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b0b5fd-93d6-424f-a19f-19508425486a None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:56.596045 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 172/342] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Jun 27 09:14:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:56.599665 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b8c5e-25a6-435e-a7b7-f9b195a00c19 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:56.599956 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b8c5e-25a6-435e-a7b7-f9b195a00c19 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:56.600255 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b8c5e-25a6-435e-a7b7-f9b195a00c19 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:56.601612 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 173/343] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:14:56.602330 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b8c5e-25a6-435e-a7b7-f9b195a00c19 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:56.612167 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c3057-e291-416e-9772-750ccfed2aa0 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:56.663802 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df5cd08-ee47-42f7-bf04-e803ec558f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:56.664513 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df5cd08-ee47-42f7-bf04-e803ec558f65 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:56.664796 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df5cd08-ee47-42f7-bf04-e803ec558f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:56.665071 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df5cd08-ee47-42f7-bf04-e803ec558f65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:56.800573 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:56.809695 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df5cd08-ee47-42f7-bf04-e803ec558f65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:56.811180 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df5cd08-ee47-42f7-bf04-e803ec558f65 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:56.813001 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b8c5e-25a6-435e-a7b7-f9b195a00c19 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:56.877083 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377efbb7-7f0b-4c87-bec0-706be523c0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:56.877791 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377efbb7-7f0b-4c87-bec0-706be523c0d9 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:56.878083 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377efbb7-7f0b-4c87-bec0-706be523c0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:56.878358 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377efbb7-7f0b-4c87-bec0-706be523c0d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:56.953209 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 171/344] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:14:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 27 09:14:56.954578 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb767dc7-ddb9-4fb6-9381-1ebf0d2c57d5 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:56.954995 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb767dc7-ddb9-4fb6-9381-1ebf0d2c57d5 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:56.955279 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb767dc7-ddb9-4fb6-9381-1ebf0d2c57d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:56.968592 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:56.974431 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-cb767dc7-ddb9-4fb6-9381-1ebf0d2c57d5 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:56.976335 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-cb767dc7-ddb9-4fb6-9381-1ebf0d2c57d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:56.983202 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377efbb7-7f0b-4c87-bec0-706be523c0d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:56.984705 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377efbb7-7f0b-4c87-bec0-706be523c0d9 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:57.051416 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 172/345] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:14:57.052239 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb767dc7-ddb9-4fb6-9381-1ebf0d2c57d5 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:57.108600 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:57.135898 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 174/346] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:14:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 09:14:57.136919 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377efbb7-7f0b-4c87-bec0-706be523c0d9 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:57.167606 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb767dc7-ddb9-4fb6-9381-1ebf0d2c57d5 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:57.204451 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f172e878-51dc-4881-9724-6346ca8260d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:57.205323 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172e878-51dc-4881-9724-6346ca8260d6 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:57.205604 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172e878-51dc-4881-9724-6346ca8260d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:57.205874 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172e878-51dc-4881-9724-6346ca8260d6 None admin] PATH_INFO: `/v3/projects/7ef24b891e2145d0ac96f35d4f4c385f` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:57.207084 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f172e878-51dc-4881-9724-6346ca8260d6 None admin] RBAC: Authorizing `identity:get_project(project_id=7ef24b891e2145d0ac96f35d4f4c385f)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:57.208687 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f172e878-51dc-4881-9724-6346ca8260d6 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:57.211236 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 173/347] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:14:57 2022] GET /identity/v3/projects/7ef24b891e2145d0ac96f35d4f4c385f => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:57.211850 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f172e878-51dc-4881-9724-6346ca8260d6 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:57.314741 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:57.327784 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377efbb7-7f0b-4c87-bec0-706be523c0d9 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:57.338450 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f172e878-51dc-4881-9724-6346ca8260d6 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:57.340659 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:57.368496 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db192287-1698-4f19-8790-f7250be329b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:57.369395 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db192287-1698-4f19-8790-f7250be329b7 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:57.369680 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db192287-1698-4f19-8790-f7250be329b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:57.369958 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db192287-1698-4f19-8790-f7250be329b7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:57.382981 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db192287-1698-4f19-8790-f7250be329b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:14:57.383341 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a50efda-2f62-4de2-94d7-9b583d9bd71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:57.384219 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50efda-2f62-4de2-94d7-9b583d9bd71f None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:57.384529 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50efda-2f62-4de2-94d7-9b583d9bd71f None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:57.384801 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50efda-2f62-4de2-94d7-9b583d9bd71f None admin] PATH_INFO: `/v3/projects/7f845d06024f4ea9b859e6d0dcef1534` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:57.386006 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a50efda-2f62-4de2-94d7-9b583d9bd71f None admin] RBAC: Authorizing `identity:get_project(project_id=7f845d06024f4ea9b859e6d0dcef1534)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:57.387459 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a50efda-2f62-4de2-94d7-9b583d9bd71f None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:57.389554 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 174/348] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:14:57 2022] GET /identity/v3/projects/7f845d06024f4ea9b859e6d0dcef1534 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:57.390431 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a50efda-2f62-4de2-94d7-9b583d9bd71f None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:57.391425 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-db192287-1698-4f19-8790-f7250be329b7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 09:14:57.391425 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:14:57.391425 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:14:57.391425 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:14:57.391425 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:14:57.391425 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:14:57.391425 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:14:57.391425 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:14:57.391425 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:14:57.391425 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:14:57.391425 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:14:57.391425 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:14:57.391425 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:14:57.391425 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:14:57.391425 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:14:57.391425 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:14:57.392422 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:14:57.392422 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:14:57.392422 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:14:57.392422 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:14:57.392422 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:14:57.392422 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:14:57.392422 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:14:57.392422 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:14:57.392422 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:14:57.392422 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:14:57.392422 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:14:57.392422 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:14:57.392422 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:14:57.392422 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:14:57.392422 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:14:57.392422 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:14:57.393217 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:14:57.393217 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:14:57.393217 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:14:57.393217 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:14:57.393217 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:14:57.393217 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:14:57.393217 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:14:57.393217 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:14:57.393217 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:14:57.393217 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:14:57.393217 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 09:14:57.393217 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:14:57.393217 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 175/349] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Jun 27 09:14:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:14:57.397889 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e54ee6-89f8-4754-9cec-dc7841e6d11e None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:57.397889 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e54ee6-89f8-4754-9cec-dc7841e6d11e None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:57.397889 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e54ee6-89f8-4754-9cec-dc7841e6d11e None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:57.397889 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 176/350] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:14:57.403590 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e54ee6-89f8-4754-9cec-dc7841e6d11e None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:57.530846 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a50efda-2f62-4de2-94d7-9b583d9bd71f None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:57.545632 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e54ee6-89f8-4754-9cec-dc7841e6d11e None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:57.575893 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f32bf-7eb3-48f6-ba56-9e38d4115bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:57.576724 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f32bf-7eb3-48f6-ba56-9e38d4115bbc None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:57.577005 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f32bf-7eb3-48f6-ba56-9e38d4115bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:57.577274 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f32bf-7eb3-48f6-ba56-9e38d4115bbc None admin] PATH_INFO: `/v3/groups/564822e2a0ae45789218c020f51b29a2` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:57.585052 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f32bf-7eb3-48f6-ba56-9e38d4115bbc None admin] RBAC: Authorizing `identity:get_group(group_id=564822e2a0ae45789218c020f51b29a2)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:57.586521 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f32bf-7eb3-48f6-ba56-9e38d4115bbc None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:57.588412 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 175/351] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Jun 27 09:14:57 2022] GET /identity/v3/groups/564822e2a0ae45789218c020f51b29a2 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:57.589019 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f32bf-7eb3-48f6-ba56-9e38d4115bbc None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:57.589234 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9efb32-73b9-43c7-b9e7-ae0bb8ebe15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:57.590028 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9efb32-73b9-43c7-b9e7-ae0bb8ebe15f None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:57.590302 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9efb32-73b9-43c7-b9e7-ae0bb8ebe15f None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:57.590578 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9efb32-73b9-43c7-b9e7-ae0bb8ebe15f None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:57.591330 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9efb32-73b9-43c7-b9e7-ae0bb8ebe15f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:57.591640 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9efb32-73b9-43c7-b9e7-ae0bb8ebe15f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:57.593081 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9efb32-73b9-43c7-b9e7-ae0bb8ebe15f None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:57.602638 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 177/352] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:14:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:57.604083 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffeb89f-b760-47a9-8961-63d5ef6baa27 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:57.604415 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffeb89f-b760-47a9-8961-63d5ef6baa27 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:57.604697 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffeb89f-b760-47a9-8961-63d5ef6baa27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:57.621308 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:57.623783 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-dffeb89f-b760-47a9-8961-63d5ef6baa27 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:57.623927 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-dffeb89f-b760-47a9-8961-63d5ef6baa27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:57.626878 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:57.705283 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 178/353] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:14:57.708466 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea504202-1c93-4e2f-9e02-2c07e07fb05a None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:57.708466 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea504202-1c93-4e2f-9e02-2c07e07fb05a None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:57.708466 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea504202-1c93-4e2f-9e02-2c07e07fb05a None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:57.708711 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 179/354] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:14:57.713802 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea504202-1c93-4e2f-9e02-2c07e07fb05a None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:57.717199 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f32bf-7eb3-48f6-ba56-9e38d4115bbc None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:57.762939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b7337-b6a8-49bd-8566-4b7bb4bfb76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:57.763847 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b7337-b6a8-49bd-8566-4b7bb4bfb76c None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:57.764081 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b7337-b6a8-49bd-8566-4b7bb4bfb76c None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:57.764366 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b7337-b6a8-49bd-8566-4b7bb4bfb76c None admin] PATH_INFO: `/v3/groups/564822e2a0ae45789218c020f51b29a2` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:57.765555 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b7337-b6a8-49bd-8566-4b7bb4bfb76c None admin] RBAC: Authorizing `identity:get_group(group_id=564822e2a0ae45789218c020f51b29a2)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:57.766956 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b7337-b6a8-49bd-8566-4b7bb4bfb76c None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:57.769859 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 176/355] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Jun 27 09:14:57 2022] GET /identity/v3/groups/564822e2a0ae45789218c020f51b29a2 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:57.770893 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8cf6a-70dd-4622-aa4c-48d644a2335a None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:57.771172 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8cf6a-70dd-4622-aa4c-48d644a2335a None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:57.772039 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8cf6a-70dd-4622-aa4c-48d644a2335a None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:57.773480 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 177/356] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:14:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:14:57.774046 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8cf6a-70dd-4622-aa4c-48d644a2335a None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:57.834652 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea504202-1c93-4e2f-9e02-2c07e07fb05a None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:57.878360 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb268628-7687-4d81-b0f2-9e005b38f897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:57.878594 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb268628-7687-4d81-b0f2-9e005b38f897 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:57.878919 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb268628-7687-4d81-b0f2-9e005b38f897 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:57.879262 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb268628-7687-4d81-b0f2-9e005b38f897 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:57.881573 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb268628-7687-4d81-b0f2-9e005b38f897 None admin] RBAC: Adding query filter params (group.id=564822e2a0ae45789218c020f51b29a2, role.id=b1260d153ca7497eaaaa0991f053ff89, scope.project.id=7ef24b891e2145d0ac96f35d4f4c385f) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:57.882649 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb268628-7687-4d81-b0f2-9e005b38f897 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:57.883791 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb268628-7687-4d81-b0f2-9e005b38f897 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:57.886928 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:57.890536 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 180/357] 10.222.0.62 () {56 vars in 1376 bytes} [Mon Jun 27 09:14:57 2022] GET /identity/v3/role_assignments?group.id=564822e2a0ae45789218c020f51b29a2&scope.project.id=7ef24b891e2145d0ac96f35d4f4c385f&role.id=b1260d153ca7497eaaaa0991f053ff89 => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:57.891946 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd848abb-a021-43cb-bda2-0c5d90fd2d41 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:57.892056 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd848abb-a021-43cb-bda2-0c5d90fd2d41 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:57.895407 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8cf6a-70dd-4622-aa4c-48d644a2335a None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:57.896486 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd848abb-a021-43cb-bda2-0c5d90fd2d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:57.906411 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:57.922139 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-cd848abb-a021-43cb-bda2-0c5d90fd2d41 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:57.923431 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-cd848abb-a021-43cb-bda2-0c5d90fd2d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:57.947720 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa2d6c-f467-4061-bca0-bccbf3fa8127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:57.948833 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa2d6c-f467-4061-bca0-bccbf3fa8127 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:57.949117 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa2d6c-f467-4061-bca0-bccbf3fa8127 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:57.949395 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa2d6c-f467-4061-bca0-bccbf3fa8127 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:58.017032 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 181/358] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:14:58.020436 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd848abb-a021-43cb-bda2-0c5d90fd2d41 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:58.063765 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa2d6c-f467-4061-bca0-bccbf3fa8127 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:58.065434 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa2d6c-f467-4061-bca0-bccbf3fa8127 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:58.148075 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd848abb-a021-43cb-bda2-0c5d90fd2d41 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:58.188813 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:58.193077 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0f79f-f454-4551-b778-f851da8008b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:58.194766 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0f79f-f454-4551-b778-f851da8008b8 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:58.195196 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0f79f-f454-4551-b778-f851da8008b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:58.195621 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0f79f-f454-4551-b778-f851da8008b8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:58.196673 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 178/359] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:14:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 09:14:58.202550 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa2d6c-f467-4061-bca0-bccbf3fa8127 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:58.202699 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:58.214738 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec0f79f-f454-4551-b778-f851da8008b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:14:58.224687 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-0ec0f79f-f454-4551-b778-f851da8008b8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 09:14:58.224687 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:14:58.224687 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:14:58.224687 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:14:58.224687 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:14:58.224687 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:14:58.224687 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:14:58.224687 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:14:58.224687 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:14:58.224687 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:14:58.224687 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:14:58.224687 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:14:58.224687 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:14:58.224687 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:14:58.224687 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:14:58.224687 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:14:58.225608 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:14:58.225608 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:14:58.225608 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:14:58.225608 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:14:58.225608 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:14:58.225608 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:14:58.225608 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:14:58.225608 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:14:58.225608 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:14:58.225608 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:14:58.225608 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:14:58.225608 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:14:58.225608 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:14:58.225608 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:14:58.225608 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:14:58.225608 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:14:58.226405 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:14:58.226405 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:14:58.226405 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:14:58.226405 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:14:58.226405 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:14:58.226405 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:14:58.226405 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:14:58.226405 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:14:58.226405 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:14:58.226405 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:14:58.226405 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 09:14:58.226405 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:14:58.226405 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 182/360] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Jun 27 09:14:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:14:58.227639 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308adc0-22ea-4cb1-869a-da9d4e334415 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:58.228227 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308adc0-22ea-4cb1-869a-da9d4e334415 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:58.228718 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308adc0-22ea-4cb1-869a-da9d4e334415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:58.247760 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-a308adc0-22ea-4cb1-869a-da9d4e334415 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:14:58.249284 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-a308adc0-22ea-4cb1-869a-da9d4e334415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:14:58.338514 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa2d6c-f467-4061-bca0-bccbf3fa8127 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:58.341925 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 183/361] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:14:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:14:58.342807 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308adc0-22ea-4cb1-869a-da9d4e334415 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:58.401283 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b6dc7a-ecc1-4d2a-9a9c-b0ad22349f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:58.402008 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6dc7a-ecc1-4d2a-9a9c-b0ad22349f70 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:58.402299 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6dc7a-ecc1-4d2a-9a9c-b0ad22349f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:58.403145 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6dc7a-ecc1-4d2a-9a9c-b0ad22349f70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:58.404006 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b6dc7a-ecc1-4d2a-9a9c-b0ad22349f70 None admin] RBAC: Adding query filter params (group.id=564822e2a0ae45789218c020f51b29a2, role.id=b1260d153ca7497eaaaa0991f053ff89, scope.project.id=7f845d06024f4ea9b859e6d0dcef1534) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:58.404347 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b6dc7a-ecc1-4d2a-9a9c-b0ad22349f70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:58.406276 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b6dc7a-ecc1-4d2a-9a9c-b0ad22349f70 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:58.414705 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 179/362] 10.222.0.62 () {56 vars in 1376 bytes} [Mon Jun 27 09:14:58 2022] GET /identity/v3/role_assignments?group.id=564822e2a0ae45789218c020f51b29a2&scope.project.id=7f845d06024f4ea9b859e6d0dcef1534&role.id=b1260d153ca7497eaaaa0991f053ff89 => generated 260 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:58.415704 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b6dc7a-ecc1-4d2a-9a9c-b0ad22349f70 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:58.477142 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308adc0-22ea-4cb1-869a-da9d4e334415 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:58.509799 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:58.529887 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:58.534579 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e86c57-d70f-4ac6-a4a2-dd8f941f9231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:58.535656 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e86c57-d70f-4ac6-a4a2-dd8f941f9231 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:58.536620 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e86c57-d70f-4ac6-a4a2-dd8f941f9231 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:58.536918 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e86c57-d70f-4ac6-a4a2-dd8f941f9231 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:58.559332 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e86c57-d70f-4ac6-a4a2-dd8f941f9231 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:14:58.570221 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-89e86c57-d70f-4ac6-a4a2-dd8f941f9231 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 09:14:58.570221 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:14:58.570221 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:14:58.570221 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:14:58.570221 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:14:58.570221 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:14:58.570221 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:14:58.570221 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:14:58.570221 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:14:58.570221 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:14:58.570221 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:14:58.570221 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:14:58.570221 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:14:58.570221 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:14:58.570221 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:14:58.570221 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:14:58.571188 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:14:58.571188 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:14:58.571188 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:14:58.571188 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:14:58.571188 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:14:58.571188 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:14:58.571188 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:14:58.571188 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:14:58.571188 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:14:58.571188 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:14:58.571188 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:14:58.571188 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:14:58.571188 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:14:58.571188 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:14:58.571188 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:14:58.571188 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:14:58.571993 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:14:58.571993 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:14:58.571993 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:14:58.571993 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:14:58.571993 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:14:58.571993 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:14:58.571993 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:14:58.571993 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:14:58.571993 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:14:58.571993 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:14:58.571993 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 09:14:58.571993 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:14:58.571993 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 184/363] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:14:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:14:58.572712 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e86c57-d70f-4ac6-a4a2-dd8f941f9231 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:58.597854 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b6dc7a-ecc1-4d2a-9a9c-b0ad22349f70 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:58.639773 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13bae75-2696-4eee-ba26-41a77fc383fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:58.640785 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13bae75-2696-4eee-ba26-41a77fc383fe None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:58.641068 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13bae75-2696-4eee-ba26-41a77fc383fe None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:58.641341 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13bae75-2696-4eee-ba26-41a77fc383fe None admin] PATH_INFO: `/v3/projects/7ef24b891e2145d0ac96f35d4f4c385f` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:58.642554 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13bae75-2696-4eee-ba26-41a77fc383fe None admin] RBAC: Authorizing `identity:get_project(project_id=7ef24b891e2145d0ac96f35d4f4c385f)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:58.644292 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13bae75-2696-4eee-ba26-41a77fc383fe None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:58.646903 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 180/364] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:14:58 2022] GET /identity/v3/projects/7ef24b891e2145d0ac96f35d4f4c385f => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:58.647838 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13bae75-2696-4eee-ba26-41a77fc383fe None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:58.719492 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e86c57-d70f-4ac6-a4a2-dd8f941f9231 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:58.767774 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f0781e-4218-4e62-82d6-12011f0f7fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:58.768537 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0781e-4218-4e62-82d6-12011f0f7fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:58.768823 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0781e-4218-4e62-82d6-12011f0f7fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:58.769100 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0781e-4218-4e62-82d6-12011f0f7fc6 None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:58.770855 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f0781e-4218-4e62-82d6-12011f0f7fc6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:58.771166 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f0781e-4218-4e62-82d6-12011f0f7fc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:58.773171 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f0781e-4218-4e62-82d6-12011f0f7fc6 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:58.787835 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 185/365] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:14:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:58.789840 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f0781e-4218-4e62-82d6-12011f0f7fc6 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:58.802751 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13bae75-2696-4eee-ba26-41a77fc383fe None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:58.839495 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:58.852500 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:58.857887 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2900f28c-4433-427d-b807-95f8a1e7abaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:58.858792 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900f28c-4433-427d-b807-95f8a1e7abaa None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:58.859080 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900f28c-4433-427d-b807-95f8a1e7abaa None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:58.859357 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900f28c-4433-427d-b807-95f8a1e7abaa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:58.880374 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2900f28c-4433-427d-b807-95f8a1e7abaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:14:58.892224 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-2900f28c-4433-427d-b807-95f8a1e7abaa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:14:58.892224 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:14:58.892224 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:14:58.892224 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:14:58.892224 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:14:58.892224 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:14:58.892224 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:14:58.892224 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:14:58.892224 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:14:58.892224 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:14:58.892224 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:14:58.892224 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:14:58.892224 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:14:58.892224 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:14:58.892224 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:14:58.892224 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:14:58.893803 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:14:58.893803 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:14:58.893803 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:14:58.893803 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:14:58.893803 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:14:58.893803 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:14:58.893803 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:14:58.893803 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:14:58.893803 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:14:58.893803 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:14:58.893803 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:14:58.893803 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:14:58.893803 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:14:58.893803 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:14:58.893803 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:14:58.893803 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:14:58.894768 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:14:58.894768 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:14:58.894768 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:14:58.894768 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:14:58.894768 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:14:58.894768 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:14:58.894768 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:14:58.894768 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:14:58.894768 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:14:58.894768 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:14:58.894768 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:14:58.894768 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:14:58.897673 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 181/366] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Jun 27 09:14:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:14:58.898950 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2900f28c-4433-427d-b807-95f8a1e7abaa None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:58.927962 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f0781e-4218-4e62-82d6-12011f0f7fc6 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:58.969918 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34118fe4-58ea-41ec-b597-a555f3da1e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:58.971031 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34118fe4-58ea-41ec-b597-a555f3da1e8e None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:58.971525 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34118fe4-58ea-41ec-b597-a555f3da1e8e None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:58.972067 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34118fe4-58ea-41ec-b597-a555f3da1e8e None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:58.973151 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34118fe4-58ea-41ec-b597-a555f3da1e8e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:58.973871 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34118fe4-58ea-41ec-b597-a555f3da1e8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:58.976845 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34118fe4-58ea-41ec-b597-a555f3da1e8e None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:58.986176 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 186/367] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Jun 27 09:14:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:58.987344 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34118fe4-58ea-41ec-b597-a555f3da1e8e None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:59.020132 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2900f28c-4433-427d-b807-95f8a1e7abaa None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:59.057962 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df17f3f-e0cd-4ad1-a77a-a0e5619188eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:59.059030 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df17f3f-e0cd-4ad1-a77a-a0e5619188eb None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:59.059317 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df17f3f-e0cd-4ad1-a77a-a0e5619188eb None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:59.059708 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df17f3f-e0cd-4ad1-a77a-a0e5619188eb None admin] PATH_INFO: `/v3/groups/564822e2a0ae45789218c020f51b29a2` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:59.060963 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df17f3f-e0cd-4ad1-a77a-a0e5619188eb None admin] RBAC: Authorizing `identity:get_group(group_id=564822e2a0ae45789218c020f51b29a2)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:59.062521 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df17f3f-e0cd-4ad1-a77a-a0e5619188eb None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:59.064740 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 182/368] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Jun 27 09:14:58 2022] GET /identity/v3/groups/564822e2a0ae45789218c020f51b29a2 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:59.065597 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df17f3f-e0cd-4ad1-a77a-a0e5619188eb None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:59.110794 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34118fe4-58ea-41ec-b597-a555f3da1e8e None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:59.127672 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:59.158293 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:59.159652 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f24000-a84c-4e31-b358-7d8006b980ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:59.161007 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f24000-a84c-4e31-b358-7d8006b980ae None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:59.161532 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f24000-a84c-4e31-b358-7d8006b980ae None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:59.162026 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f24000-a84c-4e31-b358-7d8006b980ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:59.221338 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df17f3f-e0cd-4ad1-a77a-a0e5619188eb None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:59.246214 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f24000-a84c-4e31-b358-7d8006b980ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:59.248927 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f24000-a84c-4e31-b358-7d8006b980ae None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:59.265615 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89b24b-a62e-4d3e-a321-447c8b354dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:59.266627 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89b24b-a62e-4d3e-a321-447c8b354dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:59.267123 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89b24b-a62e-4d3e-a321-447c8b354dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:59.267587 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89b24b-a62e-4d3e-a321-447c8b354dd2 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:59.268617 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef89b24b-a62e-4d3e-a321-447c8b354dd2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:59.269121 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef89b24b-a62e-4d3e-a321-447c8b354dd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:59.270715 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef89b24b-a62e-4d3e-a321-447c8b354dd2 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:59.281584 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 183/369] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:14:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:59.287233 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89b24b-a62e-4d3e-a321-447c8b354dd2 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:59.380279 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 187/370] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:14:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 09:14:59.383038 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f24000-a84c-4e31-b358-7d8006b980ae None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:59.397013 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:59.407256 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89b24b-a62e-4d3e-a321-447c8b354dd2 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:59.447894 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:59.455139 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cbde6b-bc64-4bdf-bbd3-923557b37d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:59.456118 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbde6b-bc64-4bdf-bbd3-923557b37d55 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:59.456390 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbde6b-bc64-4bdf-bbd3-923557b37d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:59.456742 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbde6b-bc64-4bdf-bbd3-923557b37d55 None admin] PATH_INFO: `/v3/users/df2ae689d8a9485e91bbd47ca8ae1336` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:59.458632 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cbde6b-bc64-4bdf-bbd3-923557b37d55 None admin] RBAC: Authorizing `identity:get_user(user_id=df2ae689d8a9485e91bbd47ca8ae1336)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:59.460114 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cbde6b-bc64-4bdf-bbd3-923557b37d55 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:59.463059 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 184/371] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Jun 27 09:14:59 2022] GET /identity/v3/users/df2ae689d8a9485e91bbd47ca8ae1336 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:59.468489 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cbde6b-bc64-4bdf-bbd3-923557b37d55 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:59.531894 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f24000-a84c-4e31-b358-7d8006b980ae None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:59.579871 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e8350e-cfac-4be7-8909-1a0d34a930a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:59.581085 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8350e-cfac-4be7-8909-1a0d34a930a0 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:59.581548 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8350e-cfac-4be7-8909-1a0d34a930a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:59.582395 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8350e-cfac-4be7-8909-1a0d34a930a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:59.583679 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e8350e-cfac-4be7-8909-1a0d34a930a0 None admin] RBAC: Adding query filter params (group.id=564822e2a0ae45789218c020f51b29a2, role.id=b137366eb53b42aab629a88be737eaf9, scope.project.id=7ef24b891e2145d0ac96f35d4f4c385f) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:14:59.584276 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e8350e-cfac-4be7-8909-1a0d34a930a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:59.586788 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e8350e-cfac-4be7-8909-1a0d34a930a0 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:59.592696 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cbde6b-bc64-4bdf-bbd3-923557b37d55 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:59.594556 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 188/372] 10.222.0.62 () {56 vars in 1376 bytes} [Mon Jun 27 09:14:59 2022] GET /identity/v3/role_assignments?group.id=564822e2a0ae45789218c020f51b29a2&scope.project.id=7ef24b891e2145d0ac96f35d4f4c385f&role.id=b137366eb53b42aab629a88be737eaf9 => generated 260 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:59.595637 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e8350e-cfac-4be7-8909-1a0d34a930a0 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:59.663056 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c6b61a-d1f8-4038-aaf7-8b1bf7539ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:59.663815 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c6b61a-d1f8-4038-aaf7-8b1bf7539ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:59.664015 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c6b61a-d1f8-4038-aaf7-8b1bf7539ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:59.664409 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c6b61a-d1f8-4038-aaf7-8b1bf7539ee1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:59.683964 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:59.719700 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e8350e-cfac-4be7-8909-1a0d34a930a0 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:14:59.750999 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:14:59.790906 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c6b61a-d1f8-4038-aaf7-8b1bf7539ee1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:59.792716 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c6b61a-d1f8-4038-aaf7-8b1bf7539ee1 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:59.792943 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390a718-e38c-40f6-b99b-b27db7c6b852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:14:59.793831 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390a718-e38c-40f6-b99b-b27db7c6b852 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:14:59.794117 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390a718-e38c-40f6-b99b-b27db7c6b852 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:14:59.794394 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390a718-e38c-40f6-b99b-b27db7c6b852 None admin] PATH_INFO: `/v3/projects/7f845d06024f4ea9b859e6d0dcef1534` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:14:59.795661 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5390a718-e38c-40f6-b99b-b27db7c6b852 None admin] RBAC: Authorizing `identity:get_project(project_id=7f845d06024f4ea9b859e6d0dcef1534)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:14:59.797849 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5390a718-e38c-40f6-b99b-b27db7c6b852 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:14:59.798871 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 189/373] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:14:59 2022] GET /identity/v3/projects/7f845d06024f4ea9b859e6d0dcef1534 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:14:59.800734 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390a718-e38c-40f6-b99b-b27db7c6b852 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:14:59.917514 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 185/374] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:14:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 09:14:59.919243 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c6b61a-d1f8-4038-aaf7-8b1bf7539ee1 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:00.024671 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:00.044055 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c6b61a-d1f8-4038-aaf7-8b1bf7539ee1 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:00.057614 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390a718-e38c-40f6-b99b-b27db7c6b852 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:00.086005 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c8a83-1f11-48cc-8e87-fb35c9b6048d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:00.087186 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c8a83-1f11-48cc-8e87-fb35c9b6048d None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:00.087655 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c8a83-1f11-48cc-8e87-fb35c9b6048d None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:00.088104 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c8a83-1f11-48cc-8e87-fb35c9b6048d None admin] PATH_INFO: `/v3/groups/564822e2a0ae45789218c020f51b29a2` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:00.093660 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c8a83-1f11-48cc-8e87-fb35c9b6048d None admin] RBAC: Authorizing `identity:get_group(group_id=564822e2a0ae45789218c020f51b29a2)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:00.095479 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c8a83-1f11-48cc-8e87-fb35c9b6048d None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:00.097624 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 186/375] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Jun 27 09:14:59 2022] GET /identity/v3/groups/564822e2a0ae45789218c020f51b29a2 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:00.098736 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c8a83-1f11-48cc-8e87-fb35c9b6048d None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:00.122505 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a829f-f3b5-4dd9-b1cd-7a64ba5663e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:00.123175 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a829f-f3b5-4dd9-b1cd-7a64ba5663e7 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:00.123521 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a829f-f3b5-4dd9-b1cd-7a64ba5663e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:00.123804 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a829f-f3b5-4dd9-b1cd-7a64ba5663e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:00.124717 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a829f-f3b5-4dd9-b1cd-7a64ba5663e7 None admin] RBAC: Adding query filter params (role.id=90a856ad3f4b4f5db89fbf1ee0841819, user.id=df2ae689d8a9485e91bbd47ca8ae1336, scope.system=all) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:00.125033 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a829f-f3b5-4dd9-b1cd-7a64ba5663e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:00.126755 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a829f-f3b5-4dd9-b1cd-7a64ba5663e7 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:00.133321 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:00.142497 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 190/376] 10.222.0.62 () {56 vars in 1308 bytes} [Mon Jun 27 09:14:59 2022] GET /identity/v3/role_assignments?user.id=df2ae689d8a9485e91bbd47ca8ae1336&scope.system=all&role.id=90a856ad3f4b4f5db89fbf1ee0841819 => generated 510 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:00.143386 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a829f-f3b5-4dd9-b1cd-7a64ba5663e7 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:00.282052 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a829f-f3b5-4dd9-b1cd-7a64ba5663e7 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:00.326841 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c8a83-1f11-48cc-8e87-fb35c9b6048d None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:00.357126 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaaeccc-c6bf-41d5-9c4b-3e4f985ddd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:00.357793 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaaeccc-c6bf-41d5-9c4b-3e4f985ddd82 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:00.358069 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaaeccc-c6bf-41d5-9c4b-3e4f985ddd82 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:00.358339 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaaeccc-c6bf-41d5-9c4b-3e4f985ddd82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:00.359177 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaaeccc-c6bf-41d5-9c4b-3e4f985ddd82 None admin] RBAC: Adding query filter params (group.id=564822e2a0ae45789218c020f51b29a2, role.id=b137366eb53b42aab629a88be737eaf9, scope.project.id=7f845d06024f4ea9b859e6d0dcef1534) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:00.359530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaaeccc-c6bf-41d5-9c4b-3e4f985ddd82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:00.361002 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaaeccc-c6bf-41d5-9c4b-3e4f985ddd82 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:00.376087 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 191/377] 10.222.0.62 () {56 vars in 1376 bytes} [Mon Jun 27 09:15:00 2022] GET /identity/v3/role_assignments?group.id=564822e2a0ae45789218c020f51b29a2&scope.project.id=7f845d06024f4ea9b859e6d0dcef1534&role.id=b137366eb53b42aab629a88be737eaf9 => generated 260 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:00.378401 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91676ea-95d0-4ef6-9203-24a06b124873 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:00.378401 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91676ea-95d0-4ef6-9203-24a06b124873 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:00.378401 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91676ea-95d0-4ef6-9203-24a06b124873 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:00.379321 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 192/378] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:15:00.386933 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e90801-3312-4c7b-b39c-77db9c906bef None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:00.387214 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e90801-3312-4c7b-b39c-77db9c906bef None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:00.387488 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e90801-3312-4c7b-b39c-77db9c906bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:00.398425 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aea735-c987-4033-9565-73a70afd5b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:00.399544 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aea735-c987-4033-9565-73a70afd5b96 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:00.399968 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aea735-c987-4033-9565-73a70afd5b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:00.400427 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aea735-c987-4033-9565-73a70afd5b96 None admin] PATH_INFO: `/v3/projects/22d0a8f6bf9e4c98ba20a328083165ac` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:00.401790 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aea735-c987-4033-9565-73a70afd5b96 None admin] RBAC: Authorizing `identity:get_project(project_id=22d0a8f6bf9e4c98ba20a328083165ac)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:00.404808 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aea735-c987-4033-9565-73a70afd5b96 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:00.406814 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 187/379] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:15:00 2022] GET /identity/v3/projects/22d0a8f6bf9e4c98ba20a328083165ac => generated 344 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:00.414189 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aea735-c987-4033-9565-73a70afd5b96 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:00.420790 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-58e90801-3312-4c7b-b39c-77db9c906bef None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:00.421590 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-58e90801-3312-4c7b-b39c-77db9c906bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:00.456425 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:00.522544 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:00.543983 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 193/380] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 09:15:00.578092 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e90801-3312-4c7b-b39c-77db9c906bef None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:00.635445 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aea735-c987-4033-9565-73a70afd5b96 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:00.683495 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9baa0-cde2-41f1-b957-df11ba386ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:00.684608 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9baa0-cde2-41f1-b957-df11ba386ff1 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:00.685214 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9baa0-cde2-41f1-b957-df11ba386ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:00.685492 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9baa0-cde2-41f1-b957-df11ba386ff1 None admin] PATH_INFO: `/v3/groups/89b16be432ea438aa0c0019613248a2a` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:00.695746 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9baa0-cde2-41f1-b957-df11ba386ff1 None admin] RBAC: Authorizing `identity:get_group(group_id=89b16be432ea438aa0c0019613248a2a)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:00.697544 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9baa0-cde2-41f1-b957-df11ba386ff1 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:00.700561 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 188/381] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Jun 27 09:15:00 2022] GET /identity/v3/groups/89b16be432ea438aa0c0019613248a2a => generated 229 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:00.706390 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9baa0-cde2-41f1-b957-df11ba386ff1 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:00.790383 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e90801-3312-4c7b-b39c-77db9c906bef None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:00.817925 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:00.827869 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9baa0-cde2-41f1-b957-df11ba386ff1 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:00.868686 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528d9df-08cc-433b-a4cc-eed6434f4676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:00.869315 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528d9df-08cc-433b-a4cc-eed6434f4676 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:00.869599 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528d9df-08cc-433b-a4cc-eed6434f4676 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:00.869872 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528d9df-08cc-433b-a4cc-eed6434f4676 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:00.870704 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0528d9df-08cc-433b-a4cc-eed6434f4676 None admin] RBAC: Adding query filter params (group.id=89b16be432ea438aa0c0019613248a2a, role.id=91c77942515d45f1ad8189c9fddf4424, scope.project.id=22d0a8f6bf9e4c98ba20a328083165ac) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:00.871011 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0528d9df-08cc-433b-a4cc-eed6434f4676 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:00.872485 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0528d9df-08cc-433b-a4cc-eed6434f4676 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:00.879302 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 189/382] 10.222.0.62 () {56 vars in 1376 bytes} [Mon Jun 27 09:15:00 2022] GET /identity/v3/role_assignments?group.id=89b16be432ea438aa0c0019613248a2a&scope.project.id=22d0a8f6bf9e4c98ba20a328083165ac&role.id=91c77942515d45f1ad8189c9fddf4424 => generated 260 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:00.897165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3837d-a196-4519-bbf1-4ab71f456d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:00.898072 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3837d-a196-4519-bbf1-4ab71f456d6d None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:00.898447 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3837d-a196-4519-bbf1-4ab71f456d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:00.898729 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3837d-a196-4519-bbf1-4ab71f456d6d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:00.913865 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d3837d-a196-4519-bbf1-4ab71f456d6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:15:00.924362 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-87d3837d-a196-4519-bbf1-4ab71f456d6d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 09:15:00.924362 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:00.924362 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:00.924362 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:00.924362 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:00.924362 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:00.924362 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:00.924362 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:00.924362 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:00.924362 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:00.924362 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:00.924362 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:00.924362 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:15:00.924362 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:15:00.924362 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:15:00.924362 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:15:00.925319 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:15:00.925319 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:15:00.925319 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:15:00.925319 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:15:00.925319 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:00.925319 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:00.925319 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:00.925319 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:00.925319 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:00.925319 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:00.925319 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:00.925319 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:00.925319 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:00.925319 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:00.925319 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:00.925319 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:00.926112 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:00.926112 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:00.926112 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:00.926112 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:00.926112 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:15:00.926112 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:15:00.926112 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:15:00.926112 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:15:00.926112 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:15:00.926112 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:15:00.926112 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 09:15:00.926112 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:00.926112 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 194/383] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:15:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 09:15:00.933836 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528d9df-08cc-433b-a4cc-eed6434f4676 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:01.010274 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1f4d2-07b0-4129-bc72-43e324bc335b None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:01.010628 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1f4d2-07b0-4129-bc72-43e324bc335b None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:01.010824 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1f4d2-07b0-4129-bc72-43e324bc335b None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:01.012507 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 195/384] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:15:01.030361 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70cb7e9-e0d6-4b71-a8c1-2eb6c5aea9d7 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:01.030672 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70cb7e9-e0d6-4b71-a8c1-2eb6c5aea9d7 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:01.030921 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70cb7e9-e0d6-4b71-a8c1-2eb6c5aea9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:01.064232 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-e70cb7e9-e0d6-4b71-a8c1-2eb6c5aea9d7 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:01.065464 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-e70cb7e9-e0d6-4b71-a8c1-2eb6c5aea9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:01.071397 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528d9df-08cc-433b-a4cc-eed6434f4676 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:01.124068 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3596c-1f76-4fe8-bb02-b69fa8a425ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:01.125369 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3596c-1f76-4fe8-bb02-b69fa8a425ef None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:01.125646 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3596c-1f76-4fe8-bb02-b69fa8a425ef None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:01.125917 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3596c-1f76-4fe8-bb02-b69fa8a425ef None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:01.129145 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a3596c-1f76-4fe8-bb02-b69fa8a425ef None admin] RBAC: Adding query filter params (name=member) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:01.129456 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a3596c-1f76-4fe8-bb02-b69fa8a425ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:01.131615 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a3596c-1f76-4fe8-bb02-b69fa8a425ef None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:01.146843 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 190/385] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Jun 27 09:15:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:01.152487 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3596c-1f76-4fe8-bb02-b69fa8a425ef None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:01.175435 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:01.182068 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:01.234590 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 196/386] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 09:15:01.268583 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70cb7e9-e0d6-4b71-a8c1-2eb6c5aea9d7 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:01.284803 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3596c-1f76-4fe8-bb02-b69fa8a425ef None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:01.333248 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1dca27-5be4-4860-a716-f1bf737d6100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:01.334151 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1dca27-5be4-4860-a716-f1bf737d6100 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:01.334430 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1dca27-5be4-4860-a716-f1bf737d6100 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:01.334700 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1dca27-5be4-4860-a716-f1bf737d6100 None admin] PATH_INFO: `/v3/groups/564822e2a0ae45789218c020f51b29a2` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:01.335890 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1dca27-5be4-4860-a716-f1bf737d6100 None admin] RBAC: Authorizing `identity:get_group(group_id=564822e2a0ae45789218c020f51b29a2)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:01.337488 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1dca27-5be4-4860-a716-f1bf737d6100 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:01.341500 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 191/387] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Jun 27 09:15:01 2022] GET /identity/v3/groups/564822e2a0ae45789218c020f51b29a2 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:01.349133 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1dca27-5be4-4860-a716-f1bf737d6100 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:01.412780 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70cb7e9-e0d6-4b71-a8c1-2eb6c5aea9d7 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:01.451384 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d2311-d3ed-4cc0-9329-ed29c8ee1dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:01.452188 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d2311-d3ed-4cc0-9329-ed29c8ee1dae None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:01.452501 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d2311-d3ed-4cc0-9329-ed29c8ee1dae None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:01.452777 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d2311-d3ed-4cc0-9329-ed29c8ee1dae None admin] PATH_INFO: `/v3/roles/member` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:01.464342 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3d2311-d3ed-4cc0-9329-ed29c8ee1dae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:15:01.472183 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-ee3d2311-d3ed-4cc0-9329-ed29c8ee1dae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 09:15:01.472183 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:01.472183 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:01.472183 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:01.472183 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:01.472183 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:01.472183 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:01.472183 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:01.472183 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:01.472183 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:01.472183 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:01.472183 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:01.472183 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:15:01.472183 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:15:01.472183 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:15:01.472183 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:15:01.473096 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:15:01.473096 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:15:01.473096 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:15:01.473096 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:15:01.473096 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:01.473096 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:01.473096 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:01.473096 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:01.473096 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:01.473096 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:01.473096 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:01.473096 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:01.473096 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:01.473096 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:01.473096 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:01.473096 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:01.473881 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:01.473881 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:01.473881 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:01.473881 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:01.473881 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:15:01.473881 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:15:01.473881 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:15:01.473881 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:15:01.473881 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:15:01.473881 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:15:01.473881 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 09:15:01.473881 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:01.473881 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 197/388] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:15:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 09:15:01.481361 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d2311-d3ed-4cc0-9329-ed29c8ee1dae None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:01.508021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:01.544597 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:01.563403 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1dca27-5be4-4860-a716-f1bf737d6100 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:01.595580 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d2311-d3ed-4cc0-9329-ed29c8ee1dae None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:01.610981 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945dc88-c3df-4818-bac3-f5aa5af2e2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:01.611843 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945dc88-c3df-4818-bac3-f5aa5af2e2ec None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:01.612120 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945dc88-c3df-4818-bac3-f5aa5af2e2ec None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:01.612451 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945dc88-c3df-4818-bac3-f5aa5af2e2ec None admin] PATH_INFO: `/v3/projects/7ef24b891e2145d0ac96f35d4f4c385f` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:01.613682 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2945dc88-c3df-4818-bac3-f5aa5af2e2ec None admin] RBAC: Authorizing `identity:get_project(project_id=7ef24b891e2145d0ac96f35d4f4c385f)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:01.615993 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2945dc88-c3df-4818-bac3-f5aa5af2e2ec None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:01.618052 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 192/389] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:15:01 2022] GET /identity/v3/projects/7ef24b891e2145d0ac96f35d4f4c385f => generated 298 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:01.624909 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945dc88-c3df-4818-bac3-f5aa5af2e2ec None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:01.636448 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890d016-0394-442e-b272-b6d166e1c611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:01.637129 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890d016-0394-442e-b272-b6d166e1c611 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:01.637417 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890d016-0394-442e-b272-b6d166e1c611 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:01.637693 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890d016-0394-442e-b272-b6d166e1c611 None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:01.638450 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5890d016-0394-442e-b272-b6d166e1c611 None admin] RBAC: Adding query filter params (name=member) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:01.638761 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5890d016-0394-442e-b272-b6d166e1c611 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:01.641075 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5890d016-0394-442e-b272-b6d166e1c611 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:01.652879 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 198/390] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Jun 27 09:15:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:15:01.659239 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890d016-0394-442e-b272-b6d166e1c611 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:01.753960 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945dc88-c3df-4818-bac3-f5aa5af2e2ec None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:01.774487 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890d016-0394-442e-b272-b6d166e1c611 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:01.788581 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:01.793115 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5e0a8-b001-4678-8b24-ab0135383b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:01.794003 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5e0a8-b001-4678-8b24-ab0135383b49 None admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:01.794287 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5e0a8-b001-4678-8b24-ab0135383b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:01.794564 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5e0a8-b001-4678-8b24-ab0135383b49 None admin] PATH_INFO: `/v3/projects/7ef24b891e2145d0ac96f35d4f4c385f/groups/564822e2a0ae45789218c020f51b29a2/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:01.796624 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb5e0a8-b001-4678-8b24-ab0135383b49 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ef24b891e2145d0ac96f35d4f4c385f, group_id=564822e2a0ae45789218c020f51b29a2, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:01.798082 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb5e0a8-b001-4678-8b24-ab0135383b49 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:01.816986 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed02cb4-5225-4caf-89bc-e037c0a1143d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:01.817955 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed02cb4-5225-4caf-89bc-e037c0a1143d None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:01.818263 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed02cb4-5225-4caf-89bc-e037c0a1143d None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:01.818539 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed02cb4-5225-4caf-89bc-e037c0a1143d None admin] PATH_INFO: `/v3/groups/564822e2a0ae45789218c020f51b29a2` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:01.819780 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed02cb4-5225-4caf-89bc-e037c0a1143d None admin] RBAC: Authorizing `identity:get_group(group_id=564822e2a0ae45789218c020f51b29a2)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:01.821346 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed02cb4-5225-4caf-89bc-e037c0a1143d None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:01.823036 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 199/391] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Jun 27 09:15:01 2022] GET /identity/v3/groups/564822e2a0ae45789218c020f51b29a2 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:15:01.828497 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed02cb4-5225-4caf-89bc-e037c0a1143d None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:01.906939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 193/392] 10.222.0.62 () {58 vars in 1442 bytes} [Mon Jun 27 09:15:01 2022] PUT /identity/v3/projects/7ef24b891e2145d0ac96f35d4f4c385f/groups/564822e2a0ae45789218c020f51b29a2/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:15:01.952003 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed02cb4-5225-4caf-89bc-e037c0a1143d None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:01.990868 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f5c228-d0f8-425b-9e81-4034f3a9a860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:01.991747 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5c228-d0f8-425b-9e81-4034f3a9a860 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:01.992031 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5c228-d0f8-425b-9e81-4034f3a9a860 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:01.992339 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5c228-d0f8-425b-9e81-4034f3a9a860 None admin] PATH_INFO: `/v3/projects/7f845d06024f4ea9b859e6d0dcef1534` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:01.993552 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f5c228-d0f8-425b-9e81-4034f3a9a860 None admin] RBAC: Authorizing `identity:get_project(project_id=7f845d06024f4ea9b859e6d0dcef1534)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:01.995016 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f5c228-d0f8-425b-9e81-4034f3a9a860 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:01.997114 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 200/393] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:15:01 2022] GET /identity/v3/projects/7f845d06024f4ea9b859e6d0dcef1534 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:15:02.004606 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5e0a8-b001-4678-8b24-ab0135383b49 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:02.019842 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:02.125081 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5e0a8-b001-4678-8b24-ab0135383b49 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:02.162081 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc122e9c-3a63-43f6-b44b-9b6913a76de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:02.163006 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc122e9c-3a63-43f6-b44b-9b6913a76de9 None admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:02.163286 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc122e9c-3a63-43f6-b44b-9b6913a76de9 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:02.163556 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc122e9c-3a63-43f6-b44b-9b6913a76de9 None admin] PATH_INFO: `/v3/projects/7f845d06024f4ea9b859e6d0dcef1534/groups/564822e2a0ae45789218c020f51b29a2/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:02.165775 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc122e9c-3a63-43f6-b44b-9b6913a76de9 None admin] RBAC: Authorizing `identity:create_grant(project_id=7f845d06024f4ea9b859e6d0dcef1534, group_id=564822e2a0ae45789218c020f51b29a2, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:02.168273 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc122e9c-3a63-43f6-b44b-9b6913a76de9 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:02.240987 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 194/394] 10.222.0.62 () {58 vars in 1442 bytes} [Mon Jun 27 09:15:02 2022] PUT /identity/v3/projects/7f845d06024f4ea9b859e6d0dcef1534/groups/564822e2a0ae45789218c020f51b29a2/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:15:02.448483 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb3adb-5f68-47ba-9bd1-24466ade5b88 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:02.449017 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb3adb-5f68-47ba-9bd1-24466ade5b88 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:02.449017 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb3adb-5f68-47ba-9bd1-24466ade5b88 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:02.450483 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 201/395] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:15:02.456612 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b18c8-fbd8-4e70-953e-e46f7da73baa None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:02.456925 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b18c8-fbd8-4e70-953e-e46f7da73baa None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:02.457511 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b18c8-fbd8-4e70-953e-e46f7da73baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:02.480129 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-c90b18c8-fbd8-4e70-953e-e46f7da73baa None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:02.481378 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-c90b18c8-fbd8-4e70-953e-e46f7da73baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:02.551841 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:02.566850 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 195/396] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:15:02.602911 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb3adb-5f68-47ba-9bd1-24466ade5b88 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:02.661344 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:02.746011 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb3adb-5f68-47ba-9bd1-24466ade5b88 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:02.794326 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c3982-6fe3-49c1-a74a-ab524dcc9a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:02.795148 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c3982-6fe3-49c1-a74a-ab524dcc9a4f None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:02.795429 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c3982-6fe3-49c1-a74a-ab524dcc9a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:02.795704 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c3982-6fe3-49c1-a74a-ab524dcc9a4f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:02.810300 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72c3982-6fe3-49c1-a74a-ab524dcc9a4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:15:02.818530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-f72c3982-6fe3-49c1-a74a-ab524dcc9a4f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 09:15:02.818530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:02.818530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:02.818530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:02.818530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:02.818530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:02.818530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:02.818530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:02.818530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:02.818530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:02.818530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:02.818530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:02.818530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:15:02.818530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:15:02.818530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:15:02.818530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:15:02.819422 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:15:02.819422 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:15:02.819422 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:15:02.819422 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:15:02.819422 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:02.819422 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:02.819422 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:02.819422 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:02.819422 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:02.819422 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:02.819422 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:02.819422 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:02.819422 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:02.819422 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:02.819422 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:02.819422 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:02.820614 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:02.820614 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:02.820614 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:02.820614 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:02.820614 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:15:02.820614 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:15:02.820614 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:15:02.820614 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:15:02.820614 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:15:02.820614 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:15:02.820614 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 09:15:02.820614 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:02.820614 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 202/397] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Jun 27 09:15:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:02.829332 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b18c8-fbd8-4e70-953e-e46f7da73baa None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:02.974766 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b18c8-fbd8-4e70-953e-e46f7da73baa None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:03.025866 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c035252-c693-4e8a-9b62-61dd0a8a1caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:03.026474 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c035252-c693-4e8a-9b62-61dd0a8a1caa None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:03.026731 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c035252-c693-4e8a-9b62-61dd0a8a1caa None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:03.027004 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c035252-c693-4e8a-9b62-61dd0a8a1caa None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:03.028024 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c035252-c693-4e8a-9b62-61dd0a8a1caa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:03.028363 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c035252-c693-4e8a-9b62-61dd0a8a1caa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:03.029742 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c035252-c693-4e8a-9b62-61dd0a8a1caa None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:03.038974 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 196/398] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:15:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:03.045513 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c3982-6fe3-49c1-a74a-ab524dcc9a4f None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:03.181076 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:03.184767 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c3982-6fe3-49c1-a74a-ab524dcc9a4f None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:03.227644 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe10ba7-7b28-4faf-aaae-d2523278d14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:03.228586 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe10ba7-7b28-4faf-aaae-d2523278d14a None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:03.228863 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe10ba7-7b28-4faf-aaae-d2523278d14a None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:03.229136 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe10ba7-7b28-4faf-aaae-d2523278d14a None admin] PATH_INFO: `/v3/groups/564822e2a0ae45789218c020f51b29a2` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:03.230362 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe10ba7-7b28-4faf-aaae-d2523278d14a None admin] RBAC: Authorizing `identity:get_group(group_id=564822e2a0ae45789218c020f51b29a2)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:03.231781 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe10ba7-7b28-4faf-aaae-d2523278d14a None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:03.233613 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 203/399] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Jun 27 09:15:03 2022] GET /identity/v3/groups/564822e2a0ae45789218c020f51b29a2 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:03.239079 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c035252-c693-4e8a-9b62-61dd0a8a1caa None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:03.302676 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:03.346631 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c035252-c693-4e8a-9b62-61dd0a8a1caa None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:03.354959 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155034f-f87b-4a4d-883e-11cb3754c11c None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:03.355554 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155034f-f87b-4a4d-883e-11cb3754c11c None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:03.356043 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155034f-f87b-4a4d-883e-11cb3754c11c None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:03.357962 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 204/400] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 09:15:03.363242 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62107764-5e2d-4f82-889b-514859488181 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:03.363784 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62107764-5e2d-4f82-889b-514859488181 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:03.364303 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62107764-5e2d-4f82-889b-514859488181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:03.389671 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-62107764-5e2d-4f82-889b-514859488181 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:03.391169 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25479e18-e344-4459-af61-2a90dcee8c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:03.391603 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-62107764-5e2d-4f82-889b-514859488181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:03.392052 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25479e18-e344-4459-af61-2a90dcee8c81 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:03.392382 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25479e18-e344-4459-af61-2a90dcee8c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:03.392662 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25479e18-e344-4459-af61-2a90dcee8c81 None admin] PATH_INFO: `/v3/projects/7ef24b891e2145d0ac96f35d4f4c385f` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:03.393951 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25479e18-e344-4459-af61-2a90dcee8c81 None admin] RBAC: Authorizing `identity:get_project(project_id=7ef24b891e2145d0ac96f35d4f4c385f)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:03.395403 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25479e18-e344-4459-af61-2a90dcee8c81 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:03.397870 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 197/401] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:15:03 2022] GET /identity/v3/projects/7ef24b891e2145d0ac96f35d4f4c385f => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:03.403568 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25479e18-e344-4459-af61-2a90dcee8c81 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:03.475689 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 205/402] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 09:15:03.503512 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62107764-5e2d-4f82-889b-514859488181 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:03.512887 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25479e18-e344-4459-af61-2a90dcee8c81 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:03.540997 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:03.550042 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a78743-b7cd-4d16-852d-d2cfdf231a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:03.550932 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a78743-b7cd-4d16-852d-d2cfdf231a05 None admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:03.566042 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a78743-b7cd-4d16-852d-d2cfdf231a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:03.566042 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a78743-b7cd-4d16-852d-d2cfdf231a05 None admin] PATH_INFO: `/v3/projects/7ef24b891e2145d0ac96f35d4f4c385f/groups/564822e2a0ae45789218c020f51b29a2/roles/b137366eb53b42aab629a88be737eaf9` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:03.566042 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a78743-b7cd-4d16-852d-d2cfdf231a05 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ef24b891e2145d0ac96f35d4f4c385f, group_id=564822e2a0ae45789218c020f51b29a2, role_id=b137366eb53b42aab629a88be737eaf9)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:03.566042 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a78743-b7cd-4d16-852d-d2cfdf231a05 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:03.625987 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:03.631128 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62107764-5e2d-4f82-889b-514859488181 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:03.667063 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e6cd81-bbe1-4f74-994d-e8ef65610bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:03.667874 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6cd81-bbe1-4f74-994d-e8ef65610bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:03.668157 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6cd81-bbe1-4f74-994d-e8ef65610bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:03.668456 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6cd81-bbe1-4f74-994d-e8ef65610bb1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:03.679193 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e6cd81-bbe1-4f74-994d-e8ef65610bb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:15:03.688044 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-f8e6cd81-bbe1-4f74-994d-e8ef65610bb1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 09:15:03.688044 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:03.688044 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:03.688044 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:03.688044 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:03.688044 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:03.688044 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:03.688044 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:03.688044 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:03.688044 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:03.688044 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:03.688044 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:03.688044 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:15:03.688044 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:15:03.688044 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:15:03.688044 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:15:03.689055 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:15:03.689055 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:15:03.689055 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:15:03.689055 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:15:03.689055 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:03.689055 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:03.689055 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:03.689055 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:03.689055 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:03.689055 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:03.689055 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:03.689055 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:03.689055 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:03.689055 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:03.689055 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:03.689055 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:03.690312 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:03.690312 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:03.690312 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:03.690312 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:03.690312 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:15:03.690312 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:15:03.690312 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:15:03.690312 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:15:03.690312 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:15:03.690312 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:15:03.690312 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 09:15:03.690312 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:03.690312 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 206/403] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Jun 27 09:15:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:03.690994 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b36350-51a8-46cf-adf8-b4e63171cc8c None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:03.691330 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b36350-51a8-46cf-adf8-b4e63171cc8c None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:03.691330 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b36350-51a8-46cf-adf8-b4e63171cc8c None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:03.694468 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 207/404] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:15:03.700034 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b36350-51a8-46cf-adf8-b4e63171cc8c None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:03.719307 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 198/405] 10.222.0.62 () {58 vars in 1442 bytes} [Mon Jun 27 09:15:03 2022] PUT /identity/v3/projects/7ef24b891e2145d0ac96f35d4f4c385f/groups/564822e2a0ae45789218c020f51b29a2/roles/b137366eb53b42aab629a88be737eaf9 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:15:03.721771 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5fd553-5fe7-4e4a-b1fc-e3f757bdfe07 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:03.721771 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5fd553-5fe7-4e4a-b1fc-e3f757bdfe07 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:03.721771 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5fd553-5fe7-4e4a-b1fc-e3f757bdfe07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:03.754522 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-6f5fd553-5fe7-4e4a-b1fc-e3f757bdfe07 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:03.756317 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-6f5fd553-5fe7-4e4a-b1fc-e3f757bdfe07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:03.898060 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b36350-51a8-46cf-adf8-b4e63171cc8c None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:03.903080 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 199/406] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:15:03.931092 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5fd553-5fe7-4e4a-b1fc-e3f757bdfe07 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:03.939337 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23d503e-c6c3-43c0-ac81-de7362159ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:03.940001 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d503e-c6c3-43c0-ac81-de7362159ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:03.940308 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d503e-c6c3-43c0-ac81-de7362159ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:03.940882 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d503e-c6c3-43c0-ac81-de7362159ad0 None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:03.941430 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23d503e-c6c3-43c0-ac81-de7362159ad0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:03.941737 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23d503e-c6c3-43c0-ac81-de7362159ad0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:03.943920 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23d503e-c6c3-43c0-ac81-de7362159ad0 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:03.957664 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 208/407] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:15:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:03.959100 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23d503e-c6c3-43c0-ac81-de7362159ad0 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:03.988621 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:04.067639 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5fd553-5fe7-4e4a-b1fc-e3f757bdfe07 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:04.104558 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:04.136702 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23d503e-c6c3-43c0-ac81-de7362159ad0 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:04.157958 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae03292-cdc9-420c-afcf-c1cc6a976228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:04.158735 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae03292-cdc9-420c-afcf-c1cc6a976228 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:04.159028 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae03292-cdc9-420c-afcf-c1cc6a976228 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:04.159308 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae03292-cdc9-420c-afcf-c1cc6a976228 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:04.178628 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e9310-de29-4ceb-9bcf-76b8a3646db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:04.180446 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e9310-de29-4ceb-9bcf-76b8a3646db7 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:04.181541 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e9310-de29-4ceb-9bcf-76b8a3646db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:04.182268 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e9310-de29-4ceb-9bcf-76b8a3646db7 None admin] PATH_INFO: `/v3/groups/564822e2a0ae45789218c020f51b29a2` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:04.184798 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45e9310-de29-4ceb-9bcf-76b8a3646db7 None admin] RBAC: Authorizing `identity:get_group(group_id=564822e2a0ae45789218c020f51b29a2)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:04.185209 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae03292-cdc9-420c-afcf-c1cc6a976228 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:15:04.187585 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45e9310-de29-4ceb-9bcf-76b8a3646db7 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:04.190433 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 209/408] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Jun 27 09:15:03 2022] GET /identity/v3/groups/564822e2a0ae45789218c020f51b29a2 => generated 226 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:15:04.200233 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e9310-de29-4ceb-9bcf-76b8a3646db7 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:04.201743 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-9ae03292-cdc9-420c-afcf-c1cc6a976228 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:15:04.201743 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:04.201743 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:04.201743 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:04.201743 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:04.201743 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:04.201743 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:04.201743 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:04.201743 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:04.201743 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:04.201743 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:04.201743 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:04.201743 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:15:04.201743 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:15:04.201743 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:15:04.201743 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:15:04.202607 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:15:04.202607 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:15:04.202607 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:15:04.202607 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:15:04.202607 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:04.202607 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:04.202607 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:04.202607 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:04.202607 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:04.202607 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:04.202607 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:04.202607 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:04.202607 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:04.202607 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:04.202607 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:04.202607 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:04.203575 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:04.203575 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:04.203575 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:04.203575 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:04.203575 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:15:04.203575 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:15:04.203575 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:15:04.203575 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:15:04.203575 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:15:04.203575 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:15:04.203575 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:15:04.203575 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:04.203575 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 200/409] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Jun 27 09:15:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:04.211168 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae03292-cdc9-420c-afcf-c1cc6a976228 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:04.313376 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e9310-de29-4ceb-9bcf-76b8a3646db7 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:04.340113 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:04.350106 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc5916d-ace0-422a-b544-49321f0996eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:04.351266 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5916d-ace0-422a-b544-49321f0996eb None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:04.351740 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5916d-ace0-422a-b544-49321f0996eb None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:04.352234 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5916d-ace0-422a-b544-49321f0996eb None admin] PATH_INFO: `/v3/projects/7f845d06024f4ea9b859e6d0dcef1534` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:04.353678 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc5916d-ace0-422a-b544-49321f0996eb None admin] RBAC: Authorizing `identity:get_project(project_id=7f845d06024f4ea9b859e6d0dcef1534)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:04.355409 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc5916d-ace0-422a-b544-49321f0996eb None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:04.362101 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 210/410] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:15:04 2022] GET /identity/v3/projects/7f845d06024f4ea9b859e6d0dcef1534 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:04.363298 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc5916d-ace0-422a-b544-49321f0996eb None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:04.469555 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae03292-cdc9-420c-afcf-c1cc6a976228 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:04.487423 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc5916d-ace0-422a-b544-49321f0996eb None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:04.504166 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2293bbd-42d3-4ebb-a9cb-6d09087595bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:04.504986 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2293bbd-42d3-4ebb-a9cb-6d09087595bb None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:04.505276 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2293bbd-42d3-4ebb-a9cb-6d09087595bb None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:04.506083 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2293bbd-42d3-4ebb-a9cb-6d09087595bb None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:04.506840 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2293bbd-42d3-4ebb-a9cb-6d09087595bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:04.507150 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2293bbd-42d3-4ebb-a9cb-6d09087595bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:04.508684 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2293bbd-42d3-4ebb-a9cb-6d09087595bb None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:04.518247 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 201/411] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:15:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:04.519621 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865cff8-7668-4142-9c69-95558d8eee3d None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:04.519955 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865cff8-7668-4142-9c69-95558d8eee3d None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:04.520210 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865cff8-7668-4142-9c69-95558d8eee3d None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:04.522193 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 202/412] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:15:04.523203 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ff71d-6b50-43fa-8a7a-68c7e8e56124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:04.524091 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ff71d-6b50-43fa-8a7a-68c7e8e56124 None admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:04.524412 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ff71d-6b50-43fa-8a7a-68c7e8e56124 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:04.524684 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ff71d-6b50-43fa-8a7a-68c7e8e56124 None admin] PATH_INFO: `/v3/projects/7f845d06024f4ea9b859e6d0dcef1534/groups/564822e2a0ae45789218c020f51b29a2/roles/b137366eb53b42aab629a88be737eaf9` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:04.526932 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865cff8-7668-4142-9c69-95558d8eee3d None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:04.527183 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ff71d-6b50-43fa-8a7a-68c7e8e56124 None admin] RBAC: Authorizing `identity:create_grant(project_id=7f845d06024f4ea9b859e6d0dcef1534, group_id=564822e2a0ae45789218c020f51b29a2, role_id=b137366eb53b42aab629a88be737eaf9)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:04.529086 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ff71d-6b50-43fa-8a7a-68c7e8e56124 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:04.571033 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:04.617277 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 211/413] 10.222.0.62 () {58 vars in 1442 bytes} [Mon Jun 27 09:15:04 2022] PUT /identity/v3/projects/7f845d06024f4ea9b859e6d0dcef1534/groups/564822e2a0ae45789218c020f51b29a2/roles/b137366eb53b42aab629a88be737eaf9 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:15:04.618167 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58759ba7-bd24-4e6a-9bed-64276d1b1823 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:04.618285 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58759ba7-bd24-4e6a-9bed-64276d1b1823 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:04.618878 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58759ba7-bd24-4e6a-9bed-64276d1b1823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:04.654681 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-58759ba7-bd24-4e6a-9bed-64276d1b1823 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:04.656212 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-58759ba7-bd24-4e6a-9bed-64276d1b1823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:04.665364 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865cff8-7668-4142-9c69-95558d8eee3d None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:04.683944 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:04.744794 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c6ab4-f3ea-41ff-b8b2-49ddb2dda289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:04.745651 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c6ab4-f3ea-41ff-b8b2-49ddb2dda289 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:04.745933 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c6ab4-f3ea-41ff-b8b2-49ddb2dda289 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:04.746259 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c6ab4-f3ea-41ff-b8b2-49ddb2dda289 None admin] PATH_INFO: `/v3/groups/89b16be432ea438aa0c0019613248a2a` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:04.747522 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72c6ab4-f3ea-41ff-b8b2-49ddb2dda289 None admin] RBAC: Authorizing `identity:get_group(group_id=89b16be432ea438aa0c0019613248a2a)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:04.749084 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72c6ab4-f3ea-41ff-b8b2-49ddb2dda289 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:04.751108 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 203/414] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Jun 27 09:15:04 2022] GET /identity/v3/groups/89b16be432ea438aa0c0019613248a2a => generated 229 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:04.756813 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c6ab4-f3ea-41ff-b8b2-49ddb2dda289 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:04.816473 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 212/415] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:15:04.845514 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58759ba7-bd24-4e6a-9bed-64276d1b1823 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:04.901909 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c6ab4-f3ea-41ff-b8b2-49ddb2dda289 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:04.911152 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:04.952065 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67e20e-48c4-40bb-93a2-566cb68d99ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:04.952957 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67e20e-48c4-40bb-93a2-566cb68d99ce None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:04.953241 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67e20e-48c4-40bb-93a2-566cb68d99ce None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:04.953511 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67e20e-48c4-40bb-93a2-566cb68d99ce None admin] PATH_INFO: `/v3/projects/22d0a8f6bf9e4c98ba20a328083165ac` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:04.957834 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f67e20e-48c4-40bb-93a2-566cb68d99ce None admin] RBAC: Authorizing `identity:get_project(project_id=22d0a8f6bf9e4c98ba20a328083165ac)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:04.959332 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f67e20e-48c4-40bb-93a2-566cb68d99ce None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:04.962553 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 204/416] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:15:04 2022] GET /identity/v3/projects/22d0a8f6bf9e4c98ba20a328083165ac => generated 344 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:04.966658 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67e20e-48c4-40bb-93a2-566cb68d99ce None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:04.981129 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58759ba7-bd24-4e6a-9bed-64276d1b1823 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:05.049986 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f4e66-adeb-427a-9b30-f46beaa9057e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:05.050833 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f4e66-adeb-427a-9b30-f46beaa9057e None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:05.051113 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f4e66-adeb-427a-9b30-f46beaa9057e None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:05.051383 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f4e66-adeb-427a-9b30-f46beaa9057e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:05.067386 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f4e66-adeb-427a-9b30-f46beaa9057e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:15:05.076011 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-bf6f4e66-adeb-427a-9b30-f46beaa9057e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 09:15:05.076011 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:05.076011 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:05.076011 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:05.076011 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:05.076011 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:05.076011 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:05.076011 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:05.076011 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:05.076011 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:05.076011 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:05.076011 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:05.076011 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:15:05.076011 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:15:05.076011 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:15:05.076011 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:15:05.076989 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:15:05.076989 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:15:05.076989 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:15:05.076989 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:15:05.076989 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:05.076989 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:05.076989 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:05.076989 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:05.076989 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:05.076989 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:05.076989 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:05.076989 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:05.076989 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:05.076989 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:05.076989 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:05.076989 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:05.077788 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:05.077788 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:05.077788 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:05.077788 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:05.077788 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:15:05.077788 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:15:05.077788 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:15:05.077788 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:15:05.077788 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:15:05.077788 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:15:05.077788 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 09:15:05.077788 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:05.077788 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 213/417] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:15:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 09:15:05.078992 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e52ab-2453-442d-a1e8-69b965bb74c2 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:05.079269 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e52ab-2453-442d-a1e8-69b965bb74c2 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:05.079602 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e52ab-2453-442d-a1e8-69b965bb74c2 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:05.081161 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 214/418] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:15:05.085989 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e52ab-2453-442d-a1e8-69b965bb74c2 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:05.098032 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:05.123064 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67e20e-48c4-40bb-93a2-566cb68d99ce None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:05.168932 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52cb11-52bf-4741-8543-a726e1b2398f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:05.170122 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52cb11-52bf-4741-8543-a726e1b2398f None admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:05.170457 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52cb11-52bf-4741-8543-a726e1b2398f None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:05.170736 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52cb11-52bf-4741-8543-a726e1b2398f None admin] PATH_INFO: `/v3/projects/22d0a8f6bf9e4c98ba20a328083165ac/groups/89b16be432ea438aa0c0019613248a2a/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:05.173529 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc52cb11-52bf-4741-8543-a726e1b2398f None admin] RBAC: Authorizing `identity:create_grant(project_id=22d0a8f6bf9e4c98ba20a328083165ac, group_id=89b16be432ea438aa0c0019613248a2a, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:05.174986 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc52cb11-52bf-4741-8543-a726e1b2398f None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:05.214117 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e52ab-2453-442d-a1e8-69b965bb74c2 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:05.252084 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780fd327-c668-4150-ae00-4a3dcaa75420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:05.252873 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780fd327-c668-4150-ae00-4a3dcaa75420 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:05.253153 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780fd327-c668-4150-ae00-4a3dcaa75420 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:05.253424 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780fd327-c668-4150-ae00-4a3dcaa75420 None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:05.254077 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 205/419] 10.222.0.62 () {58 vars in 1442 bytes} [Mon Jun 27 09:15:04 2022] PUT /identity/v3/projects/22d0a8f6bf9e4c98ba20a328083165ac/groups/89b16be432ea438aa0c0019613248a2a/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:15:05.254184 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780fd327-c668-4150-ae00-4a3dcaa75420 None admin] RBAC: Adding query filter params (name=member) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:05.254462 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780fd327-c668-4150-ae00-4a3dcaa75420 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:05.255901 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780fd327-c668-4150-ae00-4a3dcaa75420 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:05.256123 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091b97d-26a6-430a-a216-af52b464ccd3 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:05.256620 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091b97d-26a6-430a-a216-af52b464ccd3 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:05.257088 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091b97d-26a6-430a-a216-af52b464ccd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:05.277231 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-e091b97d-26a6-430a-a216-af52b464ccd3 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:05.281912 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-e091b97d-26a6-430a-a216-af52b464ccd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:05.282069 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 215/420] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Jun 27 09:15:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:05.295024 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780fd327-c668-4150-ae00-4a3dcaa75420 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:05.324844 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:05.370941 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 206/421] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:15:05.413998 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091b97d-26a6-430a-a216-af52b464ccd3 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:05.441517 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:05.484141 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780fd327-c668-4150-ae00-4a3dcaa75420 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:05.524085 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432f0b0-536e-4939-84dd-017c509db052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:05.525597 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432f0b0-536e-4939-84dd-017c509db052 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:05.526072 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432f0b0-536e-4939-84dd-017c509db052 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:05.526589 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432f0b0-536e-4939-84dd-017c509db052 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:05.538375 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091b97d-26a6-430a-a216-af52b464ccd3 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:05.575433 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e8b56-7d2b-41b3-b986-e67f310c88e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:05.575943 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e8b56-7d2b-41b3-b986-e67f310c88e2 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:05.576254 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e8b56-7d2b-41b3-b986-e67f310c88e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:05.576533 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e8b56-7d2b-41b3-b986-e67f310c88e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:05.587810 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926e8b56-7d2b-41b3-b986-e67f310c88e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:15:05.595657 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-926e8b56-7d2b-41b3-b986-e67f310c88e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 09:15:05.595657 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:05.595657 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:05.595657 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:05.595657 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:05.595657 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:05.595657 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:05.595657 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:05.595657 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:05.595657 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:05.595657 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:05.595657 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:05.595657 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:15:05.595657 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:15:05.595657 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:15:05.595657 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:15:05.596552 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:15:05.596552 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:15:05.596552 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:15:05.596552 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:15:05.596552 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:05.596552 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:05.596552 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:05.596552 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:05.596552 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:05.596552 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:05.596552 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:05.596552 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:05.596552 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:05.596552 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:05.596552 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:05.596552 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:05.597420 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:05.597420 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:05.597420 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:05.597420 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:05.597420 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:15:05.597420 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:15:05.597420 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:15:05.597420 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:15:05.597420 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:15:05.597420 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:15:05.597420 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 09:15:05.597420 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:05.597420 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 207/422] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:15:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 09:15:05.605420 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e8b56-7d2b-41b3-b986-e67f310c88e2 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:05.612577 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f432f0b0-536e-4939-84dd-017c509db052 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:05.614291 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f432f0b0-536e-4939-84dd-017c509db052 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:05.648939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:05.687837 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:05.725503 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 216/423] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:15:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 27 09:15:05.730903 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432f0b0-536e-4939-84dd-017c509db052 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:05.774010 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e8b56-7d2b-41b3-b986-e67f310c88e2 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:05.814438 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e26e9-a2e7-4fce-be1c-4b17e2bfb01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:05.815461 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e26e9-a2e7-4fce-be1c-4b17e2bfb01b None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:05.815957 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e26e9-a2e7-4fce-be1c-4b17e2bfb01b None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:05.816461 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e26e9-a2e7-4fce-be1c-4b17e2bfb01b None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:05.817422 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e26e9-a2e7-4fce-be1c-4b17e2bfb01b None admin] RBAC: Adding query filter params (name=member) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:05.818991 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e26e9-a2e7-4fce-be1c-4b17e2bfb01b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:05.820679 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e26e9-a2e7-4fce-be1c-4b17e2bfb01b None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:05.830915 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 208/424] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Jun 27 09:15:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:05.838494 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e26e9-a2e7-4fce-be1c-4b17e2bfb01b None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:05.928505 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432f0b0-536e-4939-84dd-017c509db052 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:05.996318 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:06.014012 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e26e9-a2e7-4fce-be1c-4b17e2bfb01b None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:06.019228 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a222e-a47a-4a48-9b51-39e53f69e5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:06.020126 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a222e-a47a-4a48-9b51-39e53f69e5e5 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:06.020438 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a222e-a47a-4a48-9b51-39e53f69e5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:06.023967 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a222e-a47a-4a48-9b51-39e53f69e5e5 None admin] PATH_INFO: `/v3/projects/7ef24b891e2145d0ac96f35d4f4c385f` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:06.023967 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12a222e-a47a-4a48-9b51-39e53f69e5e5 None admin] RBAC: Authorizing `identity:get_project(project_id=7ef24b891e2145d0ac96f35d4f4c385f)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:06.023967 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12a222e-a47a-4a48-9b51-39e53f69e5e5 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:06.025788 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 217/425] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:15:05 2022] GET /identity/v3/projects/7ef24b891e2145d0ac96f35d4f4c385f => generated 298 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:06.033524 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a222e-a47a-4a48-9b51-39e53f69e5e5 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:06.057913 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0def7cf-f8d4-4cde-81a9-96da13b953dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:06.059115 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0def7cf-f8d4-4cde-81a9-96da13b953dc None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:06.059400 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0def7cf-f8d4-4cde-81a9-96da13b953dc None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:06.060120 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0def7cf-f8d4-4cde-81a9-96da13b953dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:06.119027 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:06.145318 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0def7cf-f8d4-4cde-81a9-96da13b953dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:06.149252 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0def7cf-f8d4-4cde-81a9-96da13b953dc None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:06.244351 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a222e-a47a-4a48-9b51-39e53f69e5e5 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:06.251053 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:06.271623 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 209/426] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:15:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 09:15:06.273244 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e58dd-dae1-48b5-8624-13bc79c62ff9 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:06.273563 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e58dd-dae1-48b5-8624-13bc79c62ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:06.273960 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e58dd-dae1-48b5-8624-13bc79c62ff9 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:06.279994 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 210/427] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:15:06.279994 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e58dd-dae1-48b5-8624-13bc79c62ff9 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:06.287604 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bbbf1a-d987-4c6f-a111-9a14391b8031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:06.289363 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbbf1a-d987-4c6f-a111-9a14391b8031 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:06.289837 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbbf1a-d987-4c6f-a111-9a14391b8031 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:06.290301 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbbf1a-d987-4c6f-a111-9a14391b8031 None admin] PATH_INFO: `/v3/groups/564822e2a0ae45789218c020f51b29a2` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:06.291738 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bbbf1a-d987-4c6f-a111-9a14391b8031 None admin] RBAC: Authorizing `identity:get_group(group_id=564822e2a0ae45789218c020f51b29a2)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:06.293443 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bbbf1a-d987-4c6f-a111-9a14391b8031 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:06.295728 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 218/428] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Jun 27 09:15:06 2022] GET /identity/v3/groups/564822e2a0ae45789218c020f51b29a2 => generated 226 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:15:06.297099 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5c5d1-0d86-42fe-978a-b1b8777c6737 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:06.297576 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5c5d1-0d86-42fe-978a-b1b8777c6737 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:06.298119 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5c5d1-0d86-42fe-978a-b1b8777c6737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:06.319108 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-f7c5c5d1-0d86-42fe-978a-b1b8777c6737 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:06.320633 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-f7c5c5d1-0d86-42fe-978a-b1b8777c6737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:06.404318 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 219/429] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:15:06.404318 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5c5d1-0d86-42fe-978a-b1b8777c6737 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:06.430084 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e58dd-dae1-48b5-8624-13bc79c62ff9 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:06.435517 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:06.471751 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7eb00-db1c-4736-8e48-ee5d41988194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:06.473048 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7eb00-db1c-4736-8e48-ee5d41988194 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:06.473529 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7eb00-db1c-4736-8e48-ee5d41988194 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:06.473996 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7eb00-db1c-4736-8e48-ee5d41988194 None admin] PATH_INFO: `/v3/projects/7f845d06024f4ea9b859e6d0dcef1534` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:06.476007 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad7eb00-db1c-4736-8e48-ee5d41988194 None admin] RBAC: Authorizing `identity:get_project(project_id=7f845d06024f4ea9b859e6d0dcef1534)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:06.477726 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad7eb00-db1c-4736-8e48-ee5d41988194 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:06.480068 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 211/430] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:15:06 2022] GET /identity/v3/projects/7f845d06024f4ea9b859e6d0dcef1534 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:06.481169 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7eb00-db1c-4736-8e48-ee5d41988194 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:06.509728 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5c5d1-0d86-42fe-978a-b1b8777c6737 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:06.541413 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:06.549104 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047e817-852c-4ca7-81bc-eb7d66088649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:06.549724 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047e817-852c-4ca7-81bc-eb7d66088649 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:06.549926 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047e817-852c-4ca7-81bc-eb7d66088649 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:06.550201 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047e817-852c-4ca7-81bc-eb7d66088649 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:06.551029 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4047e817-852c-4ca7-81bc-eb7d66088649 None admin] RBAC: Adding query filter params (group.id=564822e2a0ae45789218c020f51b29a2, role.id=b1260d153ca7497eaaaa0991f053ff89, scope.project.id=7ef24b891e2145d0ac96f35d4f4c385f) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:06.554803 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4047e817-852c-4ca7-81bc-eb7d66088649 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:06.554803 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4047e817-852c-4ca7-81bc-eb7d66088649 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:06.560229 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 220/431] 10.222.0.62 () {56 vars in 1376 bytes} [Mon Jun 27 09:15:06 2022] GET /identity/v3/role_assignments?group.id=564822e2a0ae45789218c020f51b29a2&scope.project.id=7ef24b891e2145d0ac96f35d4f4c385f&role.id=b1260d153ca7497eaaaa0991f053ff89 => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:06.568820 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047e817-852c-4ca7-81bc-eb7d66088649 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:06.593781 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7eb00-db1c-4736-8e48-ee5d41988194 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:06.635184 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26828970-a35b-4d2d-b47a-d13a40d93d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:06.636400 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26828970-a35b-4d2d-b47a-d13a40d93d27 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:06.636875 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26828970-a35b-4d2d-b47a-d13a40d93d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:06.637360 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26828970-a35b-4d2d-b47a-d13a40d93d27 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:06.650214 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26828970-a35b-4d2d-b47a-d13a40d93d27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:15:06.659592 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-26828970-a35b-4d2d-b47a-d13a40d93d27 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 09:15:06.659592 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:06.659592 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:06.659592 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:06.659592 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:06.659592 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:06.659592 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:06.659592 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:06.659592 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:06.659592 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:06.659592 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:06.659592 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:06.659592 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:15:06.659592 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:15:06.659592 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:15:06.659592 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:15:06.660518 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:15:06.660518 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:15:06.660518 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:15:06.660518 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:15:06.660518 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:06.660518 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:06.660518 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:06.660518 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:06.660518 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:06.660518 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:06.660518 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:06.660518 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:06.660518 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:06.660518 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:06.660518 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:06.660518 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:06.661339 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:06.661339 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:06.661339 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:06.661339 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:06.661339 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:15:06.661339 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:15:06.661339 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:15:06.661339 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:15:06.661339 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:15:06.661339 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:15:06.661339 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 09:15:06.661339 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:06.664557 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 212/432] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Jun 27 09:15:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:06.670323 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26828970-a35b-4d2d-b47a-d13a40d93d27 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:06.766136 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:06.780894 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26828970-a35b-4d2d-b47a-d13a40d93d27 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:06.781120 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047e817-852c-4ca7-81bc-eb7d66088649 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:06.804616 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:06.826607 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99be73-49a7-4c07-8937-189697a790fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:06.827674 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99be73-49a7-4c07-8937-189697a790fc None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:06.828247 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99be73-49a7-4c07-8937-189697a790fc None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:06.829544 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99be73-49a7-4c07-8937-189697a790fc None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:06.830522 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da99be73-49a7-4c07-8937-189697a790fc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:06.831154 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da99be73-49a7-4c07-8937-189697a790fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:06.835949 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da99be73-49a7-4c07-8937-189697a790fc None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:06.851689 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 213/433] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:15:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:15:06.859201 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99be73-49a7-4c07-8937-189697a790fc None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:06.865730 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccf0fd-4658-4672-8d02-c4d4c39b02d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:06.866812 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccf0fd-4658-4672-8d02-c4d4c39b02d2 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:06.867262 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccf0fd-4658-4672-8d02-c4d4c39b02d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:06.867725 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccf0fd-4658-4672-8d02-c4d4c39b02d2 None admin] PATH_INFO: `/v3/groups/564822e2a0ae45789218c020f51b29a2` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:06.869101 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cccf0fd-4658-4672-8d02-c4d4c39b02d2 None admin] RBAC: Authorizing `identity:get_group(group_id=564822e2a0ae45789218c020f51b29a2)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:06.870694 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cccf0fd-4658-4672-8d02-c4d4c39b02d2 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:06.872915 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 221/434] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Jun 27 09:15:06 2022] GET /identity/v3/groups/564822e2a0ae45789218c020f51b29a2 => generated 226 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:06.878314 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccf0fd-4658-4672-8d02-c4d4c39b02d2 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:06.991872 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99be73-49a7-4c07-8937-189697a790fc None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:07.007129 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccf0fd-4658-4672-8d02-c4d4c39b02d2 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:07.034848 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15e458-cd07-4272-a492-e87c9e3c44d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:07.035822 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15e458-cd07-4272-a492-e87c9e3c44d3 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:07.036315 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15e458-cd07-4272-a492-e87c9e3c44d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:07.037383 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15e458-cd07-4272-a492-e87c9e3c44d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:07.050744 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3b0c8-a5fa-43d3-aae2-39c159de2150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:07.051596 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3b0c8-a5fa-43d3-aae2-39c159de2150 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:07.051948 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3b0c8-a5fa-43d3-aae2-39c159de2150 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:07.052399 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3b0c8-a5fa-43d3-aae2-39c159de2150 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:07.053309 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3b0c8-a5fa-43d3-aae2-39c159de2150 None admin] RBAC: Adding query filter params (group.id=564822e2a0ae45789218c020f51b29a2, role.id=b1260d153ca7497eaaaa0991f053ff89, scope.project.id=7f845d06024f4ea9b859e6d0dcef1534) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:07.053691 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3b0c8-a5fa-43d3-aae2-39c159de2150 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:07.055301 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3b0c8-a5fa-43d3-aae2-39c159de2150 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:07.064218 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 222/435] 10.222.0.62 () {56 vars in 1376 bytes} [Mon Jun 27 09:15:06 2022] GET /identity/v3/role_assignments?group.id=564822e2a0ae45789218c020f51b29a2&scope.project.id=7f845d06024f4ea9b859e6d0dcef1534&role.id=b1260d153ca7497eaaaa0991f053ff89 => generated 611 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:07.094704 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d24474-fd88-45eb-8246-a7968017d7ea None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:07.095070 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d24474-fd88-45eb-8246-a7968017d7ea None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:07.095257 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d24474-fd88-45eb-8246-a7968017d7ea None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:07.096995 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 223/436] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 09:15:07.105738 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9db76-132f-49b1-bd9a-9ad8ec67b18a None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:07.106531 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9db76-132f-49b1-bd9a-9ad8ec67b18a None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:07.106531 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9db76-132f-49b1-bd9a-9ad8ec67b18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:07.114539 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:07.136248 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-abb9db76-132f-49b1-bd9a-9ad8ec67b18a None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:07.137881 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-abb9db76-132f-49b1-bd9a-9ad8ec67b18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:07.143423 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d15e458-cd07-4272-a492-e87c9e3c44d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:07.144269 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d15e458-cd07-4272-a492-e87c9e3c44d3 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:07.188562 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:07.252060 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 224/437] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:15:07.277930 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb9db76-132f-49b1-bd9a-9ad8ec67b18a None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:07.290139 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 214/438] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:15:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 09:15:07.295862 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15e458-cd07-4272-a492-e87c9e3c44d3 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:07.383909 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:07.413960 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb9db76-132f-49b1-bd9a-9ad8ec67b18a None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:07.422377 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15e458-cd07-4272-a492-e87c9e3c44d3 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:07.456751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977d3d8-58ae-407a-bd29-c30163e7e7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:07.457918 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977d3d8-58ae-407a-bd29-c30163e7e7c3 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:07.458405 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977d3d8-58ae-407a-bd29-c30163e7e7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:07.459318 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977d3d8-58ae-407a-bd29-c30163e7e7c3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:07.462090 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76ff01-1f23-4f8b-b70b-2039dc01e32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:07.462943 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76ff01-1f23-4f8b-b70b-2039dc01e32d None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:07.463222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76ff01-1f23-4f8b-b70b-2039dc01e32d None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:07.463492 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76ff01-1f23-4f8b-b70b-2039dc01e32d None admin] PATH_INFO: `/v3/projects/7ef24b891e2145d0ac96f35d4f4c385f` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:07.464724 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed76ff01-1f23-4f8b-b70b-2039dc01e32d None admin] RBAC: Authorizing `identity:get_project(project_id=7ef24b891e2145d0ac96f35d4f4c385f)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:07.466172 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed76ff01-1f23-4f8b-b70b-2039dc01e32d None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:07.467902 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 215/439] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:15:07 2022] GET /identity/v3/projects/7ef24b891e2145d0ac96f35d4f4c385f => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:15:07.471766 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d977d3d8-58ae-407a-bd29-c30163e7e7c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:15:07.473359 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76ff01-1f23-4f8b-b70b-2039dc01e32d None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:07.479304 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-d977d3d8-58ae-407a-bd29-c30163e7e7c3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 09:15:07.479304 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:07.479304 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:07.479304 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:07.479304 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:07.479304 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:07.479304 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:07.479304 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:07.479304 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:07.479304 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:07.479304 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:07.479304 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:07.479304 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:15:07.479304 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:15:07.479304 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:15:07.479304 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:15:07.480278 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:15:07.480278 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:15:07.480278 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:15:07.480278 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:15:07.480278 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:07.480278 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:07.480278 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:07.480278 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:07.480278 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:07.480278 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:07.480278 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:07.480278 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:07.480278 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:07.480278 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:07.480278 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:07.480278 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:07.481092 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:07.481092 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:07.481092 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:07.481092 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:07.481092 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:15:07.481092 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:15:07.481092 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:15:07.481092 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:15:07.481092 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:15:07.481092 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:15:07.481092 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 09:15:07.481092 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:07.488218 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 225/440] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Jun 27 09:15:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 09:15:07.488218 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977d3d8-58ae-407a-bd29-c30163e7e7c3 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:07.512727 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:07.586156 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76ff01-1f23-4f8b-b70b-2039dc01e32d None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:07.593341 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977d3d8-58ae-407a-bd29-c30163e7e7c3 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:07.622368 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c0fef-1b02-49f9-9bea-4cb0789216d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:07.623227 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c0fef-1b02-49f9-9bea-4cb0789216d3 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:07.623514 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c0fef-1b02-49f9-9bea-4cb0789216d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:07.623790 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c0fef-1b02-49f9-9bea-4cb0789216d3 None admin] PATH_INFO: `/v3/groups/564822e2a0ae45789218c020f51b29a2` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:07.625006 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c0fef-1b02-49f9-9bea-4cb0789216d3 None admin] RBAC: Authorizing `identity:get_group(group_id=564822e2a0ae45789218c020f51b29a2)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:07.626438 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c0fef-1b02-49f9-9bea-4cb0789216d3 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:07.628054 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 216/441] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Jun 27 09:15:07 2022] GET /identity/v3/groups/564822e2a0ae45789218c020f51b29a2 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:15:07.628387 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee9032-eca6-4f62-a471-7a39d2539fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:07.629104 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee9032-eca6-4f62-a471-7a39d2539fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:07.629268 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e7e92-d335-4c8b-a528-6adb45f574d8 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:07.629422 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee9032-eca6-4f62-a471-7a39d2539fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:07.629511 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e7e92-d335-4c8b-a528-6adb45f574d8 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:07.629683 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee9032-eca6-4f62-a471-7a39d2539fc7 None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:07.629781 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e7e92-d335-4c8b-a528-6adb45f574d8 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:07.630910 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee9032-eca6-4f62-a471-7a39d2539fc7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:07.631212 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee9032-eca6-4f62-a471-7a39d2539fc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:07.631616 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 217/442] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:15:07.632725 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee9032-eca6-4f62-a471-7a39d2539fc7 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:07.636135 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e7e92-d335-4c8b-a528-6adb45f574d8 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:07.645406 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 226/443] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:15:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:15:07.645406 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c7e54-4a65-4563-b289-25bc6869d3e9 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:07.645406 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c7e54-4a65-4563-b289-25bc6869d3e9 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:07.645406 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c7e54-4a65-4563-b289-25bc6869d3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:07.651599 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:07.661429 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-b96c7e54-4a65-4563-b289-25bc6869d3e9 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:07.662644 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-b96c7e54-4a65-4563-b289-25bc6869d3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:07.728347 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 227/444] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:15:07.729197 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c7e54-4a65-4563-b289-25bc6869d3e9 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:07.744603 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:07.746300 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e7e92-d335-4c8b-a528-6adb45f574d8 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:07.782561 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2cf2e-b047-4534-a47a-1957e0157be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:07.783212 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2cf2e-b047-4534-a47a-1957e0157be5 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:07.783486 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2cf2e-b047-4534-a47a-1957e0157be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:07.783756 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2cf2e-b047-4534-a47a-1957e0157be5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:07.784611 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e2cf2e-b047-4534-a47a-1957e0157be5 None admin] RBAC: Adding query filter params (group.id=564822e2a0ae45789218c020f51b29a2, role.id=b137366eb53b42aab629a88be737eaf9, scope.project.id=7ef24b891e2145d0ac96f35d4f4c385f) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:07.784916 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e2cf2e-b047-4534-a47a-1957e0157be5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:07.786346 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e2cf2e-b047-4534-a47a-1957e0157be5 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:07.792290 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 218/445] 10.222.0.62 () {56 vars in 1376 bytes} [Mon Jun 27 09:15:07 2022] GET /identity/v3/role_assignments?group.id=564822e2a0ae45789218c020f51b29a2&scope.project.id=7ef24b891e2145d0ac96f35d4f4c385f&role.id=b137366eb53b42aab629a88be737eaf9 => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:07.793162 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2cf2e-b047-4534-a47a-1957e0157be5 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:07.835402 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c7e54-4a65-4563-b289-25bc6869d3e9 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:07.874063 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6d572-974e-49e3-9180-b6782be21927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:07.874457 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6d572-974e-49e3-9180-b6782be21927 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:07.874457 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6d572-974e-49e3-9180-b6782be21927 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:07.874820 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6d572-974e-49e3-9180-b6782be21927 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:07.889919 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:07.916238 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2cf2e-b047-4534-a47a-1957e0157be5 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:07.950039 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db6d572-974e-49e3-9180-b6782be21927 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:07.951266 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db6d572-974e-49e3-9180-b6782be21927 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:07.956463 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7283713-ec09-4bf6-a826-90812f697589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:07.957256 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7283713-ec09-4bf6-a826-90812f697589 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:07.958023 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7283713-ec09-4bf6-a826-90812f697589 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:07.958023 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7283713-ec09-4bf6-a826-90812f697589 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:07.968514 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:07.976776 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7283713-ec09-4bf6-a826-90812f697589 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:15:07.984696 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-d7283713-ec09-4bf6-a826-90812f697589 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:15:07.984696 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:07.984696 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:07.984696 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:07.984696 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:07.984696 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:07.984696 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:07.984696 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:07.984696 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:07.984696 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:07.984696 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:07.984696 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:07.984696 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:15:07.984696 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:15:07.984696 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:15:07.984696 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:15:07.985650 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:15:07.985650 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:15:07.985650 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:15:07.985650 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:15:07.985650 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:07.985650 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:07.985650 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:07.985650 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:07.985650 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:07.985650 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:07.985650 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:07.985650 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:07.985650 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:07.985650 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:07.985650 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:07.985650 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:07.986466 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:07.986466 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:07.986466 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:07.986466 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:07.986466 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:15:07.986466 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:15:07.986466 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:15:07.986466 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:15:07.986466 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:15:07.986466 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:15:07.986466 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:15:07.986466 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:07.986466 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 219/446] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Jun 27 09:15:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:07.992427 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7283713-ec09-4bf6-a826-90812f697589 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:08.081739 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 228/447] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:15:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 09:15:08.089729 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6d572-974e-49e3-9180-b6782be21927 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:08.123368 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7283713-ec09-4bf6-a826-90812f697589 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:08.162647 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3979f-11b5-4c23-82fb-6d2cbf478447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:08.163319 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3979f-11b5-4c23-82fb-6d2cbf478447 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:08.163603 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3979f-11b5-4c23-82fb-6d2cbf478447 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:08.163892 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3979f-11b5-4c23-82fb-6d2cbf478447 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:08.164679 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d3979f-11b5-4c23-82fb-6d2cbf478447 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:08.164991 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d3979f-11b5-4c23-82fb-6d2cbf478447 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:08.166387 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d3979f-11b5-4c23-82fb-6d2cbf478447 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:08.169297 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:08.178386 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 220/448] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:15:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:15:08.183191 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3979f-11b5-4c23-82fb-6d2cbf478447 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:08.229914 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6d572-974e-49e3-9180-b6782be21927 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:08.246962 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:08.273498 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab31354-c31f-4e7f-b854-d59867b95497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:08.274371 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab31354-c31f-4e7f-b854-d59867b95497 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:08.274651 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab31354-c31f-4e7f-b854-d59867b95497 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:08.274926 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab31354-c31f-4e7f-b854-d59867b95497 None admin] PATH_INFO: `/v3/projects/7f845d06024f4ea9b859e6d0dcef1534` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:08.276184 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab31354-c31f-4e7f-b854-d59867b95497 None admin] RBAC: Authorizing `identity:get_project(project_id=7f845d06024f4ea9b859e6d0dcef1534)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:08.277910 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab31354-c31f-4e7f-b854-d59867b95497 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:08.279625 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 229/449] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:15:08 2022] GET /identity/v3/projects/7f845d06024f4ea9b859e6d0dcef1534 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:15:08.285553 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab31354-c31f-4e7f-b854-d59867b95497 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:08.303335 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3979f-11b5-4c23-82fb-6d2cbf478447 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:08.342871 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665faecf-b28e-452e-9e1e-d8add2d796d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:08.343437 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665faecf-b28e-452e-9e1e-d8add2d796d1 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:08.343717 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665faecf-b28e-452e-9e1e-d8add2d796d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:08.343982 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665faecf-b28e-452e-9e1e-d8add2d796d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:08.393655 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab31354-c31f-4e7f-b854-d59867b95497 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:08.415707 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:08.418984 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665faecf-b28e-452e-9e1e-d8add2d796d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:08.420504 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665faecf-b28e-452e-9e1e-d8add2d796d1 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:08.431758 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c85d63-63f1-4ed9-b376-3cf5ec181e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:08.432645 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c85d63-63f1-4ed9-b376-3cf5ec181e0d None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:08.433002 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c85d63-63f1-4ed9-b376-3cf5ec181e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:08.433210 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c85d63-63f1-4ed9-b376-3cf5ec181e0d None admin] PATH_INFO: `/v3/groups/564822e2a0ae45789218c020f51b29a2` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:08.434399 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c85d63-63f1-4ed9-b376-3cf5ec181e0d None admin] RBAC: Authorizing `identity:get_group(group_id=564822e2a0ae45789218c020f51b29a2)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:08.435831 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c85d63-63f1-4ed9-b376-3cf5ec181e0d None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:08.437494 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 230/450] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Jun 27 09:15:08 2022] GET /identity/v3/groups/564822e2a0ae45789218c020f51b29a2 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:08.443321 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c85d63-63f1-4ed9-b376-3cf5ec181e0d None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:08.492928 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:08.519889 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 221/451] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:15:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 27 09:15:08.526043 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665faecf-b28e-452e-9e1e-d8add2d796d1 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:08.543754 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c85d63-63f1-4ed9-b376-3cf5ec181e0d None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:08.576814 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0a9965-f1e5-4e6c-a75a-cc768c77756e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:08.577463 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a9965-f1e5-4e6c-a75a-cc768c77756e None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:08.577745 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a9965-f1e5-4e6c-a75a-cc768c77756e None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:08.578021 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a9965-f1e5-4e6c-a75a-cc768c77756e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:08.578855 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0a9965-f1e5-4e6c-a75a-cc768c77756e None admin] RBAC: Adding query filter params (group.id=564822e2a0ae45789218c020f51b29a2, role.id=b137366eb53b42aab629a88be737eaf9, scope.project.id=7f845d06024f4ea9b859e6d0dcef1534) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:08.579162 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0a9965-f1e5-4e6c-a75a-cc768c77756e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:08.580613 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0a9965-f1e5-4e6c-a75a-cc768c77756e None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:08.596801 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 231/452] 10.222.0.62 () {56 vars in 1376 bytes} [Mon Jun 27 09:15:08 2022] GET /identity/v3/role_assignments?group.id=564822e2a0ae45789218c020f51b29a2&scope.project.id=7f845d06024f4ea9b859e6d0dcef1534&role.id=b137366eb53b42aab629a88be737eaf9 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:15:08.622711 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:08.627076 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665faecf-b28e-452e-9e1e-d8add2d796d1 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:08.665144 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a98687-e0ed-4271-920c-b668c1d12bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:08.665995 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a98687-e0ed-4271-920c-b668c1d12bc0 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:08.666206 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a98687-e0ed-4271-920c-b668c1d12bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:08.666474 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a98687-e0ed-4271-920c-b668c1d12bc0 None admin] PATH_INFO: `/v3/projects/22d0a8f6bf9e4c98ba20a328083165ac` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:08.667812 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a98687-e0ed-4271-920c-b668c1d12bc0 None admin] RBAC: Authorizing `identity:get_project(project_id=22d0a8f6bf9e4c98ba20a328083165ac)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:08.670161 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a98687-e0ed-4271-920c-b668c1d12bc0 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:08.672027 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 222/453] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:15:08 2022] GET /identity/v3/projects/22d0a8f6bf9e4c98ba20a328083165ac => generated 344 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:15:08.677804 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0a9965-f1e5-4e6c-a75a-cc768c77756e None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:08.784811 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0a9965-f1e5-4e6c-a75a-cc768c77756e None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:08.797587 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:08.818385 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ccf122-852a-4226-bc1a-59ab1a4f69c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:08.821268 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccf122-852a-4226-bc1a-59ab1a4f69c5 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:08.821557 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccf122-852a-4226-bc1a-59ab1a4f69c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:08.823139 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccf122-852a-4226-bc1a-59ab1a4f69c5 None admin] PATH_INFO: `/v3/groups/89b16be432ea438aa0c0019613248a2a` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:08.825497 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ccf122-852a-4226-bc1a-59ab1a4f69c5 None admin] RBAC: Authorizing `identity:get_group(group_id=89b16be432ea438aa0c0019613248a2a)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:08.826970 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ccf122-852a-4226-bc1a-59ab1a4f69c5 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:08.828679 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 232/454] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Jun 27 09:15:08 2022] GET /identity/v3/groups/89b16be432ea438aa0c0019613248a2a => generated 229 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:08.835410 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a98687-e0ed-4271-920c-b668c1d12bc0 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:08.936326 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a98687-e0ed-4271-920c-b668c1d12bc0 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:08.970879 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc2706-da78-464e-96e0-2d17c1724c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:08.971522 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc2706-da78-464e-96e0-2d17c1724c6a None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:08.971806 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc2706-da78-464e-96e0-2d17c1724c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:08.972076 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc2706-da78-464e-96e0-2d17c1724c6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:08.972938 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc2706-da78-464e-96e0-2d17c1724c6a None admin] RBAC: Adding query filter params (group.id=89b16be432ea438aa0c0019613248a2a, role.id=91c77942515d45f1ad8189c9fddf4424, scope.project.id=22d0a8f6bf9e4c98ba20a328083165ac) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:08.973250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc2706-da78-464e-96e0-2d17c1724c6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:08.974723 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc2706-da78-464e-96e0-2d17c1724c6a None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:08.980392 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 223/455] 10.222.0.62 () {56 vars in 1376 bytes} [Mon Jun 27 09:15:08 2022] GET /identity/v3/role_assignments?group.id=89b16be432ea438aa0c0019613248a2a&scope.project.id=22d0a8f6bf9e4c98ba20a328083165ac&role.id=91c77942515d45f1ad8189c9fddf4424 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:11.437789 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5aacd-f1f6-4810-8097-121be017e14f None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:11.438618 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5aacd-f1f6-4810-8097-121be017e14f None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:11.439051 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5aacd-f1f6-4810-8097-121be017e14f None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:11.440652 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 233/456] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:15:11.445962 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b126d4-bc0c-4703-94b5-bc770cc4ce31 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:11.446721 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b126d4-bc0c-4703-94b5-bc770cc4ce31 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:11.447143 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b126d4-bc0c-4703-94b5-bc770cc4ce31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:11.469627 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-08b126d4-bc0c-4703-94b5-bc770cc4ce31 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:11.471065 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-08b126d4-bc0c-4703-94b5-bc770cc4ce31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:11.497319 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:11.556380 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 224/457] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:15:11.592432 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5aacd-f1f6-4810-8097-121be017e14f None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:11.741231 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5aacd-f1f6-4810-8097-121be017e14f None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:11.741397 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c02fa3-4949-4d97-a15b-396d5bf7096e None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:11.741667 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c02fa3-4949-4d97-a15b-396d5bf7096e None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:11.741913 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c02fa3-4949-4d97-a15b-396d5bf7096e None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:11.743529 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 225/458] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:15:11.753672 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca47d59-e086-4bbd-b931-5f273b0ec299 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:11.754208 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca47d59-e086-4bbd-b931-5f273b0ec299 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:11.754675 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca47d59-e086-4bbd-b931-5f273b0ec299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:11.795258 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da9889-0aa8-42f8-a60a-8d1378be2f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:11.796062 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da9889-0aa8-42f8-a60a-8d1378be2f95 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:11.796372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da9889-0aa8-42f8-a60a-8d1378be2f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:11.796651 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da9889-0aa8-42f8-a60a-8d1378be2f95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:11.798045 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-7ca47d59-e086-4bbd-b931-5f273b0ec299 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:11.799257 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-7ca47d59-e086-4bbd-b931-5f273b0ec299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:11.819686 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da9889-0aa8-42f8-a60a-8d1378be2f95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:11.821170 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da9889-0aa8-42f8-a60a-8d1378be2f95 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:11.852366 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-b9da9889-0aa8-42f8-a60a-8d1378be2f95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:11.852366 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:11.852366 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:11.852366 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:11.852366 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:11.852366 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:11.852366 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:11.852366 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:11.852366 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:11.852366 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:11.852366 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:11.852366 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:11.852366 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:11.852366 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:11.852366 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:11.853307 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:11.853307 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:11.853307 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:11.853307 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:11.853307 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:11.853307 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:11.853307 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:11.853307 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:11.853307 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:11.853307 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:11.853307 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:11.853307 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:11.853307 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:11.853307 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:11.853307 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:11.853307 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:11.853307 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:11.854137 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:11.854137 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:11.854137 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:11.854137 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:11.854137 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 234/459] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:11.855599 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde82d0-79e8-4d4c-8fe9-73717eb26fcb None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:11.855887 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde82d0-79e8-4d4c-8fe9-73717eb26fcb None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:11.856166 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde82d0-79e8-4d4c-8fe9-73717eb26fcb None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:11.857898 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 235/460] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:15:11.861672 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde82d0-79e8-4d4c-8fe9-73717eb26fcb None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:11.898542 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:11.917133 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 226/461] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:15:11.919035 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d452a2-3e51-4ac7-843b-c65453bc364e None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:11.919497 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d452a2-3e51-4ac7-843b-c65453bc364e None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:11.919917 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d452a2-3e51-4ac7-843b-c65453bc364e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:11.944420 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-00d452a2-3e51-4ac7-843b-c65453bc364e None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:11.946520 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-00d452a2-3e51-4ac7-843b-c65453bc364e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:11.989923 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde82d0-79e8-4d4c-8fe9-73717eb26fcb None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:12.031260 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dee0c0-15b5-444e-bcfc-37fe92a02212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:12.032152 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dee0c0-15b5-444e-bcfc-37fe92a02212 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:12.032417 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 227/462] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:15:12.032744 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dee0c0-15b5-444e-bcfc-37fe92a02212 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:12.033237 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dee0c0-15b5-444e-bcfc-37fe92a02212 None admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:12.033524 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d452a2-3e51-4ac7-843b-c65453bc364e None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:12.034374 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dee0c0-15b5-444e-bcfc-37fe92a02212 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:12.034903 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dee0c0-15b5-444e-bcfc-37fe92a02212 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:12.036584 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dee0c0-15b5-444e-bcfc-37fe92a02212 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:12.049412 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 236/463] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:12.060581 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:12.061761 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dee0c0-15b5-444e-bcfc-37fe92a02212 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:12.150066 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d452a2-3e51-4ac7-843b-c65453bc364e None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:12.172028 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:12.182001 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dee0c0-15b5-444e-bcfc-37fe92a02212 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:12.188990 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097278d0-2203-4f9a-8f9e-eb74ffa923a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:12.190068 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097278d0-2203-4f9a-8f9e-eb74ffa923a6 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:12.190540 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097278d0-2203-4f9a-8f9e-eb74ffa923a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:12.191026 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097278d0-2203-4f9a-8f9e-eb74ffa923a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:12.203859 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097278d0-2203-4f9a-8f9e-eb74ffa923a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:12.205763 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097278d0-2203-4f9a-8f9e-eb74ffa923a6 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:12.220438 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a73bc-b614-4352-be05-7ff8c96afa79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:12.221345 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a73bc-b614-4352-be05-7ff8c96afa79 None admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:12.221775 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a73bc-b614-4352-be05-7ff8c96afa79 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:12.222225 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a73bc-b614-4352-be05-7ff8c96afa79 None admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:12.223078 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2a73bc-b614-4352-be05-7ff8c96afa79 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:12.224727 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2a73bc-b614-4352-be05-7ff8c96afa79 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:12.225629 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-097278d0-2203-4f9a-8f9e-eb74ffa923a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:12.225629 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:12.225629 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:12.225629 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:12.225629 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:12.225629 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:12.225629 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:12.225629 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:12.225629 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:12.225629 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:12.225629 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:12.225629 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:12.225629 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:12.225629 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:12.225629 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:12.226657 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:12.226657 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:12.226657 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:12.226657 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:12.226657 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:12.226657 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:12.226657 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:12.226657 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:12.226657 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:12.226657 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:12.226657 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:12.226657 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:12.226657 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:12.226657 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:12.226657 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:12.226657 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:12.226657 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:12.227633 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:12.227633 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:12.227633 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:12.227633 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:12.232237 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 228/464] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:12.232237 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097278d0-2203-4f9a-8f9e-eb74ffa923a6 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:12.315592 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:12.325836 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 237/465] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Jun 27 09:15:12 2022] POST /identity/v3/users => generated 246 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:15:12.326943 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a73bc-b614-4352-be05-7ff8c96afa79 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:12.366162 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097278d0-2203-4f9a-8f9e-eb74ffa923a6 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:12.417007 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccdd237-a632-4431-807c-3d4970127ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:12.418791 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccdd237-a632-4431-807c-3d4970127ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:12.419226 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccdd237-a632-4431-807c-3d4970127ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:12.419909 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccdd237-a632-4431-807c-3d4970127ad8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:12.436982 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccdd237-a632-4431-807c-3d4970127ad8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:12.439544 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccdd237-a632-4431-807c-3d4970127ad8 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:12.466024 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-fccdd237-a632-4431-807c-3d4970127ad8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:12.466024 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:12.466024 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:12.466024 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:12.466024 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:12.466024 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:12.466024 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:12.466024 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:12.466024 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:12.466024 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:12.466024 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:12.466024 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:12.466024 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:12.466024 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:12.466024 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:12.467710 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:12.467710 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:12.467710 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:12.467710 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:12.467710 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:12.467710 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:12.467710 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:12.467710 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:12.467710 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:12.467710 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:12.467710 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:12.467710 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:12.467710 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:12.467710 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:12.467710 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:12.467710 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:12.467710 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:12.475486 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:12.475486 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:12.475486 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:12.475486 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:12.475720 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a73bc-b614-4352-be05-7ff8c96afa79 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:12.476137 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 229/466] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:12.476137 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379c427-1090-4916-b94c-7fd76ceb65fa None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:12.476137 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379c427-1090-4916-b94c-7fd76ceb65fa None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:12.476137 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379c427-1090-4916-b94c-7fd76ceb65fa None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:12.476137 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 230/467] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:15:12.477976 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379c427-1090-4916-b94c-7fd76ceb65fa None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:12.519569 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a3e0cc-342a-4bb2-a087-9051b264801d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:12.520165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3e0cc-342a-4bb2-a087-9051b264801d None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:12.520476 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3e0cc-342a-4bb2-a087-9051b264801d None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:12.520782 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3e0cc-342a-4bb2-a087-9051b264801d None admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:12.521697 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a3e0cc-342a-4bb2-a087-9051b264801d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:12.522011 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a3e0cc-342a-4bb2-a087-9051b264801d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:12.523534 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a3e0cc-342a-4bb2-a087-9051b264801d None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:12.540677 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 238/468] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:12.541992 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e0362-ce0d-4166-a304-86601eec0593 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:12.542337 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e0362-ce0d-4166-a304-86601eec0593 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:12.542614 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e0362-ce0d-4166-a304-86601eec0593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:12.562885 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-f09e0362-ce0d-4166-a304-86601eec0593 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:12.564108 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-f09e0362-ce0d-4166-a304-86601eec0593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:12.574105 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:12.610564 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379c427-1090-4916-b94c-7fd76ceb65fa None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:12.644611 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:12.653217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc856a6-9739-4fd7-b061-6e2c9f902c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:12.653940 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc856a6-9739-4fd7-b061-6e2c9f902c49 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:12.654278 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc856a6-9739-4fd7-b061-6e2c9f902c49 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:12.654552 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc856a6-9739-4fd7-b061-6e2c9f902c49 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:12.655285 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 239/469] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:15:12.655391 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc856a6-9739-4fd7-b061-6e2c9f902c49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:12.655661 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc856a6-9739-4fd7-b061-6e2c9f902c49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:12.656129 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e0362-ce0d-4166-a304-86601eec0593 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:12.661988 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc856a6-9739-4fd7-b061-6e2c9f902c49 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:12.690166 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 231/470] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:12.695486 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc856a6-9739-4fd7-b061-6e2c9f902c49 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:12.784406 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e0362-ce0d-4166-a304-86601eec0593 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:12.806694 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc856a6-9739-4fd7-b061-6e2c9f902c49 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:12.821272 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9892b6a0-8d44-486e-aec4-461dc2286591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:12.821952 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892b6a0-8d44-486e-aec4-461dc2286591 None admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:12.822235 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892b6a0-8d44-486e-aec4-461dc2286591 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:12.822512 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892b6a0-8d44-486e-aec4-461dc2286591 None admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:12.823224 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9892b6a0-8d44-486e-aec4-461dc2286591 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:12.824766 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9892b6a0-8d44-486e-aec4-461dc2286591 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:12.833624 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:12.842153 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b4e6f-dd32-4a33-a9e4-de32b10965ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:12.842821 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b4e6f-dd32-4a33-a9e4-de32b10965ec None admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:12.843098 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b4e6f-dd32-4a33-a9e4-de32b10965ec None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:12.843370 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b4e6f-dd32-4a33-a9e4-de32b10965ec None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:12.844150 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b4e6f-dd32-4a33-a9e4-de32b10965ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:12.845638 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b4e6f-dd32-4a33-a9e4-de32b10965ec None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:12.902884 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 240/471] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Jun 27 09:15:12 2022] POST /identity/v3/users => generated 248 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:15:12.903766 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9892b6a0-8d44-486e-aec4-461dc2286591 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:12.940968 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 232/472] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Jun 27 09:15:12 2022] POST /identity/v3/users => generated 248 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:15:12.942616 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90056f4e-87ee-4bac-8ba4-7f20f059d584 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:12.943366 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90056f4e-87ee-4bac-8ba4-7f20f059d584 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:12.943649 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90056f4e-87ee-4bac-8ba4-7f20f059d584 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:12.945951 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 233/473] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:15:12.951334 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ce4c0-f4e3-4ba4-955d-a726a82d564c None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:12.953631 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ce4c0-f4e3-4ba4-955d-a726a82d564c None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:12.953631 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ce4c0-f4e3-4ba4-955d-a726a82d564c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:12.980168 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-0f6ce4c0-f4e3-4ba4-955d-a726a82d564c None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:12.981919 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-0f6ce4c0-f4e3-4ba4-955d-a726a82d564c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:13.040660 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:13.115221 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9892b6a0-8d44-486e-aec4-461dc2286591 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:13.147373 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 234/474] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 09:15:13.157296 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b536ebe-6c19-43c7-83b1-5b361325316f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:13.158120 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b536ebe-6c19-43c7-83b1-5b361325316f None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:13.158438 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b536ebe-6c19-43c7-83b1-5b361325316f None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:13.158718 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b536ebe-6c19-43c7-83b1-5b361325316f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:13.170770 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b536ebe-6c19-43c7-83b1-5b361325316f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:13.172660 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b536ebe-6c19-43c7-83b1-5b361325316f None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:13.175849 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ce4c0-f4e3-4ba4-955d-a726a82d564c None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:13.190894 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-3b536ebe-6c19-43c7-83b1-5b361325316f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:13.190894 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:13.190894 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:13.190894 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:13.190894 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:13.190894 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:13.190894 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:13.190894 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:13.190894 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:13.190894 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:13.190894 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:13.190894 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:13.190894 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:13.190894 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:13.190894 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:13.191785 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:13.191785 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:13.191785 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:13.191785 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:13.191785 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:13.191785 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:13.191785 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:13.191785 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:13.191785 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:13.191785 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:13.191785 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:13.191785 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:13.191785 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:13.191785 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:13.191785 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:13.191785 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:13.191785 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:13.192739 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:13.192739 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:13.192739 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:13.192739 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:13.192739 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 241/475] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:13.202059 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b536ebe-6c19-43c7-83b1-5b361325316f None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:13.274276 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:13.325785 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ce4c0-f4e3-4ba4-955d-a726a82d564c None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:13.343282 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b536ebe-6c19-43c7-83b1-5b361325316f None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:13.370475 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7139e0d-729d-4948-be98-48a4dbcf0bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:13.371638 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7139e0d-729d-4948-be98-48a4dbcf0bc8 None admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:13.372179 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7139e0d-729d-4948-be98-48a4dbcf0bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:13.372992 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7139e0d-729d-4948-be98-48a4dbcf0bc8 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:13.374312 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7139e0d-729d-4948-be98-48a4dbcf0bc8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:13.376449 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7139e0d-729d-4948-be98-48a4dbcf0bc8 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:13.398563 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad2b14-1d72-48e4-a087-6d1adc386047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:13.399506 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad2b14-1d72-48e4-a087-6d1adc386047 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:13.399798 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad2b14-1d72-48e4-a087-6d1adc386047 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:13.400784 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad2b14-1d72-48e4-a087-6d1adc386047 None admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:13.401002 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad2b14-1d72-48e4-a087-6d1adc386047 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:13.403077 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad2b14-1d72-48e4-a087-6d1adc386047 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:13.403077 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad2b14-1d72-48e4-a087-6d1adc386047 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:13.405078 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.sql.core [None req-b7139e0d-729d-4948-be98-48a4dbcf0bc8 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 27 09:15:13.405078 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 27 09:15:13.405078 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [parameters: {'id': '2f04733d62f14c4da705de015e41694b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 27 09:15:13.405078 dv-cinder-847730-1-smb devstack@keystone.service[80307]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80307) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 27 09:15:13.427502 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-b7139e0d-729d-4948-be98-48a4dbcf0bc8 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 27 09:15:13.427502 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:13.427502 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 27 09:15:13.427502 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 27 09:15:13.427502 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 27 09:15:13.427502 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 27 09:15:13.427502 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 27 09:15:13.427502 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application result = self._query(query) Jun 27 09:15:13.427502 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 27 09:15:13.427502 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application conn.query(q) Jun 27 09:15:13.427502 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 27 09:15:13.427502 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 27 09:15:13.427502 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 27 09:15:13.427502 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application result.read() Jun 27 09:15:13.427502 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 27 09:15:13.428620 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 27 09:15:13.428620 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 27 09:15:13.428620 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 27 09:15:13.428620 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 27 09:15:13.428620 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 27 09:15:13.428620 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 27 09:15:13.428620 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 27 09:15:13.428620 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 27 09:15:13.428620 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:13.428620 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 27 09:15:13.428620 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:13.428620 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:13.428620 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 27 09:15:13.428620 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 27 09:15:13.428620 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 27 09:15:13.428620 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return ref.to_dict() Jun 27 09:15:13.428620 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 27 09:15:13.428620 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application next(self.gen) Jun 27 09:15:13.429506 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 27 09:15:13.429506 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application yield resource Jun 27 09:15:13.429506 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 27 09:15:13.429506 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application next(self.gen) Jun 27 09:15:13.429506 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 27 09:15:13.429506 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self.session.rollback() Jun 27 09:15:13.429506 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 27 09:15:13.429506 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self.force_reraise() Jun 27 09:15:13.429506 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 27 09:15:13.429506 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise self.value Jun 27 09:15:13.429506 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 27 09:15:13.429506 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 27 09:15:13.429506 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 27 09:15:13.429506 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application session.commit() Jun 27 09:15:13.429506 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 27 09:15:13.429506 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 27 09:15:13.429506 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 27 09:15:13.430429 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._prepare_impl() Jun 27 09:15:13.430429 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 27 09:15:13.430429 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self.session.flush() Jun 27 09:15:13.430429 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 27 09:15:13.430429 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._flush(objects) Jun 27 09:15:13.430429 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 27 09:15:13.430429 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 27 09:15:13.430429 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 27 09:15:13.430429 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application compat.raise_( Jun 27 09:15:13.430429 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 27 09:15:13.430429 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception Jun 27 09:15:13.430429 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 27 09:15:13.430429 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application flush_context.execute() Jun 27 09:15:13.430429 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 27 09:15:13.430429 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rec.execute(self) Jun 27 09:15:13.430429 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 27 09:15:13.430429 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 27 09:15:13.431284 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 27 09:15:13.431284 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 27 09:15:13.431284 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 27 09:15:13.431284 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 27 09:15:13.431284 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 27 09:15:13.431284 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 27 09:15:13.431284 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 27 09:15:13.431284 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 27 09:15:13.431284 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 27 09:15:13.431284 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 27 09:15:13.431284 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 27 09:15:13.431284 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 27 09:15:13.431284 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 27 09:15:13.431284 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 27 09:15:13.431284 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 27 09:15:13.431284 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception Jun 27 09:15:13.432092 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 27 09:15:13.432092 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 27 09:15:13.432092 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 27 09:15:13.432092 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 27 09:15:13.432092 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 27 09:15:13.432092 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application result = self._query(query) Jun 27 09:15:13.432092 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 27 09:15:13.432092 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application conn.query(q) Jun 27 09:15:13.432092 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 27 09:15:13.432092 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 27 09:15:13.432092 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 27 09:15:13.432092 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application result.read() Jun 27 09:15:13.432092 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 27 09:15:13.432092 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 27 09:15:13.432092 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 27 09:15:13.432092 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 27 09:15:13.435510 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 27 09:15:13.435510 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 27 09:15:13.435510 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 27 09:15:13.435510 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 27 09:15:13.435510 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 27 09:15:13.435510 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 27 09:15:13.435510 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [parameters: {'id': '2f04733d62f14c4da705de015e41694b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 27 09:15:13.435510 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 27 09:15:13.435510 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:13.435510 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 09:15:13.435510 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:13.435510 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:13.435510 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:13.435510 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:13.435510 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:13.435510 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:13.437739 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:13.437739 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:13.437739 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:13.437739 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:13.437739 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:13.437739 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:13.437739 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 27 09:15:13.437739 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 27 09:15:13.437739 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:13.437739 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:13.437739 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 27 09:15:13.437739 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 27 09:15:13.437739 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 27 09:15:13.437739 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 27 09:15:13.437739 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 27 09:15:13.437739 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:13.441270 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 235/476] 10.222.0.62 () {60 vars in 1131 bytes} [Mon Jun 27 09:15:13 2022] POST /identity/v3/roles => generated 144 bytes in 259 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 27 09:15:13.441270 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7139e0d-729d-4948-be98-48a4dbcf0bc8 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:13.444860 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 242/477] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:13.451243 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad2b14-1d72-48e4-a087-6d1adc386047 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:13.526810 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:13.649056 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad2b14-1d72-48e4-a087-6d1adc386047 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:13.660569 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:13.694994 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f8ee32-3ba3-47a2-b2b4-bbae4da8e6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:13.695671 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8ee32-3ba3-47a2-b2b4-bbae4da8e6a8 None admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:13.695953 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8ee32-3ba3-47a2-b2b4-bbae4da8e6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:13.696254 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8ee32-3ba3-47a2-b2b4-bbae4da8e6a8 None admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:13.696968 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f8ee32-3ba3-47a2-b2b4-bbae4da8e6a8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:13.699718 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f8ee32-3ba3-47a2-b2b4-bbae4da8e6a8 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:13.717836 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7139e0d-729d-4948-be98-48a4dbcf0bc8 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:13.756774 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c256f-2bbc-4ce5-93a7-46b873b4cc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:13.757577 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c256f-2bbc-4ce5-93a7-46b873b4cc70 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:13.757930 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c256f-2bbc-4ce5-93a7-46b873b4cc70 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:13.758206 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c256f-2bbc-4ce5-93a7-46b873b4cc70 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:13.772616 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 243/478] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Jun 27 09:15:13 2022] POST /identity/v3/users => generated 249 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:15:13.778509 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6c256f-2bbc-4ce5-93a7-46b873b4cc70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:15:13.787985 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-fb6c256f-2bbc-4ce5-93a7-46b873b4cc70 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 09:15:13.787985 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:13.787985 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:13.787985 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:13.787985 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:13.787985 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:13.787985 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:13.787985 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:13.787985 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:13.787985 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:13.787985 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:13.787985 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:13.787985 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:15:13.787985 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:15:13.787985 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:15:13.787985 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:15:13.789021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:15:13.789021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:15:13.789021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:15:13.789021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:15:13.789021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:13.789021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:13.789021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:13.789021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:13.789021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:13.789021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:13.789021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:13.789021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:13.789021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:13.789021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:13.789021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:13.789021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:13.789807 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:13.789807 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:13.789807 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:13.789807 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:13.789807 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:15:13.789807 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:15:13.789807 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:15:13.789807 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:15:13.789807 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:15:13.789807 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:15:13.789807 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 09:15:13.789807 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:13.789807 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 236/479] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Jun 27 09:15:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:13.795860 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f8ee32-3ba3-47a2-b2b4-bbae4da8e6a8 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:13.926113 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f8ee32-3ba3-47a2-b2b4-bbae4da8e6a8 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:13.962502 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51dbc26-476a-4560-b3fa-483eaecff1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:13.963189 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51dbc26-476a-4560-b3fa-483eaecff1d6 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:13.963474 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51dbc26-476a-4560-b3fa-483eaecff1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:13.963750 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51dbc26-476a-4560-b3fa-483eaecff1d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:13.964549 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51dbc26-476a-4560-b3fa-483eaecff1d6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:13.964856 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51dbc26-476a-4560-b3fa-483eaecff1d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:13.966300 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51dbc26-476a-4560-b3fa-483eaecff1d6 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:13.979860 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 244/480] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:15:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:14.593806 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bbfe2-7817-4514-9971-c0dea7232159 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:14.594323 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bbfe2-7817-4514-9971-c0dea7232159 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:14.594323 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bbfe2-7817-4514-9971-c0dea7232159 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:14.596044 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 237/481] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:15:14.601636 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2475e-1197-4363-8225-03c6a16fb6b7 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:14.601925 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2475e-1197-4363-8225-03c6a16fb6b7 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:14.602202 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2475e-1197-4363-8225-03c6a16fb6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:14.625459 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-17d2475e-1197-4363-8225-03c6a16fb6b7 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:14.626678 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-17d2475e-1197-4363-8225-03c6a16fb6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:14.645877 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:14.712625 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 245/482] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 09:15:14.749073 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3bbfe2-7817-4514-9971-c0dea7232159 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:14.871657 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:14.879943 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3bbfe2-7817-4514-9971-c0dea7232159 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:14.933082 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c07f9-06b0-4fcd-b497-f36524a4d921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:14.933883 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c07f9-06b0-4fcd-b497-f36524a4d921 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:14.934168 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c07f9-06b0-4fcd-b497-f36524a4d921 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:14.934442 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c07f9-06b0-4fcd-b497-f36524a4d921 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:14.955238 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4c07f9-06b0-4fcd-b497-f36524a4d921 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:15:14.963267 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-1a4c07f9-06b0-4fcd-b497-f36524a4d921 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 09:15:14.963267 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:14.963267 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:14.963267 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:14.963267 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:14.963267 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:14.963267 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:14.963267 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:14.963267 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:14.963267 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:14.963267 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:14.963267 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:14.963267 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:15:14.963267 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:15:14.963267 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:15:14.963267 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:15:14.964146 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:15:14.964146 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:15:14.964146 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:15:14.964146 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:15:14.964146 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:14.964146 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:14.964146 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:14.964146 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:14.964146 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:14.964146 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:14.964146 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:14.964146 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:14.964146 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:14.964146 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:14.964146 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:14.964146 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:14.964962 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:14.964962 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:14.964962 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:14.964962 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:14.964962 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:15:14.964962 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:15:14.964962 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:15:14.964962 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:15:14.964962 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:15:14.964962 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:15:14.964962 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 09:15:14.964962 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:14.964962 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 238/483] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Jun 27 09:15:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:14.971440 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2475e-1197-4363-8225-03c6a16fb6b7 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:15.086825 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2475e-1197-4363-8225-03c6a16fb6b7 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:15.124185 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc362ee2-960d-4b9a-83f3-aa5108142d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:15.124862 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc362ee2-960d-4b9a-83f3-aa5108142d55 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:15.125143 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc362ee2-960d-4b9a-83f3-aa5108142d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:15.125415 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc362ee2-960d-4b9a-83f3-aa5108142d55 None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:15.126160 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc362ee2-960d-4b9a-83f3-aa5108142d55 None admin] RBAC: Adding query filter params (name=service) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:15.126461 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc362ee2-960d-4b9a-83f3-aa5108142d55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:15.127835 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc362ee2-960d-4b9a-83f3-aa5108142d55 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:15.136705 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 246/484] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Jun 27 09:15:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:15.141743 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c07f9-06b0-4fcd-b497-f36524a4d921 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:15.306983 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c07f9-06b0-4fcd-b497-f36524a4d921 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:15.358711 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f5d56-0c46-4475-af53-1af0bfba65fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:15.359505 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f5d56-0c46-4475-af53-1af0bfba65fc None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:15.359786 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f5d56-0c46-4475-af53-1af0bfba65fc None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:15.360059 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f5d56-0c46-4475-af53-1af0bfba65fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:15.376655 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f5d56-0c46-4475-af53-1af0bfba65fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:15.378058 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f5d56-0c46-4475-af53-1af0bfba65fc None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:15.399924 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-ee2f5d56-0c46-4475-af53-1af0bfba65fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:15.399924 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:15.399924 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:15.399924 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:15.399924 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:15.399924 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:15.399924 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:15.399924 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:15.399924 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:15.399924 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:15.399924 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:15.399924 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:15.399924 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:15.399924 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:15.399924 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:15.400863 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:15.400863 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:15.400863 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:15.400863 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:15.400863 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:15.400863 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:15.400863 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:15.400863 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:15.400863 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:15.400863 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:15.400863 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:15.400863 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:15.400863 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:15.400863 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:15.400863 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:15.400863 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:15.400863 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:15.401700 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:15.401700 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:15.401700 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:15.401700 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:15.401700 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 239/485] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:15.407256 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc362ee2-960d-4b9a-83f3-aa5108142d55 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:15.445104 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:15.564742 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc362ee2-960d-4b9a-83f3-aa5108142d55 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:15.607459 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155fedc4-4b27-4a58-9cca-c42375963941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:15.608125 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fedc4-4b27-4a58-9cca-c42375963941 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:15.608435 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fedc4-4b27-4a58-9cca-c42375963941 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:15.608713 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fedc4-4b27-4a58-9cca-c42375963941 None admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:15.609446 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155fedc4-4b27-4a58-9cca-c42375963941 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:15.609753 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155fedc4-4b27-4a58-9cca-c42375963941 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:15.611126 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155fedc4-4b27-4a58-9cca-c42375963941 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:15.627651 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 247/486] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:15.633508 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f5d56-0c46-4475-af53-1af0bfba65fc None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:15.643530 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:15.670582 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f7dbc-11b4-42c5-908b-f66fd810d44a None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:15.670884 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f7dbc-11b4-42c5-908b-f66fd810d44a None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:15.671130 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f7dbc-11b4-42c5-908b-f66fd810d44a None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:15.672863 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 248/487] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 09:15:15.679983 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8622c-763e-403b-8b10-770923d3ca9e None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:15.680303 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8622c-763e-403b-8b10-770923d3ca9e None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:15.680581 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8622c-763e-403b-8b10-770923d3ca9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:15.702859 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-fdc8622c-763e-403b-8b10-770923d3ca9e None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:15.704061 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-fdc8622c-763e-403b-8b10-770923d3ca9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:15.779030 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f5d56-0c46-4475-af53-1af0bfba65fc None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:15.791268 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 249/488] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 09:15:15.793256 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ae5dd-9340-4c05-aa71-2beed064a60c None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:15.793750 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ae5dd-9340-4c05-aa71-2beed064a60c None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:15.794248 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ae5dd-9340-4c05-aa71-2beed064a60c None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:15.795794 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 250/489] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:15:15.802255 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6571ff7-bdbe-43a2-90bf-ac28a5097a06 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:15.802953 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6571ff7-bdbe-43a2-90bf-ac28a5097a06 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:15.804937 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6571ff7-bdbe-43a2-90bf-ac28a5097a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:15.824254 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:15.831229 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-e6571ff7-bdbe-43a2-90bf-ac28a5097a06 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:15.832690 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-e6571ff7-bdbe-43a2-90bf-ac28a5097a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:15.835751 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f021d-d980-48c8-8a4f-c856710785da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:15.836631 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f021d-d980-48c8-8a4f-c856710785da None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:15.837723 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f021d-d980-48c8-8a4f-c856710785da None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:15.837998 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f021d-d980-48c8-8a4f-c856710785da None admin] PATH_INFO: `/v3/users/nova` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:15.847350 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f021d-d980-48c8-8a4f-c856710785da None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:15.848872 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f021d-d980-48c8-8a4f-c856710785da None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:15.870460 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-467f021d-d980-48c8-8a4f-c856710785da None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 27 09:15:15.870460 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:15.870460 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:15.870460 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:15.870460 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:15.870460 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:15.870460 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:15.870460 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:15.870460 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:15.870460 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:15.870460 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:15.870460 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:15.870460 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 09:15:15.870460 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 09:15:15.870460 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 09:15:15.870460 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 09:15:15.871411 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:15.871411 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:15.871411 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 09:15:15.871411 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:15:15.871411 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 09:15:15.871411 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:15:15.871411 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:15.871411 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:15.871411 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:15.871411 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:15.871411 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:15.871411 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:15.871411 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:15.871411 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:15.871411 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:15.871411 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:15.871411 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:15.871411 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:15.872790 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:15.872790 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:15.872790 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 09:15:15.872790 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 09:15:15.872790 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 09:15:15.872790 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 09:15:15.872790 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 09:15:15.872790 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 09:15:15.872790 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 27 09:15:15.872790 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:15.872790 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 240/490] 10.222.0.62 () {56 vars in 1093 bytes} [Mon Jun 27 09:15:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:15.872790 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f021d-d980-48c8-8a4f-c856710785da None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:15.916304 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 251/491] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 09:15:15.917506 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6571ff7-bdbe-43a2-90bf-ac28a5097a06 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:15.954362 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:16.000443 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f021d-d980-48c8-8a4f-c856710785da None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:16.042224 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f83a12c-f97e-4a8e-b13c-debf2d4ce6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:16.043018 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83a12c-f97e-4a8e-b13c-debf2d4ce6ee None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:16.043290 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83a12c-f97e-4a8e-b13c-debf2d4ce6ee None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:16.043596 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83a12c-f97e-4a8e-b13c-debf2d4ce6ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:16.054579 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6571ff7-bdbe-43a2-90bf-ac28a5097a06 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:16.055145 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f83a12c-f97e-4a8e-b13c-debf2d4ce6ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:15:16.062901 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-2f83a12c-f97e-4a8e-b13c-debf2d4ce6ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 09:15:16.062901 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:16.062901 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:16.062901 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:16.062901 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:16.062901 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:16.062901 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:16.062901 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:16.062901 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:16.062901 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:16.062901 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:16.062901 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:16.062901 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:15:16.062901 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:15:16.062901 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:15:16.062901 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:15:16.063843 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:15:16.063843 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:15:16.063843 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:15:16.063843 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:15:16.063843 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:16.063843 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:16.063843 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:16.063843 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:16.063843 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:16.063843 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:16.063843 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:16.063843 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:16.063843 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:16.063843 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:16.063843 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:16.063843 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:16.064674 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:16.064674 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:16.064674 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:16.064674 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:16.064674 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:15:16.064674 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:15:16.064674 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:15:16.064674 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:15:16.064674 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:15:16.064674 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:15:16.064674 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 09:15:16.064674 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:16.069111 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 241/492] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Jun 27 09:15:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:16.069942 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f83a12c-f97e-4a8e-b13c-debf2d4ce6ee None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:16.097195 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84baf1-cfe9-43c9-8e7d-d15045049186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:16.098282 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84baf1-cfe9-43c9-8e7d-d15045049186 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:16.098801 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84baf1-cfe9-43c9-8e7d-d15045049186 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:16.099318 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84baf1-cfe9-43c9-8e7d-d15045049186 None admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:16.100451 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc84baf1-cfe9-43c9-8e7d-d15045049186 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:16.100963 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc84baf1-cfe9-43c9-8e7d-d15045049186 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:16.113022 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc84baf1-cfe9-43c9-8e7d-d15045049186 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:16.125675 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:16.156423 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 252/493] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Jun 27 09:15:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:16.157666 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84baf1-cfe9-43c9-8e7d-d15045049186 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:16.179746 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f83a12c-f97e-4a8e-b13c-debf2d4ce6ee None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:16.206671 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:16.216373 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697bb67b-a04d-41de-8c40-7ffeef205f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:16.217680 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697bb67b-a04d-41de-8c40-7ffeef205f0e None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:16.217680 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697bb67b-a04d-41de-8c40-7ffeef205f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:16.217680 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697bb67b-a04d-41de-8c40-7ffeef205f0e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:16.229557 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697bb67b-a04d-41de-8c40-7ffeef205f0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:15:16.237692 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-697bb67b-a04d-41de-8c40-7ffeef205f0e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 09:15:16.237692 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:16.237692 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:16.237692 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:16.237692 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:16.237692 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:16.237692 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:16.237692 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:16.237692 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:16.237692 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:16.237692 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:16.237692 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:16.237692 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:15:16.237692 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:15:16.237692 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:15:16.237692 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:15:16.238738 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:15:16.238738 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:15:16.238738 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:15:16.238738 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:15:16.238738 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:16.238738 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:16.238738 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:16.238738 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:16.238738 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:16.238738 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:16.238738 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:16.238738 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:16.238738 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:16.238738 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:16.238738 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:16.238738 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:16.240099 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:16.240099 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:16.240099 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:16.240099 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:16.240099 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:15:16.240099 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:15:16.240099 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:15:16.240099 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:15:16.240099 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:15:16.240099 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:15:16.240099 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 09:15:16.240099 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:16.240746 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 242/494] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Jun 27 09:15:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:16.245805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697bb67b-a04d-41de-8c40-7ffeef205f0e None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:16.279233 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84baf1-cfe9-43c9-8e7d-d15045049186 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:16.317180 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c2401d-7099-4a2e-b2a1-11db4a6165b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:16.319009 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2401d-7099-4a2e-b2a1-11db4a6165b7 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:16.319990 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2401d-7099-4a2e-b2a1-11db4a6165b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:16.320566 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2401d-7099-4a2e-b2a1-11db4a6165b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:16.321539 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c2401d-7099-4a2e-b2a1-11db4a6165b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:16.322049 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c2401d-7099-4a2e-b2a1-11db4a6165b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:16.323741 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c2401d-7099-4a2e-b2a1-11db4a6165b7 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:16.335310 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 253/495] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Jun 27 09:15:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:16.336563 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c2401d-7099-4a2e-b2a1-11db4a6165b7 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:16.357152 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697bb67b-a04d-41de-8c40-7ffeef205f0e None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:16.394666 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c92a37-5521-4884-9113-ff4e2b05edc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:16.395301 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c92a37-5521-4884-9113-ff4e2b05edc8 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:16.395601 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c92a37-5521-4884-9113-ff4e2b05edc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:16.395879 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c92a37-5521-4884-9113-ff4e2b05edc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:16.407537 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:16.455578 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:16.458225 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c2401d-7099-4a2e-b2a1-11db4a6165b7 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:16.471603 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c92a37-5521-4884-9113-ff4e2b05edc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:16.473091 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c92a37-5521-4884-9113-ff4e2b05edc8 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:16.497534 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e55a73-10f8-4f87-8ce4-e4f4b6a12089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:16.498492 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e55a73-10f8-4f87-8ce4-e4f4b6a12089 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:16.498957 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e55a73-10f8-4f87-8ce4-e4f4b6a12089 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:16.499477 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e55a73-10f8-4f87-8ce4-e4f4b6a12089 None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:16.500442 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e55a73-10f8-4f87-8ce4-e4f4b6a12089 None admin] RBAC: Adding query filter params (name=service) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:16.500942 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e55a73-10f8-4f87-8ce4-e4f4b6a12089 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:16.502450 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e55a73-10f8-4f87-8ce4-e4f4b6a12089 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:16.515637 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 254/496] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Jun 27 09:15:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:16.519460 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e55a73-10f8-4f87-8ce4-e4f4b6a12089 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:16.587466 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 243/497] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:15:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 09:15:16.589271 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7091f4e-9623-4b54-8983-0f59478525fd None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:16.589709 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7091f4e-9623-4b54-8983-0f59478525fd None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:16.589934 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7091f4e-9623-4b54-8983-0f59478525fd None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:16.591411 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 244/498] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:15:16.596102 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7091f4e-9623-4b54-8983-0f59478525fd None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:16.625127 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e55a73-10f8-4f87-8ce4-e4f4b6a12089 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:16.641736 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:16.659145 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca5828-e021-48eb-8f29-342c46e980b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:16.659942 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca5828-e021-48eb-8f29-342c46e980b2 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:16.660248 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca5828-e021-48eb-8f29-342c46e980b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:16.660534 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca5828-e021-48eb-8f29-342c46e980b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:16.672756 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca5828-e021-48eb-8f29-342c46e980b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:16.674770 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca5828-e021-48eb-8f29-342c46e980b2 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:16.685002 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:16.694175 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-4aca5828-e021-48eb-8f29-342c46e980b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:16.694175 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:16.694175 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:16.694175 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:16.694175 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:16.694175 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:16.694175 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:16.694175 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:16.694175 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:16.694175 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:16.694175 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:16.694175 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:16.694175 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:16.694175 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:16.694175 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:16.696718 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:16.696718 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:16.696718 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:16.696718 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:16.696718 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:16.696718 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:16.696718 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:16.696718 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:16.696718 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:16.696718 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:16.696718 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:16.696718 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:16.696718 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:16.696718 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:16.696718 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:16.696718 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:16.696718 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:16.697552 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:16.697552 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:16.697552 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:16.697552 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:16.697552 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 255/499] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:16.697552 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca5828-e021-48eb-8f29-342c46e980b2 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:16.702520 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7091f4e-9623-4b54-8983-0f59478525fd None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:16.738606 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd71a05a-6483-4e00-90ae-50dbb3ddf760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:16.739341 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71a05a-6483-4e00-90ae-50dbb3ddf760 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:16.739630 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71a05a-6483-4e00-90ae-50dbb3ddf760 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:16.739906 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71a05a-6483-4e00-90ae-50dbb3ddf760 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:16.749930 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd71a05a-6483-4e00-90ae-50dbb3ddf760 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:16.751409 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd71a05a-6483-4e00-90ae-50dbb3ddf760 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:16.768638 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-bd71a05a-6483-4e00-90ae-50dbb3ddf760 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:16.768638 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:16.768638 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:16.768638 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:16.768638 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:16.768638 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:16.768638 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:16.768638 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:16.768638 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:16.768638 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:16.768638 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:16.768638 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:16.768638 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:16.768638 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:16.768638 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:16.769507 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:16.769507 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:16.769507 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:16.769507 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:16.769507 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:16.769507 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:16.769507 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:16.769507 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:16.769507 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:16.769507 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:16.769507 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:16.769507 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:16.769507 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:16.769507 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:16.769507 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:16.769507 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:16.769507 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:16.770341 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:16.770341 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:16.770341 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:16.770341 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:16.770341 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 245/500] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:16.771651 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347ccb3-375e-4e78-9bf0-74cd3314bf7b None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:16.771913 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347ccb3-375e-4e78-9bf0-74cd3314bf7b None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:16.772215 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347ccb3-375e-4e78-9bf0-74cd3314bf7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:16.788998 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-4347ccb3-375e-4e78-9bf0-74cd3314bf7b None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:16.790185 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-4347ccb3-375e-4e78-9bf0-74cd3314bf7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:16.799749 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca5828-e021-48eb-8f29-342c46e980b2 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:16.833662 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b8075d-614e-4dfa-938e-2d6997476288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:16.834559 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8075d-614e-4dfa-938e-2d6997476288 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:16.834843 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8075d-614e-4dfa-938e-2d6997476288 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:16.835121 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8075d-614e-4dfa-938e-2d6997476288 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:16.846109 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b8075d-614e-4dfa-938e-2d6997476288 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:16.847696 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b8075d-614e-4dfa-938e-2d6997476288 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:16.858181 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 246/501] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:15:16.859521 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407998e-e4ad-492d-abcf-53a942970825 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:16.859807 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407998e-e4ad-492d-abcf-53a942970825 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:16.860080 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407998e-e4ad-492d-abcf-53a942970825 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:16.861541 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 247/502] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:15:16.862071 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407998e-e4ad-492d-abcf-53a942970825 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:16.869301 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-88b8075d-614e-4dfa-938e-2d6997476288 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:16.869301 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:16.869301 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:16.869301 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:16.869301 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:16.869301 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:16.869301 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:16.869301 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:16.869301 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:16.869301 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:16.869301 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:16.869301 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:16.869301 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:16.869301 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:16.869301 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:16.870158 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:16.870158 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:16.870158 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:16.870158 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:16.870158 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:16.870158 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:16.870158 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:16.870158 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:16.870158 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:16.870158 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:16.870158 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:16.870158 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:16.870158 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:16.870158 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:16.870158 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:16.870158 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:16.870158 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:16.870982 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:16.870982 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:16.870982 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:16.870982 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:16.871585 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 256/503] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:16.872008 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b8075d-614e-4dfa-938e-2d6997476288 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:16.905645 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:16.935917 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:16.969662 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407998e-e4ad-492d-abcf-53a942970825 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:16.983083 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b8075d-614e-4dfa-938e-2d6997476288 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:17.003759 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121aec45-1dad-4fb6-8f4b-a1b10b727bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:17.004380 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121aec45-1dad-4fb6-8f4b-a1b10b727bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:17.004696 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121aec45-1dad-4fb6-8f4b-a1b10b727bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:17.005478 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121aec45-1dad-4fb6-8f4b-a1b10b727bc9 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:17.006192 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121aec45-1dad-4fb6-8f4b-a1b10b727bc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:17.006504 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121aec45-1dad-4fb6-8f4b-a1b10b727bc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:17.008046 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121aec45-1dad-4fb6-8f4b-a1b10b727bc9 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:17.017604 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660edf9-9137-450d-842e-32939e42ed27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:17.018262 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660edf9-9137-450d-842e-32939e42ed27 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:17.018543 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660edf9-9137-450d-842e-32939e42ed27 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:17.018818 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660edf9-9137-450d-842e-32939e42ed27 None admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:17.019561 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2660edf9-9137-450d-842e-32939e42ed27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:17.019679 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 248/504] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:17.019836 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2660edf9-9137-450d-842e-32939e42ed27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:17.021372 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be28ddb-7651-4943-8d23-664391e5f0d6 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:17.021673 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be28ddb-7651-4943-8d23-664391e5f0d6 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:17.021898 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2660edf9-9137-450d-842e-32939e42ed27 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:17.021993 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be28ddb-7651-4943-8d23-664391e5f0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:17.035160 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 257/505] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:17.036283 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660edf9-9137-450d-842e-32939e42ed27 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:17.038575 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-3be28ddb-7651-4943-8d23-664391e5f0d6 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:17.039767 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-3be28ddb-7651-4943-8d23-664391e5f0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:17.107799 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 249/506] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:15:17.109419 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be28ddb-7651-4943-8d23-664391e5f0d6 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:17.120584 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:17.141426 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660edf9-9137-450d-842e-32939e42ed27 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:17.173374 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:17.177114 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0cdda4-0638-4e94-8bc6-2709aa473cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:17.177772 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0cdda4-0638-4e94-8bc6-2709aa473cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:17.178057 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0cdda4-0638-4e94-8bc6-2709aa473cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:17.178327 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0cdda4-0638-4e94-8bc6-2709aa473cd4 None admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:17.179045 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0cdda4-0638-4e94-8bc6-2709aa473cd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:17.179351 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0cdda4-0638-4e94-8bc6-2709aa473cd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:17.180756 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0cdda4-0638-4e94-8bc6-2709aa473cd4 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:17.191894 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 258/507] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:17.197073 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0cdda4-0638-4e94-8bc6-2709aa473cd4 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:17.215294 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be28ddb-7651-4943-8d23-664391e5f0d6 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:17.250614 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5e702-e91b-4fa3-839b-6fa73613a403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:17.251396 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5e702-e91b-4fa3-839b-6fa73613a403 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:17.251677 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5e702-e91b-4fa3-839b-6fa73613a403 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:17.251945 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5e702-e91b-4fa3-839b-6fa73613a403 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:17.262616 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5e702-e91b-4fa3-839b-6fa73613a403 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:17.264052 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5e702-e91b-4fa3-839b-6fa73613a403 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:17.282920 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-e4f5e702-e91b-4fa3-839b-6fa73613a403 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:17.282920 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:17.282920 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:17.282920 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:17.282920 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:17.282920 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:17.282920 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:17.282920 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:17.282920 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:17.282920 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:17.282920 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:17.282920 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:17.282920 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:17.282920 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:17.282920 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:17.283888 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:17.283888 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:17.283888 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:17.283888 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:17.283888 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:17.283888 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:17.283888 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:17.283888 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:17.283888 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:17.283888 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:17.283888 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:17.283888 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:17.283888 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:17.283888 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:17.283888 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:17.283888 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:17.283888 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:17.285056 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:17.285056 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:17.285056 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:17.285056 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:17.285056 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 250/508] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:17.285056 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5e702-e91b-4fa3-839b-6fa73613a403 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:17.298717 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0cdda4-0638-4e94-8bc6-2709aa473cd4 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:17.332422 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47749034-fa94-4b33-ab9e-539bbb503658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:17.334069 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47749034-fa94-4b33-ab9e-539bbb503658 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:17.334350 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47749034-fa94-4b33-ab9e-539bbb503658 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:17.334620 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47749034-fa94-4b33-ab9e-539bbb503658 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:17.342147 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47749034-fa94-4b33-ab9e-539bbb503658 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:17.343575 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47749034-fa94-4b33-ab9e-539bbb503658 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:17.359413 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-47749034-fa94-4b33-ab9e-539bbb503658 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 27 09:15:17.359413 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:17.359413 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:17.359413 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:17.359413 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:17.359413 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:17.359413 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:17.359413 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:17.359413 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:17.359413 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:17.359413 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:17.359413 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:17.359413 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 09:15:17.359413 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 09:15:17.359413 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 09:15:17.359413 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 09:15:17.360398 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:17.360398 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:17.360398 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 09:15:17.360398 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:15:17.360398 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 09:15:17.360398 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:15:17.360398 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:17.360398 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:17.360398 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:17.360398 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:17.360398 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:17.360398 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:17.360398 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:17.360398 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:17.360398 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:17.360398 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:17.360398 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:17.360398 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:17.361302 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:17.361302 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:17.361302 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 09:15:17.361302 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 09:15:17.361302 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 09:15:17.361302 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 09:15:17.361302 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 09:15:17.361302 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 09:15:17.361302 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 27 09:15:17.361302 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:17.361302 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 259/509] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:15:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:17.361871 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47749034-fa94-4b33-ab9e-539bbb503658 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:17.364187 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:17.388263 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5e702-e91b-4fa3-839b-6fa73613a403 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:17.400451 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:17.423321 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0bb6be-3048-4cac-87ff-62e5dee465e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:17.424110 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0bb6be-3048-4cac-87ff-62e5dee465e8 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:17.424415 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0bb6be-3048-4cac-87ff-62e5dee465e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:17.424684 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0bb6be-3048-4cac-87ff-62e5dee465e8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:17.432302 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0bb6be-3048-4cac-87ff-62e5dee465e8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:17.434373 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0bb6be-3048-4cac-87ff-62e5dee465e8 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:17.448793 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-3b0bb6be-3048-4cac-87ff-62e5dee465e8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 27 09:15:17.448793 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:17.448793 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:17.448793 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:17.448793 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:17.448793 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:17.448793 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:17.448793 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:17.448793 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:17.448793 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:17.448793 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:17.448793 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:17.448793 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 09:15:17.448793 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 09:15:17.448793 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 09:15:17.448793 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 09:15:17.449685 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:17.449685 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:17.449685 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 09:15:17.449685 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:15:17.449685 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 09:15:17.449685 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:15:17.449685 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:17.449685 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:17.449685 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:17.449685 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:17.449685 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:17.449685 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:17.449685 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:17.449685 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:17.449685 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:17.449685 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:17.449685 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:17.449685 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:17.450559 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:17.450559 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:17.450559 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 09:15:17.450559 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 09:15:17.450559 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 09:15:17.450559 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 09:15:17.450559 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 09:15:17.450559 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 09:15:17.450559 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 27 09:15:17.450559 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:17.450559 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 251/510] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:15:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:17.451107 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0bb6be-3048-4cac-87ff-62e5dee465e8 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:17.465040 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47749034-fa94-4b33-ab9e-539bbb503658 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:17.498580 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6811247-59ef-4d6d-86f4-d1c04320fb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:17.499371 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6811247-59ef-4d6d-86f4-d1c04320fb66 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:17.499644 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6811247-59ef-4d6d-86f4-d1c04320fb66 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:17.499914 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6811247-59ef-4d6d-86f4-d1c04320fb66 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:17.509905 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6811247-59ef-4d6d-86f4-d1c04320fb66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:15:17.517624 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-b6811247-59ef-4d6d-86f4-d1c04320fb66 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 09:15:17.517624 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:17.517624 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:17.517624 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:17.517624 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:17.517624 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:17.517624 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:17.517624 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:17.517624 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:17.517624 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:17.517624 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:17.517624 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:17.517624 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:15:17.517624 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:15:17.517624 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:15:17.517624 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:15:17.518617 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:15:17.518617 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:15:17.518617 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:15:17.518617 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:15:17.518617 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:17.518617 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:17.518617 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:17.518617 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:17.518617 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:17.518617 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:17.518617 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:17.518617 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:17.518617 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:17.518617 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:17.518617 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:17.518617 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:17.519627 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:17.519627 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:17.519627 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:17.519627 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:17.519627 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:15:17.519627 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:15:17.519627 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:15:17.519627 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:15:17.519627 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:15:17.519627 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:15:17.519627 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 09:15:17.519627 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:17.519627 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 260/511] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Jun 27 09:15:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:17.519627 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6811247-59ef-4d6d-86f4-d1c04320fb66 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:17.553360 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0bb6be-3048-4cac-87ff-62e5dee465e8 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:17.585420 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:17.588140 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19248c6c-db0c-485c-b004-e9c96fb5a6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:17.588956 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19248c6c-db0c-485c-b004-e9c96fb5a6a1 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:17.589237 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19248c6c-db0c-485c-b004-e9c96fb5a6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:17.589507 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19248c6c-db0c-485c-b004-e9c96fb5a6a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:17.596114 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19248c6c-db0c-485c-b004-e9c96fb5a6a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:17.597576 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19248c6c-db0c-485c-b004-e9c96fb5a6a1 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:17.613495 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-19248c6c-db0c-485c-b004-e9c96fb5a6a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:15:17.613495 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:17.613495 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:17.613495 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:17.613495 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:17.613495 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:17.613495 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:17.613495 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:17.613495 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:17.613495 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:17.613495 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:17.613495 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:17.613495 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 09:15:17.613495 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 09:15:17.613495 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 09:15:17.614401 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 09:15:17.614401 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:17.614401 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:17.614401 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:17.614401 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:17.614401 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:17.614401 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:17.614401 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:17.614401 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:17.614401 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:17.614401 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:17.614401 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:17.614401 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:17.614401 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:17.614401 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:17.614401 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:17.614401 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:17.615271 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 09:15:17.615271 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 09:15:17.615271 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 09:15:17.615271 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 09:15:17.615271 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 09:15:17.615271 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 09:15:17.615271 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:15:17.615271 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:17.615271 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 252/512] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:15:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:17.615755 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19248c6c-db0c-485c-b004-e9c96fb5a6a1 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:17.627623 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6811247-59ef-4d6d-86f4-d1c04320fb66 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:17.644674 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:17.661982 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57148b2f-d070-4546-9083-e445d82eca46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:17.662638 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57148b2f-d070-4546-9083-e445d82eca46 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:17.662919 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57148b2f-d070-4546-9083-e445d82eca46 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:17.663190 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57148b2f-d070-4546-9083-e445d82eca46 None admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:17.663904 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57148b2f-d070-4546-9083-e445d82eca46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:17.664225 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57148b2f-d070-4546-9083-e445d82eca46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:17.665609 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57148b2f-d070-4546-9083-e445d82eca46 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:17.677175 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 261/513] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:17.677973 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57148b2f-d070-4546-9083-e445d82eca46 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:17.719693 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19248c6c-db0c-485c-b004-e9c96fb5a6a1 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:17.755798 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695ac17-a8e9-4969-8153-4ad635db2a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:17.756492 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695ac17-a8e9-4969-8153-4ad635db2a37 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:17.756779 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695ac17-a8e9-4969-8153-4ad635db2a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:17.757060 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695ac17-a8e9-4969-8153-4ad635db2a37 None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:17.757893 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c695ac17-a8e9-4969-8153-4ad635db2a37 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:17.758204 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c695ac17-a8e9-4969-8153-4ad635db2a37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:17.759678 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c695ac17-a8e9-4969-8153-4ad635db2a37 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:17.782954 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57148b2f-d070-4546-9083-e445d82eca46 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:17.796819 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 253/514] 10.222.0.62 () {56 vars in 1137 bytes} [Mon Jun 27 09:15:17 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:17.797654 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695ac17-a8e9-4969-8153-4ad635db2a37 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:17.805834 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:17.817065 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8b1f4-272a-400b-969a-0379ad489e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:17.818439 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8b1f4-272a-400b-969a-0379ad489e85 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:17.818709 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8b1f4-272a-400b-969a-0379ad489e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:17.818798 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8b1f4-272a-400b-969a-0379ad489e85 None admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:17.819634 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c8b1f4-272a-400b-969a-0379ad489e85 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:17.819955 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c8b1f4-272a-400b-969a-0379ad489e85 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:17.821424 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c8b1f4-272a-400b-969a-0379ad489e85 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:17.839266 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 262/515] 10.222.0.62 () {56 vars in 1137 bytes} [Mon Jun 27 09:15:17 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:17.841059 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8b1f4-272a-400b-969a-0379ad489e85 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:17.885580 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:17.897423 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695ac17-a8e9-4969-8153-4ad635db2a37 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:17.930760 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c3c66-6a33-4f3b-89bc-1bce6d0516aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:17.931420 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c3c66-6a33-4f3b-89bc-1bce6d0516aa None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:17.931701 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c3c66-6a33-4f3b-89bc-1bce6d0516aa None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:17.931978 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c3c66-6a33-4f3b-89bc-1bce6d0516aa None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:17.932763 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c3c66-6a33-4f3b-89bc-1bce6d0516aa None admin] RBAC: Adding query filter params (name=service) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:17.933067 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c3c66-6a33-4f3b-89bc-1bce6d0516aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:17.934449 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c3c66-6a33-4f3b-89bc-1bce6d0516aa None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:17.939366 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8b1f4-272a-400b-969a-0379ad489e85 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:17.942267 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 254/516] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Jun 27 09:15:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:17.943554 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c3c66-6a33-4f3b-89bc-1bce6d0516aa None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:17.973653 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3175ba-d85f-4fe3-990d-4ff83525e6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:17.974288 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3175ba-d85f-4fe3-990d-4ff83525e6f1 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:17.974563 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3175ba-d85f-4fe3-990d-4ff83525e6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:17.974838 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3175ba-d85f-4fe3-990d-4ff83525e6f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:17.975619 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3175ba-d85f-4fe3-990d-4ff83525e6f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:17.975922 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3175ba-d85f-4fe3-990d-4ff83525e6f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:17.977408 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3175ba-d85f-4fe3-990d-4ff83525e6f1 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:17.999470 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 263/517] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Jun 27 09:15:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:17.999470 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3175ba-d85f-4fe3-990d-4ff83525e6f1 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:18.039200 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:18.049342 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c3c66-6a33-4f3b-89bc-1bce6d0516aa None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:18.091567 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576837a9-4c51-4394-990a-c4f748bf80b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:18.092507 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576837a9-4c51-4394-990a-c4f748bf80b6 None admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:18.092969 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576837a9-4c51-4394-990a-c4f748bf80b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:18.093428 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576837a9-4c51-4394-990a-c4f748bf80b6 None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:18.094502 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576837a9-4c51-4394-990a-c4f748bf80b6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:18.097037 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576837a9-4c51-4394-990a-c4f748bf80b6 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:18.111146 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3175ba-d85f-4fe3-990d-4ff83525e6f1 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:18.144864 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da11e52-42cc-4183-8211-f3cff599e139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:18.145505 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da11e52-42cc-4183-8211-f3cff599e139 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:18.146397 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da11e52-42cc-4183-8211-f3cff599e139 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:18.146678 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da11e52-42cc-4183-8211-f3cff599e139 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:18.199419 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 255/518] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Jun 27 09:15:17 2022] POST /identity/v3/users => generated 247 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:15:18.200267 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576837a9-4c51-4394-990a-c4f748bf80b6 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:18.209598 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:18.227737 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da11e52-42cc-4183-8211-f3cff599e139 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:18.229330 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da11e52-42cc-4183-8211-f3cff599e139 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:18.280325 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:18.316526 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576837a9-4c51-4394-990a-c4f748bf80b6 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:18.345381 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 264/519] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:15:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 09:15:18.346250 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da11e52-42cc-4183-8211-f3cff599e139 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:18.365185 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9224aab-bc98-4fb8-8c23-684cb8959a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:18.366263 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9224aab-bc98-4fb8-8c23-684cb8959a55 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:18.366908 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9224aab-bc98-4fb8-8c23-684cb8959a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:18.367199 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9224aab-bc98-4fb8-8c23-684cb8959a55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:18.453405 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9224aab-bc98-4fb8-8c23-684cb8959a55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:18.455087 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9224aab-bc98-4fb8-8c23-684cb8959a55 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:18.463704 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da11e52-42cc-4183-8211-f3cff599e139 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:18.464812 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:18.500974 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68071cf3-747f-4c3c-bd26-7ff20a2fb19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:18.501780 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68071cf3-747f-4c3c-bd26-7ff20a2fb19e None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:18.502098 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68071cf3-747f-4c3c-bd26-7ff20a2fb19e None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:18.502379 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68071cf3-747f-4c3c-bd26-7ff20a2fb19e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:18.512304 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:18.514857 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68071cf3-747f-4c3c-bd26-7ff20a2fb19e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:18.516457 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68071cf3-747f-4c3c-bd26-7ff20a2fb19e None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:18.537165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-68071cf3-747f-4c3c-bd26-7ff20a2fb19e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:18.537165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:18.537165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:18.537165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:18.537165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:18.537165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:18.537165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:18.537165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:18.537165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:18.537165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:18.537165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:18.537165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:18.537165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:18.537165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:18.537165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:18.538074 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:18.538074 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:18.538074 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:18.538074 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:18.538074 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:18.538074 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:18.538074 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:18.538074 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:18.538074 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:18.538074 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:18.538074 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:18.538074 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:18.538074 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:18.538074 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:18.538074 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:18.538074 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:18.538074 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:18.538914 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:18.538914 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:18.538914 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:18.538914 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:18.541645 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 265/520] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:18.542787 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68071cf3-747f-4c3c-bd26-7ff20a2fb19e None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:18.562780 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 256/521] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:15:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 09:15:18.563709 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9224aab-bc98-4fb8-8c23-684cb8959a55 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:18.663837 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68071cf3-747f-4c3c-bd26-7ff20a2fb19e None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:18.668683 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9224aab-bc98-4fb8-8c23-684cb8959a55 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:18.678985 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:18.701104 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a700c-8288-46d8-be24-09ce80a84388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:18.701815 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a700c-8288-46d8-be24-09ce80a84388 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:18.702104 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a700c-8288-46d8-be24-09ce80a84388 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:18.702375 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a700c-8288-46d8-be24-09ce80a84388 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:18.703207 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a700c-8288-46d8-be24-09ce80a84388 None admin] RBAC: Adding query filter params (role.id=197a0da3099d45e4bcb9233039c21d8f, scope.project.id=4ba8e40538db4d89b93469b79322d20e, user.id=2c1434a85b30411c9c59cc50c3980cd8) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:18.703570 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a700c-8288-46d8-be24-09ce80a84388 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:18.705029 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a700c-8288-46d8-be24-09ce80a84388 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:18.709865 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134b9f6-dbee-40ca-a790-91c58d4d7ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:18.720615 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 266/522] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Jun 27 09:15:18 2022] GET /identity/v3/role_assignments?user.id=2c1434a85b30411c9c59cc50c3980cd8&scope.project.id=4ba8e40538db4d89b93469b79322d20e&role.id=197a0da3099d45e4bcb9233039c21d8f => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:18.720814 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134b9f6-dbee-40ca-a790-91c58d4d7ebd None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:18.720814 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134b9f6-dbee-40ca-a790-91c58d4d7ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:18.720814 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134b9f6-dbee-40ca-a790-91c58d4d7ebd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:18.721365 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a700c-8288-46d8-be24-09ce80a84388 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:18.733686 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1134b9f6-dbee-40ca-a790-91c58d4d7ebd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:18.735437 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1134b9f6-dbee-40ca-a790-91c58d4d7ebd None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:18.756338 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-1134b9f6-dbee-40ca-a790-91c58d4d7ebd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:18.756338 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:18.756338 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:18.756338 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:18.756338 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:18.756338 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:18.756338 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:18.756338 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:18.756338 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:18.756338 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:18.756338 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:18.756338 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:18.756338 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:18.756338 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:18.756338 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:18.757287 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:18.757287 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:18.757287 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:18.757287 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:18.757287 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:18.757287 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:18.757287 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:18.757287 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:18.757287 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:18.757287 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:18.757287 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:18.757287 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:18.757287 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:18.757287 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:18.757287 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:18.757287 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:18.757287 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:18.758138 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:18.758138 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:18.758138 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:18.758138 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:18.758138 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 257/523] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:18.758407 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134b9f6-dbee-40ca-a790-91c58d4d7ebd None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:18.790495 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:18.841091 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a700c-8288-46d8-be24-09ce80a84388 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:18.881772 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f7ac9-20df-4ed5-a912-f45a567d1eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:18.882591 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f7ac9-20df-4ed5-a912-f45a567d1eae None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:18.882938 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f7ac9-20df-4ed5-a912-f45a567d1eae None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:18.883283 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f7ac9-20df-4ed5-a912-f45a567d1eae None admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:18.884100 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f7ac9-20df-4ed5-a912-f45a567d1eae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:18.884503 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f7ac9-20df-4ed5-a912-f45a567d1eae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:18.886036 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f7ac9-20df-4ed5-a912-f45a567d1eae None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:18.891325 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134b9f6-dbee-40ca-a790-91c58d4d7ebd None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:18.905590 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 267/524] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:18.906501 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f7ac9-20df-4ed5-a912-f45a567d1eae None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:18.933789 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a6b4e-cb29-482a-9854-60083740784b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:18.934995 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a6b4e-cb29-482a-9854-60083740784b None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:18.935483 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a6b4e-cb29-482a-9854-60083740784b None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:18.936190 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a6b4e-cb29-482a-9854-60083740784b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:18.948014 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48a6b4e-cb29-482a-9854-60083740784b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:18.949904 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48a6b4e-cb29-482a-9854-60083740784b None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:18.969570 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-b48a6b4e-cb29-482a-9854-60083740784b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:18.969570 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:18.969570 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:18.969570 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:18.969570 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:18.969570 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:18.969570 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:18.969570 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:18.969570 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:18.969570 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:18.969570 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:18.969570 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:18.969570 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:18.969570 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:18.969570 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:18.970681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:18.970681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:18.970681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:18.970681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:18.970681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:18.970681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:18.970681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:18.970681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:18.970681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:18.970681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:18.970681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:18.970681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:18.970681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:18.970681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:18.970681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:18.970681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:18.970681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:18.971745 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:18.971745 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:18.971745 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:18.971745 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:18.973708 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 258/525] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:18.975220 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a6b4e-cb29-482a-9854-60083740784b None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:18.988256 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:19.035894 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f7ac9-20df-4ed5-a912-f45a567d1eae None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:19.054911 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:19.073866 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5940227-afdb-4934-8ba1-6dd47efd0f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:19.074556 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5940227-afdb-4934-8ba1-6dd47efd0f71 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:19.074843 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5940227-afdb-4934-8ba1-6dd47efd0f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:19.075118 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5940227-afdb-4934-8ba1-6dd47efd0f71 None admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:19.075847 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5940227-afdb-4934-8ba1-6dd47efd0f71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:19.076156 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5940227-afdb-4934-8ba1-6dd47efd0f71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:19.077855 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5940227-afdb-4934-8ba1-6dd47efd0f71 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:19.092304 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 268/526] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:19.092658 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5940227-afdb-4934-8ba1-6dd47efd0f71 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:19.109229 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a6b4e-cb29-482a-9854-60083740784b None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:19.162895 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a84ba-18bc-48d0-be30-bb8a14eb82c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:19.164105 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a84ba-18bc-48d0-be30-bb8a14eb82c3 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:19.164607 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a84ba-18bc-48d0-be30-bb8a14eb82c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:19.165118 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a84ba-18bc-48d0-be30-bb8a14eb82c3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:19.173292 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a84ba-18bc-48d0-be30-bb8a14eb82c3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:19.175117 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a84ba-18bc-48d0-be30-bb8a14eb82c3 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:19.191588 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-c77a84ba-18bc-48d0-be30-bb8a14eb82c3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 27 09:15:19.191588 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:19.191588 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:19.191588 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:19.191588 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:19.191588 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:19.191588 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:19.191588 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:19.191588 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:19.191588 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:19.191588 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:19.191588 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:19.191588 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 09:15:19.191588 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 09:15:19.191588 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 09:15:19.191588 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 09:15:19.192560 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:19.192560 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:19.192560 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 09:15:19.192560 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:15:19.192560 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 09:15:19.192560 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:15:19.192560 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:19.192560 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:19.192560 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:19.192560 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:19.192560 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:19.192560 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:19.192560 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:19.192560 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:19.192560 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:19.192560 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:19.192560 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:19.192560 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:19.193431 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:19.193431 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:19.193431 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 09:15:19.193431 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 09:15:19.193431 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 09:15:19.193431 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 09:15:19.193431 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 09:15:19.193431 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 09:15:19.193431 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 27 09:15:19.193431 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:19.196170 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 259/527] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Jun 27 09:15:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:19.197354 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a84ba-18bc-48d0-be30-bb8a14eb82c3 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:19.204931 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5940227-afdb-4934-8ba1-6dd47efd0f71 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:19.241380 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c16710-39d8-4771-97bc-14f5e2d9352e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:19.242075 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c16710-39d8-4771-97bc-14f5e2d9352e None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:19.242359 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c16710-39d8-4771-97bc-14f5e2d9352e None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:19.242638 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c16710-39d8-4771-97bc-14f5e2d9352e None admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:19.243370 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c16710-39d8-4771-97bc-14f5e2d9352e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:19.243682 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c16710-39d8-4771-97bc-14f5e2d9352e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:19.245101 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c16710-39d8-4771-97bc-14f5e2d9352e None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:19.262935 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 269/528] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:19.262935 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c16710-39d8-4771-97bc-14f5e2d9352e None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:19.282878 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:19.296637 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:19.317048 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a84ba-18bc-48d0-be30-bb8a14eb82c3 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:19.355562 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c07aa8-5695-4428-b761-bbaf7d5b1fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:19.357007 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c07aa8-5695-4428-b761-bbaf7d5b1fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:19.357565 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c07aa8-5695-4428-b761-bbaf7d5b1fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:19.358034 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c07aa8-5695-4428-b761-bbaf7d5b1fa4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:19.366676 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c07aa8-5695-4428-b761-bbaf7d5b1fa4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:19.367154 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c16710-39d8-4771-97bc-14f5e2d9352e None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:19.368993 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c07aa8-5695-4428-b761-bbaf7d5b1fa4 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:19.386984 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-66c07aa8-5695-4428-b761-bbaf7d5b1fa4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:15:19.386984 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:19.386984 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:19.386984 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:19.386984 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:19.386984 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:19.386984 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:19.386984 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:19.386984 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:19.386984 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:19.386984 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:19.386984 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:19.386984 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 09:15:19.386984 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 09:15:19.386984 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 09:15:19.387910 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 09:15:19.387910 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:19.387910 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:19.387910 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:19.387910 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:19.387910 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:19.387910 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:19.387910 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:19.387910 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:19.387910 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:19.387910 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:19.387910 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:19.387910 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:19.387910 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:19.387910 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:19.387910 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:19.387910 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:19.388786 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 09:15:19.388786 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 09:15:19.388786 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 09:15:19.388786 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 09:15:19.388786 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 09:15:19.388786 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 09:15:19.388786 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:15:19.388786 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:19.391413 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 260/529] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:15:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:19.392695 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c07aa8-5695-4428-b761-bbaf7d5b1fa4 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:19.406417 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e5e08c-7cd7-44a2-88cb-b0b96debe8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:19.407282 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5e08c-7cd7-44a2-88cb-b0b96debe8da None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:19.407391 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5e08c-7cd7-44a2-88cb-b0b96debe8da None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:19.407639 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5e08c-7cd7-44a2-88cb-b0b96debe8da None admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:19.408520 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e5e08c-7cd7-44a2-88cb-b0b96debe8da None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:19.408835 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e5e08c-7cd7-44a2-88cb-b0b96debe8da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:19.410299 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e5e08c-7cd7-44a2-88cb-b0b96debe8da None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:19.431069 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 270/530] 10.222.0.62 () {56 vars in 1139 bytes} [Mon Jun 27 09:15:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:19.431868 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e5e08c-7cd7-44a2-88cb-b0b96debe8da None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:19.512166 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c07aa8-5695-4428-b761-bbaf7d5b1fa4 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:19.530735 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:19.538272 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e5e08c-7cd7-44a2-88cb-b0b96debe8da None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:19.546227 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:19.552771 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede3920-505a-4efa-b22e-07994367071b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:19.554738 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede3920-505a-4efa-b22e-07994367071b None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:19.555298 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede3920-505a-4efa-b22e-07994367071b None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:19.555787 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede3920-505a-4efa-b22e-07994367071b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:19.563641 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ede3920-505a-4efa-b22e-07994367071b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:19.565898 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ede3920-505a-4efa-b22e-07994367071b None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:19.577942 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b5093-dae6-49ce-8eb7-761deb88df82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:19.578609 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b5093-dae6-49ce-8eb7-761deb88df82 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:19.578922 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b5093-dae6-49ce-8eb7-761deb88df82 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:19.579205 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b5093-dae6-49ce-8eb7-761deb88df82 None admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:19.580000 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b5093-dae6-49ce-8eb7-761deb88df82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:19.580352 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b5093-dae6-49ce-8eb7-761deb88df82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:19.581858 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b5093-dae6-49ce-8eb7-761deb88df82 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:19.583749 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-2ede3920-505a-4efa-b22e-07994367071b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:15:19.583749 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:19.583749 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:19.583749 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:19.583749 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:19.583749 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:19.583749 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:19.583749 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:19.583749 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:19.583749 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:19.583749 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:19.583749 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:19.583749 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 09:15:19.583749 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 09:15:19.583749 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 09:15:19.584615 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 09:15:19.584615 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:19.584615 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:19.584615 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:19.584615 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:19.584615 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:19.584615 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:19.584615 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:19.584615 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:19.584615 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:19.584615 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:19.584615 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:19.584615 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:19.584615 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:19.584615 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:19.584615 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:19.584615 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:19.585451 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 09:15:19.585451 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 09:15:19.585451 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 09:15:19.585451 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 09:15:19.585451 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 09:15:19.585451 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 09:15:19.585451 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:15:19.585451 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:19.592277 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 261/531] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:15:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:19.593538 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede3920-505a-4efa-b22e-07994367071b None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:19.594848 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 271/532] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Jun 27 09:15:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:19.595565 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b5093-dae6-49ce-8eb7-761deb88df82 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:19.699043 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b5093-dae6-49ce-8eb7-761deb88df82 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:19.706017 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede3920-505a-4efa-b22e-07994367071b None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:19.734852 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d947fe-98a2-4d76-bf82-90d73ee3cf95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:19.735440 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d947fe-98a2-4d76-bf82-90d73ee3cf95 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:19.735727 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d947fe-98a2-4d76-bf82-90d73ee3cf95 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:19.736006 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d947fe-98a2-4d76-bf82-90d73ee3cf95 None admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:19.736838 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d947fe-98a2-4d76-bf82-90d73ee3cf95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:19.737156 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d947fe-98a2-4d76-bf82-90d73ee3cf95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:19.738750 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d947fe-98a2-4d76-bf82-90d73ee3cf95 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:19.748493 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e5e1e-3a1a-48c6-935b-6fbaa80f774a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:19.750101 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e5e1e-3a1a-48c6-935b-6fbaa80f774a None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:19.750583 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e5e1e-3a1a-48c6-935b-6fbaa80f774a None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:19.751261 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e5e1e-3a1a-48c6-935b-6fbaa80f774a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:19.760231 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 272/533] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Jun 27 09:15:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:19.760231 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d947fe-98a2-4d76-bf82-90d73ee3cf95 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:19.775833 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:19.828614 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:19.840626 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e5e1e-3a1a-48c6-935b-6fbaa80f774a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:19.842568 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e5e1e-3a1a-48c6-935b-6fbaa80f774a None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:19.867820 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d947fe-98a2-4d76-bf82-90d73ee3cf95 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:19.906299 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0ec05-869d-4827-aa62-33a51c11ff66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:19.907101 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0ec05-869d-4827-aa62-33a51c11ff66 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:19.907639 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0ec05-869d-4827-aa62-33a51c11ff66 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:19.907767 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0ec05-869d-4827-aa62-33a51c11ff66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:19.908736 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e0ec05-869d-4827-aa62-33a51c11ff66 None admin] RBAC: Adding query filter params (role.id=197a0da3099d45e4bcb9233039c21d8f, scope.project.id=4ba8e40538db4d89b93469b79322d20e, user.id=333bceb4a90749df97595b7f38bf7ea6) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:19.909117 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e0ec05-869d-4827-aa62-33a51c11ff66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:19.910598 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e0ec05-869d-4827-aa62-33a51c11ff66 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:19.918104 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 273/534] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Jun 27 09:15:19 2022] GET /identity/v3/role_assignments?user.id=333bceb4a90749df97595b7f38bf7ea6&scope.project.id=4ba8e40538db4d89b93469b79322d20e&role.id=197a0da3099d45e4bcb9233039c21d8f => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:19.919112 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0ec05-869d-4827-aa62-33a51c11ff66 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:19.960023 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 262/535] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:15:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 09:15:19.965225 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e5e1e-3a1a-48c6-935b-6fbaa80f774a None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:20.011217 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:20.036875 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0ec05-869d-4827-aa62-33a51c11ff66 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:20.077685 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f34e921-ca77-4556-b162-df893fbd750a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:20.078379 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34e921-ca77-4556-b162-df893fbd750a None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:20.078669 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34e921-ca77-4556-b162-df893fbd750a None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:20.078949 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34e921-ca77-4556-b162-df893fbd750a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:20.080307 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f34e921-ca77-4556-b162-df893fbd750a None admin] RBAC: Adding query filter params (role.id=197a0da3099d45e4bcb9233039c21d8f, scope.project.id=4ba8e40538db4d89b93469b79322d20e, user.id=e6f97b803a28453c8b78fd8380ac64ad) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:20.080307 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f34e921-ca77-4556-b162-df893fbd750a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:20.081808 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f34e921-ca77-4556-b162-df893fbd750a None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:20.096954 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 274/536] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Jun 27 09:15:19 2022] GET /identity/v3/role_assignments?user.id=e6f97b803a28453c8b78fd8380ac64ad&scope.project.id=4ba8e40538db4d89b93469b79322d20e&role.id=197a0da3099d45e4bcb9233039c21d8f => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:20.115061 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:20.121971 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e5e1e-3a1a-48c6-935b-6fbaa80f774a None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:20.183787 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9600910-389d-4b01-a55d-7e822aebcb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:20.184644 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9600910-389d-4b01-a55d-7e822aebcb35 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:20.184969 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9600910-389d-4b01-a55d-7e822aebcb35 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:20.185246 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9600910-389d-4b01-a55d-7e822aebcb35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:20.197544 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9600910-389d-4b01-a55d-7e822aebcb35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:20.199142 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9600910-389d-4b01-a55d-7e822aebcb35 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:20.219465 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-f9600910-389d-4b01-a55d-7e822aebcb35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:20.219465 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:20.219465 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:20.219465 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:20.219465 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:20.219465 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:20.219465 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:20.219465 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:20.219465 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:20.219465 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:20.219465 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:20.219465 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:20.219465 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:20.219465 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:20.219465 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:20.220524 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:20.220524 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:20.220524 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:20.220524 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:20.220524 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:20.220524 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:20.220524 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:20.220524 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:20.220524 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:20.220524 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:20.220524 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:20.220524 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:20.220524 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:20.220524 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:20.220524 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:20.220524 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:20.220524 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:20.221391 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:20.221391 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:20.221391 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:20.221391 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:20.225437 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 263/537] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 09:15:20.227508 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f34e921-ca77-4556-b162-df893fbd750a None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:20.342631 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8bf41-12ae-4ee3-86dd-aeadb9e1f059 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:20.342940 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8bf41-12ae-4ee3-86dd-aeadb9e1f059 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:20.343282 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8bf41-12ae-4ee3-86dd-aeadb9e1f059 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:20.345042 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 264/538] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 09:15:20.350430 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf900a-1c76-4d59-ae14-2db002fda574 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:20.350716 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf900a-1c76-4d59-ae14-2db002fda574 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:20.350995 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf900a-1c76-4d59-ae14-2db002fda574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:20.383889 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-5dbf900a-1c76-4d59-ae14-2db002fda574 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:20.385120 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-5dbf900a-1c76-4d59-ae14-2db002fda574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:20.401789 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f34e921-ca77-4556-b162-df893fbd750a None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:20.454284 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9033bb-770f-4a8c-837c-d0cbbbb5171c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:20.454954 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9033bb-770f-4a8c-837c-d0cbbbb5171c None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:20.455238 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9033bb-770f-4a8c-837c-d0cbbbb5171c None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:20.455515 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9033bb-770f-4a8c-837c-d0cbbbb5171c None admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:20.458711 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9033bb-770f-4a8c-837c-d0cbbbb5171c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:20.459040 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9033bb-770f-4a8c-837c-d0cbbbb5171c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:20.460481 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9033bb-770f-4a8c-837c-d0cbbbb5171c None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:20.486215 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 275/539] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:20.492758 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9033bb-770f-4a8c-837c-d0cbbbb5171c None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:20.512589 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:20.553516 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 265/540] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 09:15:20.578285 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf900a-1c76-4d59-ae14-2db002fda574 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:20.674980 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9033bb-770f-4a8c-837c-d0cbbbb5171c None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:20.691975 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:20.719246 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347cf08-ee5f-4d0e-8352-8abcec81807b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:20.720511 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347cf08-ee5f-4d0e-8352-8abcec81807b None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:20.721020 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347cf08-ee5f-4d0e-8352-8abcec81807b None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:20.721497 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347cf08-ee5f-4d0e-8352-8abcec81807b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:20.729396 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4347cf08-ee5f-4d0e-8352-8abcec81807b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:20.731167 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4347cf08-ee5f-4d0e-8352-8abcec81807b None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:20.748395 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-4347cf08-ee5f-4d0e-8352-8abcec81807b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:15:20.748395 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:20.748395 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:20.748395 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:20.748395 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:20.748395 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:20.748395 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:20.748395 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:20.748395 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:20.748395 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:20.748395 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:20.748395 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:20.748395 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 09:15:20.748395 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 09:15:20.748395 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 09:15:20.749267 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 09:15:20.749267 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:20.749267 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:20.749267 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:20.749267 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:20.749267 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:20.749267 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:20.749267 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:20.749267 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:20.749267 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:20.749267 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:20.749267 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:20.749267 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:20.749267 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:20.749267 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:20.749267 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:20.749267 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:20.750097 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 09:15:20.750097 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 09:15:20.750097 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 09:15:20.750097 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 09:15:20.750097 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 09:15:20.750097 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 09:15:20.750097 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:15:20.750097 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:20.750502 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf900a-1c76-4d59-ae14-2db002fda574 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:20.753074 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 276/541] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:15:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:20.759705 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347cf08-ee5f-4d0e-8352-8abcec81807b None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:20.797858 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a7f57-7095-4c81-a1dd-1c1d1cf31091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:20.799941 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a7f57-7095-4c81-a1dd-1c1d1cf31091 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:20.800512 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a7f57-7095-4c81-a1dd-1c1d1cf31091 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:20.802586 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a7f57-7095-4c81-a1dd-1c1d1cf31091 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:20.825838 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a7f57-7095-4c81-a1dd-1c1d1cf31091 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:15:20.840824 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-d52a7f57-7095-4c81-a1dd-1c1d1cf31091 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 09:15:20.840824 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:20.840824 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:20.840824 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:20.840824 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:20.840824 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:20.840824 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:20.840824 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:20.840824 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:20.840824 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:20.840824 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:20.840824 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:20.840824 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:15:20.840824 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:15:20.840824 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:15:20.840824 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:15:20.841755 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:15:20.841755 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:15:20.841755 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:15:20.841755 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:15:20.841755 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:20.841755 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:20.841755 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:20.841755 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:20.841755 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:20.841755 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:20.841755 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:20.841755 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:20.841755 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:20.841755 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:20.841755 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:20.841755 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:20.842527 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:20.842527 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:20.842527 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:20.842527 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:20.842527 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:15:20.842527 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:15:20.842527 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:15:20.842527 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:15:20.842527 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:15:20.842527 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:15:20.842527 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 09:15:20.842527 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:20.852313 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 266/542] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Jun 27 09:15:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 09:15:20.858095 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a7f57-7095-4c81-a1dd-1c1d1cf31091 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:20.882058 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:20.981553 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a7f57-7095-4c81-a1dd-1c1d1cf31091 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:20.986380 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347cf08-ee5f-4d0e-8352-8abcec81807b None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:21.029661 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:21.039013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68904e-39f9-40cc-9acd-32904f7b540d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:21.040716 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68904e-39f9-40cc-9acd-32904f7b540d None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:21.041208 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68904e-39f9-40cc-9acd-32904f7b540d None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:21.041683 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68904e-39f9-40cc-9acd-32904f7b540d None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:21.042638 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e68904e-39f9-40cc-9acd-32904f7b540d None admin] RBAC: Adding query filter params (name=service) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:21.043168 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e68904e-39f9-40cc-9acd-32904f7b540d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:21.044938 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e68904e-39f9-40cc-9acd-32904f7b540d None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:21.058057 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb38577-c074-48ba-b8b6-4aee99e230e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:21.059002 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 267/543] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Jun 27 09:15:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:15:21.059914 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb38577-c074-48ba-b8b6-4aee99e230e8 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:21.060446 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb38577-c074-48ba-b8b6-4aee99e230e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:21.060938 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb38577-c074-48ba-b8b6-4aee99e230e8 None admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:21.061947 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb38577-c074-48ba-b8b6-4aee99e230e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:21.062461 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb38577-c074-48ba-b8b6-4aee99e230e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:21.064161 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb38577-c074-48ba-b8b6-4aee99e230e8 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:21.065244 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68904e-39f9-40cc-9acd-32904f7b540d None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:21.093723 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 277/544] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Jun 27 09:15:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:21.101333 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb38577-c074-48ba-b8b6-4aee99e230e8 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:21.218558 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68904e-39f9-40cc-9acd-32904f7b540d None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:21.241005 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb38577-c074-48ba-b8b6-4aee99e230e8 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:21.254056 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb69ffa3-39c9-48c2-88a6-611b6ed50e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:21.254939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69ffa3-39c9-48c2-88a6-611b6ed50e88 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:21.255164 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69ffa3-39c9-48c2-88a6-611b6ed50e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:21.255443 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69ffa3-39c9-48c2-88a6-611b6ed50e88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:21.265935 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb69ffa3-39c9-48c2-88a6-611b6ed50e88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:21.267437 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb69ffa3-39c9-48c2-88a6-611b6ed50e88 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:21.268375 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:21.281991 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a72adf-3a4f-4533-b16e-a71237e8e052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:21.282943 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a72adf-3a4f-4533-b16e-a71237e8e052 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:21.283453 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a72adf-3a4f-4533-b16e-a71237e8e052 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:21.283925 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a72adf-3a4f-4533-b16e-a71237e8e052 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:21.285007 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a72adf-3a4f-4533-b16e-a71237e8e052 None admin] RBAC: Adding query filter params (role.id=197a0da3099d45e4bcb9233039c21d8f, scope.project.id=4ba8e40538db4d89b93469b79322d20e, user.id=097b991d67164cda94cc5aa24397f414) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:21.285522 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a72adf-3a4f-4533-b16e-a71237e8e052 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:21.287311 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-cb69ffa3-39c9-48c2-88a6-611b6ed50e88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:21.287311 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:21.287311 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:21.287311 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:21.287311 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:21.287311 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:21.287311 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:21.287311 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:21.287311 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:21.287311 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:21.287311 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:21.287311 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:21.287311 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:21.287311 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:21.287311 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:21.288133 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:21.288133 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:21.288133 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:21.288133 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:21.288133 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:21.288133 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:21.288133 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:21.288133 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:21.288133 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:21.288133 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:21.288133 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:21.288133 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:21.288133 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:21.288133 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:21.288133 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:21.288133 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:21.288133 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:21.289083 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:21.289083 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:21.289083 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:21.289083 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:21.289083 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 268/545] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:21.290308 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a72adf-3a4f-4533-b16e-a71237e8e052 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:21.290414 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495c219-dc82-4229-a9da-57bc3577069b None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:21.290665 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495c219-dc82-4229-a9da-57bc3577069b None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:21.290949 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495c219-dc82-4229-a9da-57bc3577069b None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:21.292807 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 269/546] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:15:21.297146 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f495c219-dc82-4229-a9da-57bc3577069b None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:21.303761 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 278/547] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Jun 27 09:15:21 2022] GET /identity/v3/role_assignments?user.id=097b991d67164cda94cc5aa24397f414&scope.project.id=4ba8e40538db4d89b93469b79322d20e&role.id=197a0da3099d45e4bcb9233039c21d8f => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:21.305412 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d16d9-db70-4345-aa31-1f704db77680 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:21.305765 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d16d9-db70-4345-aa31-1f704db77680 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:21.306154 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d16d9-db70-4345-aa31-1f704db77680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:21.342533 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-3b5d16d9-db70-4345-aa31-1f704db77680 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:21.343808 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-3b5d16d9-db70-4345-aa31-1f704db77680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:21.356621 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:21.415047 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f495c219-dc82-4229-a9da-57bc3577069b None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:21.453961 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88988099-ce30-4be9-a05b-92651c257698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:21.454766 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88988099-ce30-4be9-a05b-92651c257698 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:21.455120 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88988099-ce30-4be9-a05b-92651c257698 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:21.455466 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88988099-ce30-4be9-a05b-92651c257698 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:21.456313 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88988099-ce30-4be9-a05b-92651c257698 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:21.456690 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88988099-ce30-4be9-a05b-92651c257698 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:21.458729 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88988099-ce30-4be9-a05b-92651c257698 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:21.472273 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 270/548] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:21.478009 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88988099-ce30-4be9-a05b-92651c257698 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:21.479103 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 279/549] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:15:21.565309 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d16d9-db70-4345-aa31-1f704db77680 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:21.612920 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88988099-ce30-4be9-a05b-92651c257698 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:21.620590 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:21.653822 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc13ada-9cfa-44ef-9604-3755d9f69c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:21.654763 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc13ada-9cfa-44ef-9604-3755d9f69c6d None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:21.655791 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc13ada-9cfa-44ef-9604-3755d9f69c6d None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:21.656149 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc13ada-9cfa-44ef-9604-3755d9f69c6d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:21.667549 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc13ada-9cfa-44ef-9604-3755d9f69c6d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:21.671954 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc13ada-9cfa-44ef-9604-3755d9f69c6d None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:21.689444 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-ecc13ada-9cfa-44ef-9604-3755d9f69c6d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 27 09:15:21.689444 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:21.689444 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:21.689444 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:21.689444 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:21.689444 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:21.689444 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:21.689444 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:21.689444 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:21.689444 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:21.689444 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:21.689444 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:21.689444 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 09:15:21.689444 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 09:15:21.689444 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 09:15:21.689444 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 09:15:21.690579 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:21.690579 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:21.690579 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 09:15:21.690579 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:15:21.690579 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 09:15:21.690579 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:15:21.690579 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:21.690579 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:21.690579 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:21.690579 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:21.690579 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:21.690579 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:21.690579 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:21.690579 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:21.690579 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:21.690579 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:21.690579 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:21.690579 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:21.691632 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:21.691632 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:21.691632 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 09:15:21.691632 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 09:15:21.691632 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 09:15:21.691632 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 09:15:21.691632 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 09:15:21.691632 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 09:15:21.691632 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 27 09:15:21.691632 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:21.693529 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 271/550] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Jun 27 09:15:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:21.704960 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc13ada-9cfa-44ef-9604-3755d9f69c6d None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:21.748938 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d16d9-db70-4345-aa31-1f704db77680 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:21.780624 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:21.812114 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133669e4-b157-4bde-ad95-3177a075a9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:21.812931 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133669e4-b157-4bde-ad95-3177a075a9ec None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:21.813198 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133669e4-b157-4bde-ad95-3177a075a9ec None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:21.813641 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133669e4-b157-4bde-ad95-3177a075a9ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:21.832416 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133669e4-b157-4bde-ad95-3177a075a9ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:15:21.842893 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-133669e4-b157-4bde-ad95-3177a075a9ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 09:15:21.842893 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:21.842893 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:21.842893 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:21.842893 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:21.842893 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:21.842893 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:21.842893 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:21.842893 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:21.842893 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:21.842893 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:21.842893 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:21.842893 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:15:21.842893 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:15:21.842893 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:15:21.842893 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:15:21.843834 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:15:21.843834 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:15:21.843834 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:15:21.843834 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:15:21.843834 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:21.843834 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:21.843834 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:21.843834 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:21.843834 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:21.843834 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:21.843834 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:21.843834 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:21.843834 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:21.843834 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:21.843834 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:21.843834 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:21.844688 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:21.844688 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:21.844688 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:21.844688 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:21.844688 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:15:21.844688 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:15:21.844688 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:15:21.844688 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:15:21.844688 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:15:21.844688 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:15:21.844688 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 09:15:21.844688 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:21.844688 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 280/551] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Jun 27 09:15:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:21.850048 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133669e4-b157-4bde-ad95-3177a075a9ec None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:21.879624 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc13ada-9cfa-44ef-9604-3755d9f69c6d None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:21.958396 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62af78-20f6-4dc0-b286-85cdf8a3252f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:21.959079 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62af78-20f6-4dc0-b286-85cdf8a3252f None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:21.959364 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62af78-20f6-4dc0-b286-85cdf8a3252f None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:21.959639 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62af78-20f6-4dc0-b286-85cdf8a3252f None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:21.960514 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62af78-20f6-4dc0-b286-85cdf8a3252f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:21.960828 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62af78-20f6-4dc0-b286-85cdf8a3252f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:21.962277 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62af78-20f6-4dc0-b286-85cdf8a3252f None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:21.966540 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133669e4-b157-4bde-ad95-3177a075a9ec None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:22.010391 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383f245-ef36-4dda-86ac-840bd590cbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:22.011073 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383f245-ef36-4dda-86ac-840bd590cbb9 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:22.011358 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383f245-ef36-4dda-86ac-840bd590cbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:22.011636 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383f245-ef36-4dda-86ac-840bd590cbb9 None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:22.015016 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 272/552] 10.222.0.62 () {56 vars in 1135 bytes} [Mon Jun 27 09:15:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:22.015172 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0383f245-ef36-4dda-86ac-840bd590cbb9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:22.015558 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0383f245-ef36-4dda-86ac-840bd590cbb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:22.017120 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0383f245-ef36-4dda-86ac-840bd590cbb9 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:22.020982 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62af78-20f6-4dc0-b286-85cdf8a3252f None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:22.041354 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 281/553] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Jun 27 09:15:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:22.047512 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383f245-ef36-4dda-86ac-840bd590cbb9 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:22.072858 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:22.142752 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:22.169734 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62af78-20f6-4dc0-b286-85cdf8a3252f None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:22.212092 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974e5e6-91f8-472b-aa21-9b946bec5e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:22.213045 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974e5e6-91f8-472b-aa21-9b946bec5e0c None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:22.213498 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974e5e6-91f8-472b-aa21-9b946bec5e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:22.213907 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974e5e6-91f8-472b-aa21-9b946bec5e0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:22.259780 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383f245-ef36-4dda-86ac-840bd590cbb9 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:22.333452 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf384d-0bba-40ad-81c3-aece594c123c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:22.335108 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf384d-0bba-40ad-81c3-aece594c123c None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:22.340642 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf384d-0bba-40ad-81c3-aece594c123c None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:22.340965 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf384d-0bba-40ad-81c3-aece594c123c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:22.346318 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a974e5e6-91f8-472b-aa21-9b946bec5e0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:22.347972 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a974e5e6-91f8-472b-aa21-9b946bec5e0c None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:22.356869 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cf384d-0bba-40ad-81c3-aece594c123c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:22.358329 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cf384d-0bba-40ad-81c3-aece594c123c None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:22.375749 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:22.377032 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-43cf384d-0bba-40ad-81c3-aece594c123c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:22.377032 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:22.377032 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:22.377032 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:22.377032 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:22.377032 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:22.377032 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:22.377032 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:22.377032 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:22.377032 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:22.377032 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:22.377032 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:22.377032 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:22.377032 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:22.377032 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:22.378056 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:22.378056 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:22.378056 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:22.378056 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:22.378056 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:22.378056 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:22.378056 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:22.378056 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:22.378056 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:22.378056 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:22.378056 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:22.378056 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:22.378056 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:22.378056 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:22.378056 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:22.378056 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:22.378056 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:22.379144 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:22.379144 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:22.379144 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:22.379144 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:22.382994 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 282/554] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:22.388008 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf384d-0bba-40ad-81c3-aece594c123c None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:22.479661 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 273/555] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:15:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 09:15:22.482043 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd168abe-a0b8-4f26-97c6-72ffbd9559ea None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:22.482731 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd168abe-a0b8-4f26-97c6-72ffbd9559ea None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:22.483152 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd168abe-a0b8-4f26-97c6-72ffbd9559ea None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:22.485421 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 274/556] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:15:22.486380 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd168abe-a0b8-4f26-97c6-72ffbd9559ea None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:22.492646 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:22.509096 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf384d-0bba-40ad-81c3-aece594c123c None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:22.554132 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a9fc6f-425c-41df-ab2c-f978211d49c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:22.554787 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a9fc6f-425c-41df-ab2c-f978211d49c7 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:22.555067 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a9fc6f-425c-41df-ab2c-f978211d49c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:22.555404 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a9fc6f-425c-41df-ab2c-f978211d49c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:22.556154 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a9fc6f-425c-41df-ab2c-f978211d49c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:22.556414 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a9fc6f-425c-41df-ab2c-f978211d49c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:22.557779 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a9fc6f-425c-41df-ab2c-f978211d49c7 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:22.574489 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 283/557] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:22.574489 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70c389-c31d-49b2-9ac7-dbf0516ab590 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:22.574489 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70c389-c31d-49b2-9ac7-dbf0516ab590 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:22.574489 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70c389-c31d-49b2-9ac7-dbf0516ab590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:22.590948 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-8d70c389-c31d-49b2-9ac7-dbf0516ab590 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:22.592460 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-8d70c389-c31d-49b2-9ac7-dbf0516ab590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:22.603283 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd168abe-a0b8-4f26-97c6-72ffbd9559ea None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:22.628374 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:22.641230 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48419b00-7df6-472e-b53b-5d702d01269d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:22.642029 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48419b00-7df6-472e-b53b-5d702d01269d None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:22.642303 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48419b00-7df6-472e-b53b-5d702d01269d None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:22.642578 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48419b00-7df6-472e-b53b-5d702d01269d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:22.655691 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48419b00-7df6-472e-b53b-5d702d01269d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:22.657575 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48419b00-7df6-472e-b53b-5d702d01269d None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:22.669152 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 284/558] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:15:22.670790 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bb383-9c28-4eb3-b2bc-e4c140e17859 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:22.670790 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bb383-9c28-4eb3-b2bc-e4c140e17859 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:22.671375 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bb383-9c28-4eb3-b2bc-e4c140e17859 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:22.680177 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 285/559] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:15:22.680177 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3bb383-9c28-4eb3-b2bc-e4c140e17859 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:22.680438 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-48419b00-7df6-472e-b53b-5d702d01269d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:22.680438 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:22.680438 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:22.680438 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:22.680438 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:22.680438 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:22.680438 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:22.680438 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:22.680438 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:22.680438 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:22.680438 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:22.680438 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:22.680438 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:22.680438 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:22.680438 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:22.681255 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:22.681255 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:22.681255 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:22.681255 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:22.681255 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:22.681255 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:22.681255 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:22.681255 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:22.681255 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:22.681255 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:22.681255 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:22.681255 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:22.681255 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:22.681255 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:22.681255 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:22.681255 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:22.681255 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:22.682130 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:22.682130 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:22.682130 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:22.682130 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:22.683566 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 275/560] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:22.684845 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2996a1-eeea-4504-9e1c-842fa8079545 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:22.685140 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2996a1-eeea-4504-9e1c-842fa8079545 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:22.685416 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2996a1-eeea-4504-9e1c-842fa8079545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:22.702076 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-8e2996a1-eeea-4504-9e1c-842fa8079545 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:22.703261 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-8e2996a1-eeea-4504-9e1c-842fa8079545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:22.777339 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 276/561] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:15:22.777676 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:22.779049 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2996a1-eeea-4504-9e1c-842fa8079545 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:22.806015 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3bb383-9c28-4eb3-b2bc-e4c140e17859 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:22.842477 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c3ed7-87d9-4df4-9647-c55793599a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:22.843266 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c3ed7-87d9-4df4-9647-c55793599a1e None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:22.843552 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c3ed7-87d9-4df4-9647-c55793599a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:22.843827 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c3ed7-87d9-4df4-9647-c55793599a1e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:22.852003 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68c3ed7-87d9-4df4-9647-c55793599a1e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:22.853468 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68c3ed7-87d9-4df4-9647-c55793599a1e None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:22.867755 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-a68c3ed7-87d9-4df4-9647-c55793599a1e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 27 09:15:22.867755 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:22.867755 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:22.867755 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:22.867755 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:22.867755 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:22.867755 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:22.867755 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:22.867755 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:22.867755 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:22.867755 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:22.867755 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:22.867755 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 09:15:22.867755 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 09:15:22.867755 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 09:15:22.867755 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 09:15:22.869070 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:22.869070 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:22.869070 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 09:15:22.869070 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:15:22.869070 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 09:15:22.869070 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:15:22.869070 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:22.869070 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:22.869070 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:22.869070 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:22.869070 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:22.869070 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:22.869070 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:22.869070 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:22.869070 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:22.869070 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:22.869070 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:22.869070 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:22.870265 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:22.870265 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:22.870265 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 09:15:22.870265 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 09:15:22.870265 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 09:15:22.870265 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 09:15:22.870265 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 09:15:22.870265 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 09:15:22.870265 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 27 09:15:22.870265 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:22.873745 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 286/562] 10.222.0.62 () {56 vars in 1093 bytes} [Mon Jun 27 09:15:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:22.874619 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c3ed7-87d9-4df4-9647-c55793599a1e None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:22.903501 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2996a1-eeea-4504-9e1c-842fa8079545 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:22.914371 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:22.944137 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d1e55-dd3c-4fdd-814e-35726db18382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:22.944841 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d1e55-dd3c-4fdd-814e-35726db18382 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:22.945188 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d1e55-dd3c-4fdd-814e-35726db18382 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:22.945466 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d1e55-dd3c-4fdd-814e-35726db18382 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:22.946277 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d1e55-dd3c-4fdd-814e-35726db18382 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:22.946549 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d1e55-dd3c-4fdd-814e-35726db18382 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:22.948569 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d1e55-dd3c-4fdd-814e-35726db18382 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:22.962146 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 277/563] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:22.965148 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d1e55-dd3c-4fdd-814e-35726db18382 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:22.998134 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c3ed7-87d9-4df4-9647-c55793599a1e None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:23.037286 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534b221-5dfb-4c75-ba7f-c4490c9940c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:23.038141 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534b221-5dfb-4c75-ba7f-c4490c9940c6 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:23.038432 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534b221-5dfb-4c75-ba7f-c4490c9940c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:23.038712 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534b221-5dfb-4c75-ba7f-c4490c9940c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:23.047009 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:23.049835 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1534b221-5dfb-4c75-ba7f-c4490c9940c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:15:23.057829 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-1534b221-5dfb-4c75-ba7f-c4490c9940c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 09:15:23.057829 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:23.057829 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:23.057829 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:23.057829 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:23.057829 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:23.057829 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:23.057829 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:23.057829 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:23.057829 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:23.057829 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:23.057829 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:23.057829 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:15:23.057829 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:15:23.057829 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:15:23.057829 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:15:23.065030 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:15:23.065030 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:15:23.065030 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:15:23.065030 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:15:23.065030 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:23.065030 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:23.065030 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:23.065030 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:23.065030 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:23.065030 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:23.065030 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:23.065030 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:23.065030 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:23.065030 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:23.065030 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:23.065030 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:23.065857 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:23.065857 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:23.065857 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:23.065857 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:23.065857 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:15:23.065857 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:15:23.065857 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:15:23.065857 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:15:23.065857 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:15:23.065857 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:15:23.065857 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 09:15:23.065857 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:23.065857 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 287/564] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Jun 27 09:15:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:23.065857 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534b221-5dfb-4c75-ba7f-c4490c9940c6 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:23.087989 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d1e55-dd3c-4fdd-814e-35726db18382 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:23.126492 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74440503-078b-487b-abf3-c71523e69efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:23.127542 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74440503-078b-487b-abf3-c71523e69efd None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:23.127984 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74440503-078b-487b-abf3-c71523e69efd None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:23.128371 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74440503-078b-487b-abf3-c71523e69efd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:23.140570 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74440503-078b-487b-abf3-c71523e69efd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:15:23.149874 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-74440503-078b-487b-abf3-c71523e69efd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 09:15:23.149874 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:23.149874 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:23.149874 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:23.149874 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:23.149874 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:23.149874 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:23.149874 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:23.149874 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:23.149874 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:23.149874 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:23.149874 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:23.149874 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:15:23.149874 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:15:23.149874 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:15:23.149874 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:15:23.151035 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:15:23.151035 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:15:23.151035 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:15:23.151035 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:15:23.151035 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:23.151035 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:23.151035 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:23.151035 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:23.151035 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:23.151035 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:23.151035 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:23.151035 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:23.151035 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:23.151035 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:23.151035 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:23.151035 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:23.152169 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:23.152169 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:23.152169 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:23.152169 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:23.152169 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:15:23.152169 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:15:23.152169 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:15:23.152169 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:15:23.152169 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:15:23.152169 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:15:23.152169 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 09:15:23.152169 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:23.152169 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 278/565] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Jun 27 09:15:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:23.153424 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74440503-078b-487b-abf3-c71523e69efd None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:23.181375 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:23.190324 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534b221-5dfb-4c75-ba7f-c4490c9940c6 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:23.228444 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deac021-65c3-41bd-9ee2-628977e96388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:23.229645 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deac021-65c3-41bd-9ee2-628977e96388 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:23.229926 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deac021-65c3-41bd-9ee2-628977e96388 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:23.230198 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deac021-65c3-41bd-9ee2-628977e96388 None admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:23.231041 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deac021-65c3-41bd-9ee2-628977e96388 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:23.231349 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deac021-65c3-41bd-9ee2-628977e96388 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:23.232831 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deac021-65c3-41bd-9ee2-628977e96388 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:23.250365 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 288/566] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Jun 27 09:15:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:23.251202 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deac021-65c3-41bd-9ee2-628977e96388 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:23.269423 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74440503-078b-487b-abf3-c71523e69efd None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:23.305967 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe1fc7-6941-4ff3-8c2b-270487206a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:23.307041 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe1fc7-6941-4ff3-8c2b-270487206a72 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:23.307489 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe1fc7-6941-4ff3-8c2b-270487206a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:23.308035 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe1fc7-6941-4ff3-8c2b-270487206a72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:23.310888 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:23.316019 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effe1fc7-6941-4ff3-8c2b-270487206a72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:23.321636 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effe1fc7-6941-4ff3-8c2b-270487206a72 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:23.331733 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-effe1fc7-6941-4ff3-8c2b-270487206a72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:15:23.331733 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:23.331733 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:23.331733 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:23.331733 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:23.331733 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:23.331733 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:23.331733 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:23.331733 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:23.331733 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:23.331733 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:23.331733 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:23.331733 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 09:15:23.331733 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 09:15:23.331733 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 09:15:23.332877 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 09:15:23.332877 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:23.332877 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:23.332877 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:23.332877 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:23.332877 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:23.332877 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:23.332877 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:23.332877 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:23.332877 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:23.332877 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:23.332877 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:23.332877 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:23.332877 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:23.332877 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:23.332877 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:23.332877 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:23.334330 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 09:15:23.334330 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 09:15:23.334330 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 09:15:23.334330 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 09:15:23.334330 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 09:15:23.334330 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 09:15:23.334330 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:15:23.334330 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:23.334330 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 279/567] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:15:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:23.334330 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe1fc7-6941-4ff3-8c2b-270487206a72 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:23.362091 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deac021-65c3-41bd-9ee2-628977e96388 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:23.410891 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6097caf-50ec-48d0-b4f5-308b721d1f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:23.411941 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6097caf-50ec-48d0-b4f5-308b721d1f2f None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:23.412336 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6097caf-50ec-48d0-b4f5-308b721d1f2f None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:23.412515 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6097caf-50ec-48d0-b4f5-308b721d1f2f None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:23.413243 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6097caf-50ec-48d0-b4f5-308b721d1f2f None admin] RBAC: Adding query filter params (name=service) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:23.413555 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6097caf-50ec-48d0-b4f5-308b721d1f2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:23.414962 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6097caf-50ec-48d0-b4f5-308b721d1f2f None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:23.428628 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 289/568] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Jun 27 09:15:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:23.428628 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6097caf-50ec-48d0-b4f5-308b721d1f2f None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:23.433868 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:23.450674 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe1fc7-6941-4ff3-8c2b-270487206a72 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:23.488571 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d026e55d-3d46-4567-ac3a-e59e30418509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:23.489769 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026e55d-3d46-4567-ac3a-e59e30418509 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:23.490060 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026e55d-3d46-4567-ac3a-e59e30418509 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:23.490371 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026e55d-3d46-4567-ac3a-e59e30418509 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:23.491124 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d026e55d-3d46-4567-ac3a-e59e30418509 None admin] RBAC: Adding query filter params (name=service) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:23.491435 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d026e55d-3d46-4567-ac3a-e59e30418509 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:23.492860 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d026e55d-3d46-4567-ac3a-e59e30418509 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:23.501759 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 280/569] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Jun 27 09:15:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:23.502589 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d026e55d-3d46-4567-ac3a-e59e30418509 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:23.606378 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6097caf-50ec-48d0-b4f5-308b721d1f2f None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:23.629376 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:23.643773 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b9de6-b033-45fe-bb23-8e13b409019f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:23.644614 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b9de6-b033-45fe-bb23-8e13b409019f None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:23.644895 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b9de6-b033-45fe-bb23-8e13b409019f None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:23.645172 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b9de6-b033-45fe-bb23-8e13b409019f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:23.657327 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3b9de6-b033-45fe-bb23-8e13b409019f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:23.658782 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3b9de6-b033-45fe-bb23-8e13b409019f None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:23.673668 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d026e55d-3d46-4567-ac3a-e59e30418509 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:23.675653 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-ba3b9de6-b033-45fe-bb23-8e13b409019f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:23.675653 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:23.675653 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:23.675653 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:23.675653 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:23.675653 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:23.675653 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:23.675653 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:23.675653 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:23.675653 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:23.675653 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:23.675653 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:23.675653 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:23.675653 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:23.675653 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:23.677044 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:23.677044 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:23.677044 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:23.677044 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:23.677044 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:23.677044 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:23.677044 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:23.677044 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:23.677044 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:23.677044 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:23.677044 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:23.677044 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:23.677044 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:23.677044 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:23.677044 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:23.677044 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:23.677044 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:23.678184 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:23.678184 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:23.678184 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:23.678184 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:23.678184 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 290/570] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:23.678184 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b9de6-b033-45fe-bb23-8e13b409019f None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:23.711453 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644cd69f-a136-4c4b-a1ed-3eb40c422dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:23.712035 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644cd69f-a136-4c4b-a1ed-3eb40c422dfd None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:23.712349 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644cd69f-a136-4c4b-a1ed-3eb40c422dfd None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:23.712623 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644cd69f-a136-4c4b-a1ed-3eb40c422dfd None admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:23.713404 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644cd69f-a136-4c4b-a1ed-3eb40c422dfd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:23.713720 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644cd69f-a136-4c4b-a1ed-3eb40c422dfd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:23.715155 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644cd69f-a136-4c4b-a1ed-3eb40c422dfd None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:23.732463 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 281/571] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Jun 27 09:15:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:23.733282 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644cd69f-a136-4c4b-a1ed-3eb40c422dfd None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:23.744181 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:23.780152 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b9de6-b033-45fe-bb23-8e13b409019f None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:23.813574 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e4e46e-1771-430e-a216-d30df000a6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:23.814354 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4e46e-1771-430e-a216-d30df000a6cf None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:23.814637 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4e46e-1771-430e-a216-d30df000a6cf None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:23.814908 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4e46e-1771-430e-a216-d30df000a6cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:23.825367 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e4e46e-1771-430e-a216-d30df000a6cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:23.826817 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e4e46e-1771-430e-a216-d30df000a6cf None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:23.833465 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644cd69f-a136-4c4b-a1ed-3eb40c422dfd None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:23.843491 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-71e4e46e-1771-430e-a216-d30df000a6cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:23.843491 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:23.843491 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:23.843491 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:23.843491 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:23.843491 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:23.843491 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:23.843491 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:23.843491 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:23.843491 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:23.843491 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:23.843491 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:23.843491 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:23.843491 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:23.843491 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:23.844530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:23.844530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:23.844530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:23.844530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:23.844530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:23.844530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:23.844530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:23.844530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:23.844530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:23.844530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:23.844530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:23.844530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:23.844530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:23.844530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:23.844530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:23.844530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:23.844530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:23.845443 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:23.845443 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:23.845443 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:23.845443 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:23.845443 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 291/572] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:23.846104 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b1d5e-9633-44d8-a765-3465ba4d4c8d None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:23.846322 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b1d5e-9633-44d8-a765-3465ba4d4c8d None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:23.846597 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b1d5e-9633-44d8-a765-3465ba4d4c8d None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:23.848002 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 292/573] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:15:23.849146 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b1d5e-9633-44d8-a765-3465ba4d4c8d None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:23.873932 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f4818-4c9c-4bfb-ab4c-7b71afbeefa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:23.874725 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f4818-4c9c-4bfb-ab4c-7b71afbeefa2 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:23.875008 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f4818-4c9c-4bfb-ab4c-7b71afbeefa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:23.875280 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f4818-4c9c-4bfb-ab4c-7b71afbeefa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:23.875447 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:23.885713 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632f4818-4c9c-4bfb-ab4c-7b71afbeefa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:23.887270 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632f4818-4c9c-4bfb-ab4c-7b71afbeefa2 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:23.905190 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-632f4818-4c9c-4bfb-ab4c-7b71afbeefa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:23.905190 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:23.905190 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:23.905190 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:23.905190 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:23.905190 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:23.905190 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:23.905190 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:23.905190 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:23.905190 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:23.905190 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:23.905190 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:23.905190 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:23.905190 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:23.905190 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:23.906501 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:23.906501 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:23.906501 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:23.906501 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:23.906501 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:23.906501 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:23.906501 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:23.906501 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:23.906501 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:23.906501 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:23.906501 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:23.906501 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:23.906501 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:23.906501 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:23.906501 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:23.906501 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:23.906501 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:23.907380 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:23.907380 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:23.907380 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:23.907380 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:23.907380 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 282/574] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:23.907380 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f4818-4c9c-4bfb-ab4c-7b71afbeefa2 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:23.955196 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b1d5e-9633-44d8-a765-3465ba4d4c8d None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:23.969937 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:23.989682 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4d1ac-4388-429c-8658-7226ab98f9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:23.990373 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4d1ac-4388-429c-8658-7226ab98f9e8 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:23.990657 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4d1ac-4388-429c-8658-7226ab98f9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:23.990935 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4d1ac-4388-429c-8658-7226ab98f9e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:23.991654 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da4d1ac-4388-429c-8658-7226ab98f9e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:23.991962 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da4d1ac-4388-429c-8658-7226ab98f9e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:23.993441 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da4d1ac-4388-429c-8658-7226ab98f9e8 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:24.004635 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 293/575] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:24.005955 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4d1ac-4388-429c-8658-7226ab98f9e8 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:24.010906 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f4818-4c9c-4bfb-ab4c-7b71afbeefa2 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:24.049282 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16128c92-f333-4aff-8c3f-039d769b0001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:24.049940 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16128c92-f333-4aff-8c3f-039d769b0001 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:24.050225 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16128c92-f333-4aff-8c3f-039d769b0001 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:24.050501 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16128c92-f333-4aff-8c3f-039d769b0001 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:24.051338 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16128c92-f333-4aff-8c3f-039d769b0001 None admin] RBAC: Adding query filter params (role.id=197a0da3099d45e4bcb9233039c21d8f, scope.project.id=4ba8e40538db4d89b93469b79322d20e, user.id=f5477b14dae24fd3a644c9cbd6ff85ec) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:24.051680 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16128c92-f333-4aff-8c3f-039d769b0001 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:24.053185 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16128c92-f333-4aff-8c3f-039d769b0001 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:24.058994 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 283/576] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Jun 27 09:15:23 2022] GET /identity/v3/role_assignments?user.id=f5477b14dae24fd3a644c9cbd6ff85ec&scope.project.id=4ba8e40538db4d89b93469b79322d20e&role.id=197a0da3099d45e4bcb9233039c21d8f => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:24.060292 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1845fb6-3a38-4b4b-8e85-de9aaf3a44dd None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:24.060581 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1845fb6-3a38-4b4b-8e85-de9aaf3a44dd None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:24.060857 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1845fb6-3a38-4b4b-8e85-de9aaf3a44dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:24.079572 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-d1845fb6-3a38-4b4b-8e85-de9aaf3a44dd None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:24.080830 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-d1845fb6-3a38-4b4b-8e85-de9aaf3a44dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:24.115461 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:24.132769 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4d1ac-4388-429c-8658-7226ab98f9e8 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:24.171025 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 284/577] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:15:24.171909 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1845fb6-3a38-4b4b-8e85-de9aaf3a44dd None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:24.182066 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82af71d-b656-4fa4-8e30-7679aa33009d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:24.182846 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82af71d-b656-4fa4-8e30-7679aa33009d None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:24.183206 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82af71d-b656-4fa4-8e30-7679aa33009d None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:24.183556 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82af71d-b656-4fa4-8e30-7679aa33009d None admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:24.184422 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82af71d-b656-4fa4-8e30-7679aa33009d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:24.184803 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82af71d-b656-4fa4-8e30-7679aa33009d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:24.186319 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82af71d-b656-4fa4-8e30-7679aa33009d None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:24.205811 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 294/578] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:24.205811 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82af71d-b656-4fa4-8e30-7679aa33009d None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:24.255892 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:24.313391 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82af71d-b656-4fa4-8e30-7679aa33009d None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:24.316533 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1845fb6-3a38-4b4b-8e85-de9aaf3a44dd None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:24.349366 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40157f2-e9e6-4509-a058-04ac96dbe6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:24.350184 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40157f2-e9e6-4509-a058-04ac96dbe6be None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:24.350462 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40157f2-e9e6-4509-a058-04ac96dbe6be None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:24.350732 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40157f2-e9e6-4509-a058-04ac96dbe6be None admin] PATH_INFO: `/v3/projects/service` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:24.353339 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7bc52-f715-4bab-8414-0d59fbb61513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:24.354240 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7bc52-f715-4bab-8414-0d59fbb61513 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:24.354364 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7bc52-f715-4bab-8414-0d59fbb61513 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:24.354546 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7bc52-f715-4bab-8414-0d59fbb61513 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:24.355274 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba7bc52-f715-4bab-8414-0d59fbb61513 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:24.355582 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba7bc52-f715-4bab-8414-0d59fbb61513 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:24.357004 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba7bc52-f715-4bab-8414-0d59fbb61513 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:24.359537 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40157f2-e9e6-4509-a058-04ac96dbe6be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:24.360998 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40157f2-e9e6-4509-a058-04ac96dbe6be None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:24.374252 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 285/579] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:24.374252 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7bc52-f715-4bab-8414-0d59fbb61513 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:24.375822 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-e40157f2-e9e6-4509-a058-04ac96dbe6be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:15:24.375822 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:24.375822 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:24.375822 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:24.375822 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:24.375822 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:24.375822 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:24.375822 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:24.375822 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:24.375822 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:24.375822 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:24.375822 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:24.375822 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 09:15:24.375822 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 09:15:24.375822 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 09:15:24.376899 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 09:15:24.376899 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:24.376899 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:24.376899 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:24.376899 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:24.376899 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:24.376899 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:24.376899 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:24.376899 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:24.376899 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:24.376899 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:24.376899 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:24.376899 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:24.376899 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:24.376899 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:24.376899 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:24.376899 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:24.377849 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 09:15:24.377849 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 09:15:24.377849 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 09:15:24.377849 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 09:15:24.377849 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 09:15:24.377849 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 09:15:24.377849 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:15:24.377849 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:24.377849 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 295/580] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:15:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:24.377849 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40157f2-e9e6-4509-a058-04ac96dbe6be None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:24.384021 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:24.484013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7bc52-f715-4bab-8414-0d59fbb61513 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:24.495031 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40157f2-e9e6-4509-a058-04ac96dbe6be None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:24.501279 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:24.521675 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b2793-b9d4-4f63-8cdb-a595d573d8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:24.522432 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b2793-b9d4-4f63-8cdb-a595d573d8e5 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:24.522678 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b2793-b9d4-4f63-8cdb-a595d573d8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:24.522980 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b2793-b9d4-4f63-8cdb-a595d573d8e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:24.533268 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b2793-b9d4-4f63-8cdb-a595d573d8e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:15:24.542221 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-c02b2793-b9d4-4f63-8cdb-a595d573d8e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 09:15:24.542221 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:24.542221 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:24.542221 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:24.542221 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:24.542221 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:24.542221 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:24.542221 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:24.542221 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:24.542221 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:24.542221 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:24.542221 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:24.542221 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:15:24.542221 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:15:24.542221 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:15:24.542221 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:15:24.543304 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:15:24.543304 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:15:24.543304 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:15:24.543304 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:15:24.543304 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:24.543304 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:24.543304 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:24.543304 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:24.543304 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:24.543304 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:24.543304 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:24.543304 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:24.543304 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:24.543304 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:24.543304 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:24.543304 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:24.544140 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:24.544140 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:24.544140 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:24.544140 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:24.544140 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:15:24.544140 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:15:24.544140 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:15:24.544140 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:15:24.544140 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:15:24.544140 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:15:24.544140 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 09:15:24.544140 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:24.544140 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 286/581] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Jun 27 09:15:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:24.544982 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b2793-b9d4-4f63-8cdb-a595d573d8e5 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:24.581054 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c394a8c-3031-4306-8e72-1278487da4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:24.581847 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c394a8c-3031-4306-8e72-1278487da4ef None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:24.582129 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c394a8c-3031-4306-8e72-1278487da4ef None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:24.582401 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c394a8c-3031-4306-8e72-1278487da4ef None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:24.590635 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c394a8c-3031-4306-8e72-1278487da4ef None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:24.592071 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c394a8c-3031-4306-8e72-1278487da4ef None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:24.607816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-9c394a8c-3031-4306-8e72-1278487da4ef None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 27 09:15:24.607816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:24.607816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:24.607816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:24.607816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:24.607816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:24.607816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:24.607816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:24.607816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:24.607816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:24.607816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:24.607816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:24.607816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 09:15:24.607816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 09:15:24.607816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 09:15:24.607816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 09:15:24.608958 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:24.608958 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:24.608958 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 09:15:24.608958 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:15:24.608958 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 09:15:24.608958 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:15:24.608958 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:24.608958 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:24.608958 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:24.608958 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:24.608958 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:24.608958 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:24.608958 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:24.608958 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:24.608958 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:24.608958 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:24.608958 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:24.608958 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:24.609916 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:24.609916 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:24.609916 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 09:15:24.609916 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 09:15:24.609916 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 09:15:24.609916 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 09:15:24.609916 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 09:15:24.609916 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 09:15:24.609916 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 27 09:15:24.609916 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:24.609916 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 296/582] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:15:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:24.609916 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c394a8c-3031-4306-8e72-1278487da4ef None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:24.660838 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b2793-b9d4-4f63-8cdb-a595d573d8e5 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:24.680610 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:24.696866 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed755a18-cee5-4e2e-b3ba-f317fce6f035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:24.697672 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed755a18-cee5-4e2e-b3ba-f317fce6f035 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:24.697952 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed755a18-cee5-4e2e-b3ba-f317fce6f035 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:24.698224 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed755a18-cee5-4e2e-b3ba-f317fce6f035 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:24.705970 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed755a18-cee5-4e2e-b3ba-f317fce6f035 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:24.707405 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed755a18-cee5-4e2e-b3ba-f317fce6f035 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:24.721414 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-ed755a18-cee5-4e2e-b3ba-f317fce6f035 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 27 09:15:24.721414 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:24.721414 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:24.721414 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:24.721414 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:24.721414 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:24.721414 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:24.721414 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:24.721414 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:24.721414 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:24.721414 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:24.721414 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:24.721414 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 09:15:24.721414 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 09:15:24.721414 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 09:15:24.721414 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 09:15:24.722388 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:24.722388 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:24.722388 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 09:15:24.722388 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:15:24.722388 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 09:15:24.722388 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:15:24.722388 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:24.722388 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:24.722388 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:24.722388 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:24.722388 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:24.722388 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:24.722388 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:24.722388 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:24.722388 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:24.722388 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:24.722388 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:24.722388 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:24.723336 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:24.723336 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:24.723336 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 09:15:24.723336 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 09:15:24.723336 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 09:15:24.723336 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 09:15:24.723336 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 09:15:24.723336 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 09:15:24.723336 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 27 09:15:24.723336 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:24.723336 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 287/583] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:15:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:24.724920 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed755a18-cee5-4e2e-b3ba-f317fce6f035 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:24.725971 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c394a8c-3031-4306-8e72-1278487da4ef None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:24.763430 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:24.764545 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc024a6-78ea-4d92-bb23-29312111aca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:24.765212 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc024a6-78ea-4d92-bb23-29312111aca2 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:24.765495 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc024a6-78ea-4d92-bb23-29312111aca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:24.765773 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc024a6-78ea-4d92-bb23-29312111aca2 None admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:24.766579 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc024a6-78ea-4d92-bb23-29312111aca2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:24.766892 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc024a6-78ea-4d92-bb23-29312111aca2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:24.768366 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc024a6-78ea-4d92-bb23-29312111aca2 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:24.786857 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 297/584] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Jun 27 09:15:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:24.786857 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc024a6-78ea-4d92-bb23-29312111aca2 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:24.855698 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed755a18-cee5-4e2e-b3ba-f317fce6f035 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:24.898955 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de4b75-9d4c-4f77-88ba-6b50cbf1e4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:24.899621 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de4b75-9d4c-4f77-88ba-6b50cbf1e4c4 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:24.899901 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de4b75-9d4c-4f77-88ba-6b50cbf1e4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:24.900233 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de4b75-9d4c-4f77-88ba-6b50cbf1e4c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:24.900760 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc024a6-78ea-4d92-bb23-29312111aca2 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:24.900957 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04de4b75-9d4c-4f77-88ba-6b50cbf1e4c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:24.901265 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04de4b75-9d4c-4f77-88ba-6b50cbf1e4c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:24.902934 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04de4b75-9d4c-4f77-88ba-6b50cbf1e4c4 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:24.912786 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 288/585] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Jun 27 09:15:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:24.913593 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de4b75-9d4c-4f77-88ba-6b50cbf1e4c4 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:24.936642 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:24.949961 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e8dff-d0f0-4aeb-9ced-c8e919a92a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:24.950661 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e8dff-d0f0-4aeb-9ced-c8e919a92a5c None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:24.950990 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e8dff-d0f0-4aeb-9ced-c8e919a92a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:24.951307 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e8dff-d0f0-4aeb-9ced-c8e919a92a5c None admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:24.952412 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9e8dff-d0f0-4aeb-9ced-c8e919a92a5c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:24.952686 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9e8dff-d0f0-4aeb-9ced-c8e919a92a5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:24.954150 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9e8dff-d0f0-4aeb-9ced-c8e919a92a5c None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:24.977960 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 298/586] 10.222.0.62 () {56 vars in 1137 bytes} [Mon Jun 27 09:15:24 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:24.979110 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e8dff-d0f0-4aeb-9ced-c8e919a92a5c None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:25.028805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:25.034644 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de4b75-9d4c-4f77-88ba-6b50cbf1e4c4 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:25.072145 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de365d42-751a-4f68-ad10-af5e21fedea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:25.073162 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de365d42-751a-4f68-ad10-af5e21fedea3 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:25.073661 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de365d42-751a-4f68-ad10-af5e21fedea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:25.074141 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de365d42-751a-4f68-ad10-af5e21fedea3 None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:25.075171 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de365d42-751a-4f68-ad10-af5e21fedea3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:25.075666 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de365d42-751a-4f68-ad10-af5e21fedea3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:25.077316 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de365d42-751a-4f68-ad10-af5e21fedea3 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:25.095679 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 289/587] 10.222.0.62 () {56 vars in 1137 bytes} [Mon Jun 27 09:15:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:25.096602 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de365d42-751a-4f68-ad10-af5e21fedea3 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:25.106931 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e8dff-d0f0-4aeb-9ced-c8e919a92a5c None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:25.146601 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163335aa-fb48-4ce1-aecf-be8d72967a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:25.147876 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163335aa-fb48-4ce1-aecf-be8d72967a1c None admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:25.148254 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163335aa-fb48-4ce1-aecf-be8d72967a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:25.148901 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163335aa-fb48-4ce1-aecf-be8d72967a1c None admin] PATH_INFO: `/v3/projects/4ba8e40538db4d89b93469b79322d20e/users/2c1434a85b30411c9c59cc50c3980cd8/roles/197a0da3099d45e4bcb9233039c21d8f` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:25.164822 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163335aa-fb48-4ce1-aecf-be8d72967a1c None admin] RBAC: Authorizing `identity:create_grant(project_id=4ba8e40538db4d89b93469b79322d20e, user_id=2c1434a85b30411c9c59cc50c3980cd8, role_id=197a0da3099d45e4bcb9233039c21d8f)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:25.166311 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163335aa-fb48-4ce1-aecf-be8d72967a1c None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:25.215289 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de365d42-751a-4f68-ad10-af5e21fedea3 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:25.250467 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01d8ef-9e03-4653-af4c-ebbf5a09559a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:25.251249 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01d8ef-9e03-4653-af4c-ebbf5a09559a None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:25.251527 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01d8ef-9e03-4653-af4c-ebbf5a09559a None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:25.251798 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01d8ef-9e03-4653-af4c-ebbf5a09559a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:25.261996 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 299/588] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Jun 27 09:15:24 2022] PUT /identity/v3/projects/4ba8e40538db4d89b93469b79322d20e/users/2c1434a85b30411c9c59cc50c3980cd8/roles/197a0da3099d45e4bcb9233039c21d8f => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:15:25.268387 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163335aa-fb48-4ce1-aecf-be8d72967a1c None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:25.279391 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d01d8ef-9e03-4653-af4c-ebbf5a09559a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:25.280962 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d01d8ef-9e03-4653-af4c-ebbf5a09559a None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:25.301978 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-9d01d8ef-9e03-4653-af4c-ebbf5a09559a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:25.301978 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:25.301978 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:25.301978 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:25.301978 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:25.301978 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:25.301978 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:25.301978 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:25.301978 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:25.301978 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:25.301978 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:25.301978 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:25.301978 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:25.301978 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:25.301978 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:25.303009 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:25.303009 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:25.303009 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:25.303009 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:25.303009 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:25.303009 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:25.303009 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:25.303009 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:25.303009 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:25.303009 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:25.303009 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:25.303009 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:25.303009 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:25.303009 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:25.303009 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:25.303009 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:25.303009 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:25.303889 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:25.303889 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:25.303889 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:25.303889 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:25.307998 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 290/589] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:25.308990 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01d8ef-9e03-4653-af4c-ebbf5a09559a None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:25.309424 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:25.320645 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:25.406046 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163335aa-fb48-4ce1-aecf-be8d72967a1c None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:25.453181 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49a0de-bffe-4018-93db-6c6395e331ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:25.454157 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49a0de-bffe-4018-93db-6c6395e331ab None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:25.454580 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49a0de-bffe-4018-93db-6c6395e331ab None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:25.455012 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49a0de-bffe-4018-93db-6c6395e331ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:25.456112 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01d8ef-9e03-4653-af4c-ebbf5a09559a None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:25.466745 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49a0de-bffe-4018-93db-6c6395e331ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:25.468737 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49a0de-bffe-4018-93db-6c6395e331ab None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:25.489293 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-8a49a0de-bffe-4018-93db-6c6395e331ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:25.489293 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:25.489293 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:25.489293 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:25.489293 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:25.489293 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:25.489293 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:25.489293 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:25.489293 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:25.489293 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:25.489293 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:25.489293 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:25.489293 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:25.489293 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:25.489293 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:25.490403 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:25.490403 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:25.490403 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:25.490403 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:25.490403 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:25.490403 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:25.490403 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:25.490403 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:25.490403 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:25.490403 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:25.490403 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:25.490403 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:25.490403 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:25.490403 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:25.490403 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:25.490403 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:25.490403 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:25.491656 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:25.491656 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:25.491656 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:25.491656 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:25.491656 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 300/590] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:25.492000 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49a0de-bffe-4018-93db-6c6395e331ab None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:25.501994 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a94212-8708-4786-80dd-7de73173ab8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:25.502801 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a94212-8708-4786-80dd-7de73173ab8e None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:25.503086 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a94212-8708-4786-80dd-7de73173ab8e None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:25.503361 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a94212-8708-4786-80dd-7de73173ab8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:25.515895 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a94212-8708-4786-80dd-7de73173ab8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:25.517581 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a94212-8708-4786-80dd-7de73173ab8e None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:25.538266 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-03a94212-8708-4786-80dd-7de73173ab8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:25.538266 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:25.538266 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:25.538266 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:25.538266 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:25.538266 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:25.538266 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:25.538266 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:25.538266 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:25.538266 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:25.538266 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:25.538266 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:25.538266 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:25.538266 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:25.538266 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:25.539236 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:25.539236 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:25.539236 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:25.539236 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:25.539236 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:25.539236 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:25.539236 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:25.539236 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:25.539236 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:25.539236 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:25.539236 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:25.539236 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:25.539236 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:25.539236 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:25.539236 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:25.539236 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:25.539236 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:25.540153 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:25.540153 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:25.540153 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:25.540153 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:25.540153 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 291/591] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:25.544792 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a94212-8708-4786-80dd-7de73173ab8e None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:25.607938 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:25.626893 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:25.629219 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49a0de-bffe-4018-93db-6c6395e331ab None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:25.675411 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a94212-8708-4786-80dd-7de73173ab8e None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:25.677796 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963126f-e5e1-41d7-ab55-5bf9a8928a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:25.678654 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963126f-e5e1-41d7-ab55-5bf9a8928a2c None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:25.678983 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963126f-e5e1-41d7-ab55-5bf9a8928a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:25.679312 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963126f-e5e1-41d7-ab55-5bf9a8928a2c None admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:25.680702 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c963126f-e5e1-41d7-ab55-5bf9a8928a2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:25.684617 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c963126f-e5e1-41d7-ab55-5bf9a8928a2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:25.686432 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c963126f-e5e1-41d7-ab55-5bf9a8928a2c None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:25.707795 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 301/592] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:25.707795 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963126f-e5e1-41d7-ab55-5bf9a8928a2c None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:25.720755 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b145e1b-bc6e-4286-9cd7-887b6f1cc955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:25.721809 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b145e1b-bc6e-4286-9cd7-887b6f1cc955 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:25.722349 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b145e1b-bc6e-4286-9cd7-887b6f1cc955 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:25.722940 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b145e1b-bc6e-4286-9cd7-887b6f1cc955 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:25.723943 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b145e1b-bc6e-4286-9cd7-887b6f1cc955 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:25.724490 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b145e1b-bc6e-4286-9cd7-887b6f1cc955 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:25.726364 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b145e1b-bc6e-4286-9cd7-887b6f1cc955 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:25.740737 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 292/593] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:25.742031 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b145e1b-bc6e-4286-9cd7-887b6f1cc955 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:25.822113 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963126f-e5e1-41d7-ab55-5bf9a8928a2c None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:25.858534 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111d479-541e-423d-b00d-4f44718b8f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:25.859556 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111d479-541e-423d-b00d-4f44718b8f07 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:25.860060 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111d479-541e-423d-b00d-4f44718b8f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:25.860574 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111d479-541e-423d-b00d-4f44718b8f07 None admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:25.861501 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111d479-541e-423d-b00d-4f44718b8f07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:25.862044 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111d479-541e-423d-b00d-4f44718b8f07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:25.863624 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111d479-541e-423d-b00d-4f44718b8f07 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:25.863889 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b145e1b-bc6e-4286-9cd7-887b6f1cc955 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:25.884065 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 302/594] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:25.884065 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111d479-541e-423d-b00d-4f44718b8f07 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:25.884790 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:25.910308 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08226559-fe2c-4883-88ef-fabaf0e4b303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:25.912240 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08226559-fe2c-4883-88ef-fabaf0e4b303 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:25.913155 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08226559-fe2c-4883-88ef-fabaf0e4b303 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:25.914744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:25.915320 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08226559-fe2c-4883-88ef-fabaf0e4b303 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:25.927420 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08226559-fe2c-4883-88ef-fabaf0e4b303 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:25.929371 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08226559-fe2c-4883-88ef-fabaf0e4b303 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:25.951248 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-08226559-fe2c-4883-88ef-fabaf0e4b303 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 27 09:15:25.951248 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:25.951248 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:25.951248 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:25.951248 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:25.951248 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:25.951248 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:25.951248 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:25.951248 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:25.951248 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:25.951248 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:25.951248 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:25.951248 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 09:15:25.951248 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 09:15:25.951248 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 09:15:25.951248 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 09:15:25.952295 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:25.952295 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:25.952295 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 09:15:25.952295 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:15:25.952295 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 09:15:25.952295 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:15:25.952295 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:25.952295 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:25.952295 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:25.952295 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:25.952295 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:25.952295 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:25.952295 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:25.952295 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:25.952295 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:25.952295 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:25.952295 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:25.952295 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:25.953222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:25.953222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:25.953222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 09:15:25.953222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 09:15:25.953222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 09:15:25.953222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 09:15:25.953222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 09:15:25.953222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 09:15:25.953222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 27 09:15:25.953222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:25.959618 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 293/595] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Jun 27 09:15:25 2022] GET /identity/v3/users/neutron => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:25.959618 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08226559-fe2c-4883-88ef-fabaf0e4b303 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:26.006460 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111d479-541e-423d-b00d-4f44718b8f07 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:26.043073 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d001e80a-99a6-4477-bbf7-77b9d1b27510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:26.043868 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001e80a-99a6-4477-bbf7-77b9d1b27510 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:26.044157 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001e80a-99a6-4477-bbf7-77b9d1b27510 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:26.044543 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001e80a-99a6-4477-bbf7-77b9d1b27510 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:26.051816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d001e80a-99a6-4477-bbf7-77b9d1b27510 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:26.053350 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d001e80a-99a6-4477-bbf7-77b9d1b27510 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:26.068551 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-d001e80a-99a6-4477-bbf7-77b9d1b27510 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:15:26.068551 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:26.068551 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:26.068551 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:26.068551 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:26.068551 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:26.068551 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:26.068551 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:26.068551 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:26.068551 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:26.068551 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:26.068551 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:26.068551 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 09:15:26.068551 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 09:15:26.068551 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 09:15:26.069533 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 09:15:26.069533 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:26.069533 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:26.069533 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:26.069533 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:26.069533 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:26.069533 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:26.069533 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:26.069533 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:26.069533 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:26.069533 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:26.069533 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:26.069533 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:26.069533 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:26.069533 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:26.069533 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:26.069533 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:26.070401 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 09:15:26.070401 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 09:15:26.070401 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 09:15:26.070401 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 09:15:26.070401 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 09:15:26.070401 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 09:15:26.070401 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:15:26.070401 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:26.070401 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 303/596] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:15:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:26.071439 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d001e80a-99a6-4477-bbf7-77b9d1b27510 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:26.080551 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08226559-fe2c-4883-88ef-fabaf0e4b303 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:26.117806 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c2086-ec1b-496c-adae-1dbbe2b6980d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:26.118815 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c2086-ec1b-496c-adae-1dbbe2b6980d None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:26.118923 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c2086-ec1b-496c-adae-1dbbe2b6980d None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:26.119123 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c2086-ec1b-496c-adae-1dbbe2b6980d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:26.126561 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c2086-ec1b-496c-adae-1dbbe2b6980d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:26.128000 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c2086-ec1b-496c-adae-1dbbe2b6980d None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:26.142563 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-ec6c2086-ec1b-496c-adae-1dbbe2b6980d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:15:26.142563 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:26.142563 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:26.142563 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:26.142563 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:26.142563 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:26.142563 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:26.142563 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:26.142563 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:26.142563 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:26.142563 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:26.142563 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:26.142563 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 09:15:26.142563 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 09:15:26.142563 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 09:15:26.143492 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 09:15:26.143492 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:26.143492 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:26.143492 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:26.143492 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:26.143492 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:26.143492 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:26.143492 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:26.143492 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:26.143492 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:26.143492 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:26.143492 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:26.143492 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:26.143492 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:26.143492 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:26.143492 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:26.143492 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:26.144435 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 09:15:26.144435 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 09:15:26.144435 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 09:15:26.144435 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 09:15:26.144435 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 09:15:26.144435 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 09:15:26.144435 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:15:26.144435 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:26.149111 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 294/597] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:15:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:26.149780 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c2086-ec1b-496c-adae-1dbbe2b6980d None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:26.151090 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:26.195439 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:26.199415 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d001e80a-99a6-4477-bbf7-77b9d1b27510 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:26.239973 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd781b33-b83d-4929-bc92-34b5c9e2ae34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:26.240681 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd781b33-b83d-4929-bc92-34b5c9e2ae34 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:26.240965 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd781b33-b83d-4929-bc92-34b5c9e2ae34 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:26.241238 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd781b33-b83d-4929-bc92-34b5c9e2ae34 None admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:26.242079 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd781b33-b83d-4929-bc92-34b5c9e2ae34 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:26.242391 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd781b33-b83d-4929-bc92-34b5c9e2ae34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:26.243829 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd781b33-b83d-4929-bc92-34b5c9e2ae34 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:26.262523 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 304/598] 10.222.0.62 () {56 vars in 1139 bytes} [Mon Jun 27 09:15:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:26.263829 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60162d-79d6-4831-bd32-712eb90dbec9 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:26.264120 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60162d-79d6-4831-bd32-712eb90dbec9 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:26.264427 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60162d-79d6-4831-bd32-712eb90dbec9 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:26.268324 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 305/599] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:15:26.268324 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60162d-79d6-4831-bd32-712eb90dbec9 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:26.271171 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c2086-ec1b-496c-adae-1dbbe2b6980d None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:26.306583 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8937f53-95d9-47e8-8d11-3bf30ea0a08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:26.307708 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8937f53-95d9-47e8-8d11-3bf30ea0a08c None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:26.307708 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8937f53-95d9-47e8-8d11-3bf30ea0a08c None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:26.307899 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8937f53-95d9-47e8-8d11-3bf30ea0a08c None admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:26.308594 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8937f53-95d9-47e8-8d11-3bf30ea0a08c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:26.308909 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8937f53-95d9-47e8-8d11-3bf30ea0a08c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:26.310341 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8937f53-95d9-47e8-8d11-3bf30ea0a08c None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:26.327594 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 295/600] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Jun 27 09:15:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:26.327594 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8937f53-95d9-47e8-8d11-3bf30ea0a08c None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:26.386187 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60162d-79d6-4831-bd32-712eb90dbec9 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:26.411642 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:26.425032 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b60df-36a2-4394-9a83-c6ae32da8581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:26.425768 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b60df-36a2-4394-9a83-c6ae32da8581 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:26.426079 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b60df-36a2-4394-9a83-c6ae32da8581 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:26.426351 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b60df-36a2-4394-9a83-c6ae32da8581 None admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:26.427709 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646b60df-36a2-4394-9a83-c6ae32da8581 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:26.428064 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646b60df-36a2-4394-9a83-c6ae32da8581 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:26.429614 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646b60df-36a2-4394-9a83-c6ae32da8581 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:26.435577 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:26.440969 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8937f53-95d9-47e8-8d11-3bf30ea0a08c None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:26.448367 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 306/601] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Jun 27 09:15:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:26.448367 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf7e16-7d78-457f-90d1-df64aa018ded None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:26.448367 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf7e16-7d78-457f-90d1-df64aa018ded None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:26.448367 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf7e16-7d78-457f-90d1-df64aa018ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:26.463918 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-d3bf7e16-7d78-457f-90d1-df64aa018ded None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:26.465171 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-d3bf7e16-7d78-457f-90d1-df64aa018ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:26.483329 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a7db0-cb6b-4ee7-a7f3-0f3530a1c952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:26.484236 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a7db0-cb6b-4ee7-a7f3-0f3530a1c952 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:26.484530 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a7db0-cb6b-4ee7-a7f3-0f3530a1c952 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:26.484811 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a7db0-cb6b-4ee7-a7f3-0f3530a1c952 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:26.495599 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a7db0-cb6b-4ee7-a7f3-0f3530a1c952 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:26.497080 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a7db0-cb6b-4ee7-a7f3-0f3530a1c952 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:26.516744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-2e0a7db0-cb6b-4ee7-a7f3-0f3530a1c952 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:26.516744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:26.516744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:26.516744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:26.516744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:26.516744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:26.516744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:26.516744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:26.516744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:26.516744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:26.516744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:26.516744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:26.516744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:26.516744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:26.516744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:26.517738 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:26.517738 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:26.517738 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:26.517738 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:26.517738 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:26.517738 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:26.517738 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:26.517738 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:26.517738 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:26.517738 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:26.517738 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:26.517738 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:26.517738 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:26.517738 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:26.517738 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:26.517738 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:26.517738 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:26.518614 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:26.518614 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:26.518614 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:26.518614 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:26.518614 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 296/602] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:26.518894 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a7db0-cb6b-4ee7-a7f3-0f3530a1c952 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:26.552246 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 307/603] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:15:26.552246 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf7e16-7d78-457f-90d1-df64aa018ded None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:26.651198 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf7e16-7d78-457f-90d1-df64aa018ded None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:26.661176 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a7db0-cb6b-4ee7-a7f3-0f3530a1c952 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:26.664562 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:26.686201 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59f3c3-7ae4-4c89-8763-34245849f8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:26.687086 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59f3c3-7ae4-4c89-8763-34245849f8fa None admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:26.687367 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59f3c3-7ae4-4c89-8763-34245849f8fa None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:26.687647 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59f3c3-7ae4-4c89-8763-34245849f8fa None admin] PATH_INFO: `/v3/projects/4ba8e40538db4d89b93469b79322d20e/users/e6f97b803a28453c8b78fd8380ac64ad/roles/197a0da3099d45e4bcb9233039c21d8f` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:26.698987 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c042649-7627-4d26-8506-4add9aa4079c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:26.700059 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c042649-7627-4d26-8506-4add9aa4079c None admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:26.700519 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c042649-7627-4d26-8506-4add9aa4079c None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:26.700839 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c042649-7627-4d26-8506-4add9aa4079c None admin] PATH_INFO: `/v3/projects/4ba8e40538db4d89b93469b79322d20e/users/333bceb4a90749df97595b7f38bf7ea6/roles/197a0da3099d45e4bcb9233039c21d8f` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:26.703336 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd59f3c3-7ae4-4c89-8763-34245849f8fa None admin] RBAC: Authorizing `identity:create_grant(project_id=4ba8e40538db4d89b93469b79322d20e, user_id=e6f97b803a28453c8b78fd8380ac64ad, role_id=197a0da3099d45e4bcb9233039c21d8f)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:26.704830 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd59f3c3-7ae4-4c89-8763-34245849f8fa None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:26.716815 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c042649-7627-4d26-8506-4add9aa4079c None admin] RBAC: Authorizing `identity:create_grant(project_id=4ba8e40538db4d89b93469b79322d20e, user_id=333bceb4a90749df97595b7f38bf7ea6, role_id=197a0da3099d45e4bcb9233039c21d8f)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:26.722930 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c042649-7627-4d26-8506-4add9aa4079c None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:26.770306 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 308/604] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Jun 27 09:15:26 2022] PUT /identity/v3/projects/4ba8e40538db4d89b93469b79322d20e/users/e6f97b803a28453c8b78fd8380ac64ad/roles/197a0da3099d45e4bcb9233039c21d8f => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:15:26.771362 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59f3c3-7ae4-4c89-8763-34245849f8fa None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:26.796108 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:26.808818 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 297/605] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Jun 27 09:15:26 2022] PUT /identity/v3/projects/4ba8e40538db4d89b93469b79322d20e/users/333bceb4a90749df97595b7f38bf7ea6/roles/197a0da3099d45e4bcb9233039c21d8f => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:15:26.810479 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c042649-7627-4d26-8506-4add9aa4079c None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:26.916573 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59f3c3-7ae4-4c89-8763-34245849f8fa None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:26.976580 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b74f34-d8bf-4d39-bd96-729fb3c060ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:26.977192 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b74f34-d8bf-4d39-bd96-729fb3c060ea None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:26.978559 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b74f34-d8bf-4d39-bd96-729fb3c060ea None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:26.978895 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b74f34-d8bf-4d39-bd96-729fb3c060ea None admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:26.983086 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b74f34-d8bf-4d39-bd96-729fb3c060ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:26.983424 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b74f34-d8bf-4d39-bd96-729fb3c060ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:26.984884 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b74f34-d8bf-4d39-bd96-729fb3c060ea None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:27.002873 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c042649-7627-4d26-8506-4add9aa4079c None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:27.003415 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 309/606] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:27.009441 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b74f34-d8bf-4d39-bd96-729fb3c060ea None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:27.051196 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:27.070151 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28888bce-56bb-4404-8afb-b8d62ce9ae61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:27.070999 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28888bce-56bb-4404-8afb-b8d62ce9ae61 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:27.071478 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28888bce-56bb-4404-8afb-b8d62ce9ae61 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:27.071780 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28888bce-56bb-4404-8afb-b8d62ce9ae61 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:27.089496 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28888bce-56bb-4404-8afb-b8d62ce9ae61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:15:27.097379 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-28888bce-56bb-4404-8afb-b8d62ce9ae61 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 09:15:27.097379 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:27.097379 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:27.097379 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:27.097379 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:27.097379 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:27.097379 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:27.097379 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:27.097379 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:27.097379 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:27.097379 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:27.097379 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:27.097379 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:15:27.097379 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:15:27.097379 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:15:27.097379 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:15:27.098868 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:15:27.098868 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:15:27.098868 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:15:27.098868 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:15:27.098868 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:27.098868 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:27.098868 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:27.098868 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:27.098868 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:27.098868 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:27.098868 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:27.098868 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:27.098868 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:27.098868 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:27.098868 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:27.098868 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:27.099723 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:27.099723 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:27.099723 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:27.099723 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:27.099723 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:15:27.099723 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:15:27.099723 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:15:27.099723 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:15:27.099723 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:15:27.099723 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:15:27.099723 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 09:15:27.099723 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:27.099723 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 298/607] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Jun 27 09:15:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:27.115061 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28888bce-56bb-4404-8afb-b8d62ce9ae61 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:27.168227 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b74f34-d8bf-4d39-bd96-729fb3c060ea None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:27.207604 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:27.209023 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2405c-5d3f-4277-8c33-490a0fbe546d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:27.209831 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2405c-5d3f-4277-8c33-490a0fbe546d None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:27.210280 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2405c-5d3f-4277-8c33-490a0fbe546d None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:27.210567 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2405c-5d3f-4277-8c33-490a0fbe546d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:27.218597 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2405c-5d3f-4277-8c33-490a0fbe546d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:27.220985 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2405c-5d3f-4277-8c33-490a0fbe546d None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:27.238822 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-79f2405c-5d3f-4277-8c33-490a0fbe546d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:15:27.238822 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:27.238822 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:27.238822 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:27.238822 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:27.238822 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:27.238822 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:27.238822 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:27.238822 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:27.238822 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:27.238822 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:27.238822 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:27.238822 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 09:15:27.238822 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 09:15:27.238822 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 09:15:27.240355 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 09:15:27.240355 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:27.240355 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:27.240355 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:27.240355 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:27.240355 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:27.240355 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:27.240355 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:27.240355 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:27.240355 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:27.240355 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:27.240355 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:27.240355 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:27.240355 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:27.240355 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:27.240355 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:27.240355 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:27.241302 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 09:15:27.241302 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 09:15:27.241302 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 09:15:27.241302 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 09:15:27.241302 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 09:15:27.241302 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 09:15:27.241302 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:15:27.241302 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:27.241734 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 310/608] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:15:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:27.249505 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2405c-5d3f-4277-8c33-490a0fbe546d None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:27.353661 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:27.374605 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2405c-5d3f-4277-8c33-490a0fbe546d None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:27.375366 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28888bce-56bb-4404-8afb-b8d62ce9ae61 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:27.418396 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a8d6c-260a-49ff-8c17-4ad2b0ffd32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:27.419062 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a8d6c-260a-49ff-8c17-4ad2b0ffd32e None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:27.421270 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a8d6c-260a-49ff-8c17-4ad2b0ffd32e None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:27.421270 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a8d6c-260a-49ff-8c17-4ad2b0ffd32e None admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:27.421270 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170a8d6c-260a-49ff-8c17-4ad2b0ffd32e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:27.421270 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170a8d6c-260a-49ff-8c17-4ad2b0ffd32e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:27.422150 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170a8d6c-260a-49ff-8c17-4ad2b0ffd32e None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:27.453575 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 311/609] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Jun 27 09:15:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:27.461588 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a8d6c-260a-49ff-8c17-4ad2b0ffd32e None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:27.464312 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0320d0-9fd1-4814-8ffd-6b64ce27b38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:27.468221 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0320d0-9fd1-4814-8ffd-6b64ce27b38c None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:27.472235 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0320d0-9fd1-4814-8ffd-6b64ce27b38c None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:27.472235 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0320d0-9fd1-4814-8ffd-6b64ce27b38c None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:27.472235 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0320d0-9fd1-4814-8ffd-6b64ce27b38c None admin] RBAC: Adding query filter params (name=service) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:27.472235 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0320d0-9fd1-4814-8ffd-6b64ce27b38c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:27.472235 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0320d0-9fd1-4814-8ffd-6b64ce27b38c None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:27.498168 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 299/610] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Jun 27 09:15:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:27.499561 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0320d0-9fd1-4814-8ffd-6b64ce27b38c None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:27.630475 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a8d6c-260a-49ff-8c17-4ad2b0ffd32e None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:27.667050 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e1e539-6ee8-4403-967b-285071c192a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:27.667943 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1e539-6ee8-4403-967b-285071c192a3 None admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:27.668248 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1e539-6ee8-4403-967b-285071c192a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:27.668529 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1e539-6ee8-4403-967b-285071c192a3 None admin] PATH_INFO: `/v3/projects/4ba8e40538db4d89b93469b79322d20e/users/097b991d67164cda94cc5aa24397f414/roles/197a0da3099d45e4bcb9233039c21d8f` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:27.683472 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:27.685356 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e1e539-6ee8-4403-967b-285071c192a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=4ba8e40538db4d89b93469b79322d20e, user_id=097b991d67164cda94cc5aa24397f414, role_id=197a0da3099d45e4bcb9233039c21d8f)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:27.686811 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e1e539-6ee8-4403-967b-285071c192a3 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:27.716224 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0320d0-9fd1-4814-8ffd-6b64ce27b38c None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:27.740234 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:27.748967 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11c3bc-7ac3-46a7-b457-957ce6a93ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:27.749758 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11c3bc-7ac3-46a7-b457-957ce6a93ee6 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:27.750125 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11c3bc-7ac3-46a7-b457-957ce6a93ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:27.751198 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11c3bc-7ac3-46a7-b457-957ce6a93ee6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:27.762463 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e11c3bc-7ac3-46a7-b457-957ce6a93ee6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:27.764056 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e11c3bc-7ac3-46a7-b457-957ce6a93ee6 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:27.782195 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 312/611] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Jun 27 09:15:27 2022] PUT /identity/v3/projects/4ba8e40538db4d89b93469b79322d20e/users/097b991d67164cda94cc5aa24397f414/roles/197a0da3099d45e4bcb9233039c21d8f => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:15:27.783680 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b59828-f868-43be-b8dc-3c88f570dc01 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:27.784053 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b59828-f868-43be-b8dc-3c88f570dc01 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:27.784475 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b59828-f868-43be-b8dc-3c88f570dc01 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:27.786029 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 313/612] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:15:27.794847 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-1e11c3bc-7ac3-46a7-b457-957ce6a93ee6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:27.794847 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:27.794847 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:27.794847 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:27.794847 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:27.794847 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:27.794847 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:27.794847 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:27.794847 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:27.794847 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:27.794847 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:27.794847 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:27.794847 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:27.794847 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:27.794847 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:27.795995 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:27.795995 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:27.795995 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:27.795995 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:27.795995 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:27.795995 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:27.795995 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:27.795995 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:27.795995 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:27.795995 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:27.795995 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:27.795995 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:27.795995 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:27.795995 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:27.795995 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:27.795995 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:27.795995 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:27.797839 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:27.797839 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:27.797839 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:27.797839 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:27.804243 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf858d-19d6-41f9-8415-829b0cfd6120 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:27.804243 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf858d-19d6-41f9-8415-829b0cfd6120 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:27.804243 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf858d-19d6-41f9-8415-829b0cfd6120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:27.819491 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 300/613] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:27.819860 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11c3bc-7ac3-46a7-b457-957ce6a93ee6 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:27.837846 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-e1bf858d-19d6-41f9-8415-829b0cfd6120 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:27.839108 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-e1bf858d-19d6-41f9-8415-829b0cfd6120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:27.962769 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 314/614] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 09:15:27.997098 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf858d-19d6-41f9-8415-829b0cfd6120 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:28.005946 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11c3bc-7ac3-46a7-b457-957ce6a93ee6 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:28.047554 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a5e46-fed0-49cd-8609-16ce39d76bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:28.048717 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a5e46-fed0-49cd-8609-16ce39d76bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:28.049216 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a5e46-fed0-49cd-8609-16ce39d76bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:28.049695 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a5e46-fed0-49cd-8609-16ce39d76bf7 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:28.050672 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a5e46-fed0-49cd-8609-16ce39d76bf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:28.051262 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a5e46-fed0-49cd-8609-16ce39d76bf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:28.053548 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a5e46-fed0-49cd-8609-16ce39d76bf7 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:28.068327 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 301/615] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:28.073801 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a5e46-fed0-49cd-8609-16ce39d76bf7 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:28.130411 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:28.131868 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf858d-19d6-41f9-8415-829b0cfd6120 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:28.179109 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:28.204047 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d94a5-c85a-4a3e-a9de-5a27241aa74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:28.204881 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d94a5-c85a-4a3e-a9de-5a27241aa74e None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:28.205162 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d94a5-c85a-4a3e-a9de-5a27241aa74e None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:28.205436 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d94a5-c85a-4a3e-a9de-5a27241aa74e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:28.226749 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d94a5-c85a-4a3e-a9de-5a27241aa74e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:15:28.240020 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-752d94a5-c85a-4a3e-a9de-5a27241aa74e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 09:15:28.240020 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:28.240020 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:28.240020 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:28.240020 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:28.240020 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:28.240020 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:28.240020 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:28.240020 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:28.240020 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:28.240020 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:28.240020 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:28.240020 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:15:28.240020 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:15:28.240020 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:15:28.240020 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:15:28.241066 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:15:28.241066 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:15:28.241066 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:15:28.241066 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:15:28.241066 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:28.241066 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:28.241066 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:28.241066 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:28.241066 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:28.241066 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:28.241066 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:28.241066 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:28.241066 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:28.241066 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:28.241066 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:28.241066 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:28.241907 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:28.241907 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:28.241907 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:28.241907 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:28.241907 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:15:28.241907 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:15:28.241907 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:15:28.241907 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:15:28.241907 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:15:28.241907 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:15:28.241907 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 09:15:28.241907 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:28.255665 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 315/616] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Jun 27 09:15:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 09:15:28.257158 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d94a5-c85a-4a3e-a9de-5a27241aa74e None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:28.280290 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a5e46-fed0-49cd-8609-16ce39d76bf7 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:28.353090 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21abcd4-2c1b-42bb-85cd-bba1d87f6e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:28.353896 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21abcd4-2c1b-42bb-85cd-bba1d87f6e53 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:28.354176 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21abcd4-2c1b-42bb-85cd-bba1d87f6e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:28.354503 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21abcd4-2c1b-42bb-85cd-bba1d87f6e53 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:28.373336 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21abcd4-2c1b-42bb-85cd-bba1d87f6e53 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:28.374795 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21abcd4-2c1b-42bb-85cd-bba1d87f6e53 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:28.405194 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-d21abcd4-2c1b-42bb-85cd-bba1d87f6e53 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 27 09:15:28.405194 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:28.405194 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:28.405194 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:28.405194 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:28.405194 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:28.405194 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:28.405194 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:28.405194 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:28.405194 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:28.405194 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:28.405194 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:28.405194 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 09:15:28.405194 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 09:15:28.405194 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 09:15:28.405194 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 09:15:28.407423 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:28.407423 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:28.407423 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 09:15:28.407423 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:15:28.407423 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 09:15:28.407423 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:15:28.407423 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:28.407423 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:28.407423 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:28.407423 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:28.407423 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:28.407423 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:28.407423 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:28.407423 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:28.407423 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:28.407423 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:28.407423 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:28.407423 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:28.409744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:28.409744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:28.409744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 09:15:28.409744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 09:15:28.409744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 09:15:28.409744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 09:15:28.409744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 09:15:28.409744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 09:15:28.409744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 27 09:15:28.409744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:28.409744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 302/617] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Jun 27 09:15:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:28.411913 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d94a5-c85a-4a3e-a9de-5a27241aa74e None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:28.417231 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21abcd4-2c1b-42bb-85cd-bba1d87f6e53 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:28.444575 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a34236-5f74-4d47-baa5-8552a8847575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:28.445276 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a34236-5f74-4d47-baa5-8552a8847575 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:28.445563 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a34236-5f74-4d47-baa5-8552a8847575 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:28.445837 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a34236-5f74-4d47-baa5-8552a8847575 None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:28.446579 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a34236-5f74-4d47-baa5-8552a8847575 None admin] RBAC: Adding query filter params (name=service) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:28.446884 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a34236-5f74-4d47-baa5-8552a8847575 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:28.448498 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a34236-5f74-4d47-baa5-8552a8847575 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:28.462162 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 316/618] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Jun 27 09:15:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:15:28.463252 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a34236-5f74-4d47-baa5-8552a8847575 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:28.513115 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:28.572112 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a34236-5f74-4d47-baa5-8552a8847575 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:28.613371 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb3512-c3e7-4a36-8868-405d6441ef75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:28.615217 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb3512-c3e7-4a36-8868-405d6441ef75 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:28.615503 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb3512-c3e7-4a36-8868-405d6441ef75 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:28.615778 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb3512-c3e7-4a36-8868-405d6441ef75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:28.639918 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fb3512-c3e7-4a36-8868-405d6441ef75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:28.643586 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fb3512-c3e7-4a36-8868-405d6441ef75 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:28.672672 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-63fb3512-c3e7-4a36-8868-405d6441ef75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:28.672672 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:28.672672 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:28.672672 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:28.672672 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:28.672672 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:28.672672 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:28.672672 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:28.672672 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:28.672672 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:28.672672 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:28.672672 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:28.672672 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:28.672672 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:28.672672 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:28.674916 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:28.674916 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:28.674916 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:28.674916 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:28.674916 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:28.674916 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:28.674916 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:28.674916 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:28.674916 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:28.674916 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:28.674916 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:28.674916 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:28.674916 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:28.674916 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:28.674916 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:28.674916 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:28.674916 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:28.677159 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:28.677159 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:28.677159 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:28.677159 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:28.688383 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 317/619] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:28.688652 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:28.689688 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb3512-c3e7-4a36-8868-405d6441ef75 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:28.695412 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21abcd4-2c1b-42bb-85cd-bba1d87f6e53 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:28.775559 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc256f6-792e-43c2-a12f-3b2d5673fe94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:28.776152 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc256f6-792e-43c2-a12f-3b2d5673fe94 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:28.776466 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc256f6-792e-43c2-a12f-3b2d5673fe94 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:28.776985 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc256f6-792e-43c2-a12f-3b2d5673fe94 None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:28.777835 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc256f6-792e-43c2-a12f-3b2d5673fe94 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:28.778144 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc256f6-792e-43c2-a12f-3b2d5673fe94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:28.780780 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc256f6-792e-43c2-a12f-3b2d5673fe94 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:28.822406 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 303/620] 10.222.0.62 () {56 vars in 1135 bytes} [Mon Jun 27 09:15:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:28.824407 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc256f6-792e-43c2-a12f-3b2d5673fe94 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:28.925250 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:28.935883 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb3512-c3e7-4a36-8868-405d6441ef75 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:28.952345 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc256f6-792e-43c2-a12f-3b2d5673fe94 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:28.991946 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c254337-b65d-4631-9f68-a5f3103ac88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:28.992810 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c254337-b65d-4631-9f68-a5f3103ac88f None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:28.993094 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c254337-b65d-4631-9f68-a5f3103ac88f None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:28.993374 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c254337-b65d-4631-9f68-a5f3103ac88f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:29.005686 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c254337-b65d-4631-9f68-a5f3103ac88f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:29.007164 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c254337-b65d-4631-9f68-a5f3103ac88f None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:29.028284 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-2c254337-b65d-4631-9f68-a5f3103ac88f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:29.028284 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:29.028284 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:29.028284 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:29.028284 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:29.028284 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:29.028284 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:29.028284 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:29.028284 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:29.028284 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:29.028284 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:29.028284 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:29.028284 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:29.028284 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:29.028284 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:29.029219 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:29.029219 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:29.029219 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:29.029219 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:29.029219 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:29.029219 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:29.029219 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:29.029219 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:29.029219 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:29.029219 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:29.029219 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:29.029219 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:29.029219 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:29.029219 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:29.029219 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:29.029219 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:29.029219 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:29.030091 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:29.030091 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:29.030091 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:29.030091 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:29.030091 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 304/621] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:29.034807 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c254337-b65d-4631-9f68-a5f3103ac88f None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:29.039777 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:29.054658 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de12fbc-c63d-4ee1-a67b-1e6fc1e232a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:29.055334 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de12fbc-c63d-4ee1-a67b-1e6fc1e232a0 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:29.057839 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de12fbc-c63d-4ee1-a67b-1e6fc1e232a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:29.057839 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de12fbc-c63d-4ee1-a67b-1e6fc1e232a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:29.057839 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de12fbc-c63d-4ee1-a67b-1e6fc1e232a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:29.057839 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de12fbc-c63d-4ee1-a67b-1e6fc1e232a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:29.058372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de12fbc-c63d-4ee1-a67b-1e6fc1e232a0 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:29.099595 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 318/622] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:15:29.118564 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de12fbc-c63d-4ee1-a67b-1e6fc1e232a0 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:29.158200 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c254337-b65d-4631-9f68-a5f3103ac88f None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:29.237573 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4200a-3f1e-4fa2-ab55-5fd692469cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:29.238409 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4200a-3f1e-4fa2-ab55-5fd692469cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:29.238742 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4200a-3f1e-4fa2-ab55-5fd692469cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:29.239692 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4200a-3f1e-4fa2-ab55-5fd692469cb0 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:29.240947 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c4200a-3f1e-4fa2-ab55-5fd692469cb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:29.241260 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c4200a-3f1e-4fa2-ab55-5fd692469cb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:29.244430 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c4200a-3f1e-4fa2-ab55-5fd692469cb0 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:29.274764 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 305/623] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:15:29.278516 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb810e-6321-427a-9e75-08b0bc447b21 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:29.278743 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb810e-6321-427a-9e75-08b0bc447b21 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:29.279018 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb810e-6321-427a-9e75-08b0bc447b21 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:29.280598 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 306/624] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:15:29.281365 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb810e-6321-427a-9e75-08b0bc447b21 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:29.321088 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de12fbc-c63d-4ee1-a67b-1e6fc1e232a0 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:29.349632 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:29.360506 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63c007-d559-44d5-aec1-807f1e62f04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:29.361299 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63c007-d559-44d5-aec1-807f1e62f04e None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:29.361579 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63c007-d559-44d5-aec1-807f1e62f04e None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:29.361852 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63c007-d559-44d5-aec1-807f1e62f04e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:29.370641 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f63c007-d559-44d5-aec1-807f1e62f04e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:29.372087 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f63c007-d559-44d5-aec1-807f1e62f04e None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:29.387372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-0f63c007-d559-44d5-aec1-807f1e62f04e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 27 09:15:29.387372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:29.387372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:29.387372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:29.387372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:29.387372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:29.387372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:29.387372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:29.387372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:29.387372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:29.387372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:29.387372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:29.387372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 09:15:29.387372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 09:15:29.387372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 09:15:29.387372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 09:15:29.388373 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:29.388373 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:29.388373 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 09:15:29.388373 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:15:29.388373 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 09:15:29.388373 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:15:29.388373 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:29.388373 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:29.388373 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:29.388373 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:29.388373 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:29.388373 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:29.388373 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:29.388373 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:29.388373 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:29.388373 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:29.388373 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:29.388373 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:29.394401 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:29.394401 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:29.394401 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 09:15:29.394401 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 09:15:29.394401 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 09:15:29.394401 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 09:15:29.394401 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 09:15:29.394401 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 09:15:29.394401 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 27 09:15:29.394401 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:29.394401 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 319/625] 10.222.0.62 () {56 vars in 1093 bytes} [Mon Jun 27 09:15:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:29.394401 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9611d7-dc8e-431f-a006-340dee568258 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:29.394401 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9611d7-dc8e-431f-a006-340dee568258 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:29.395166 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9611d7-dc8e-431f-a006-340dee568258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:29.395244 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb810e-6321-427a-9e75-08b0bc447b21 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:29.410399 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-6d9611d7-dc8e-431f-a006-340dee568258 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:29.412144 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-6d9611d7-dc8e-431f-a006-340dee568258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:29.424191 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:29.434621 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d389443-e0fc-4600-b9a1-bcb0d69b4348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:29.435513 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d389443-e0fc-4600-b9a1-bcb0d69b4348 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:29.435807 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d389443-e0fc-4600-b9a1-bcb0d69b4348 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:29.436076 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d389443-e0fc-4600-b9a1-bcb0d69b4348 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:29.444559 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d389443-e0fc-4600-b9a1-bcb0d69b4348 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:29.446204 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d389443-e0fc-4600-b9a1-bcb0d69b4348 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:29.460353 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-0d389443-e0fc-4600-b9a1-bcb0d69b4348 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:15:29.460353 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:29.460353 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:29.460353 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:29.460353 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:29.460353 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:29.460353 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:29.460353 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:29.460353 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:29.460353 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:29.460353 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:29.460353 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:29.460353 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 09:15:29.460353 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 09:15:29.460353 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 09:15:29.461272 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 09:15:29.461272 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:29.461272 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:29.461272 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:29.461272 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:29.461272 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:29.461272 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:29.461272 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:29.461272 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:29.461272 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:29.461272 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:29.461272 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:29.461272 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:29.461272 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:29.461272 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:29.461272 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:29.461272 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:29.462200 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 09:15:29.462200 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 09:15:29.462200 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 09:15:29.462200 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 09:15:29.462200 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 09:15:29.462200 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 09:15:29.462200 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:15:29.462200 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:29.462200 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 307/626] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:15:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:29.463226 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184ed3a-6819-4510-b190-2cbfad630b2a None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:29.463226 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184ed3a-6819-4510-b190-2cbfad630b2a None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:29.463361 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184ed3a-6819-4510-b190-2cbfad630b2a None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:29.468238 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 308/627] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:15:29.468238 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184ed3a-6819-4510-b190-2cbfad630b2a None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:29.490241 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 320/628] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:15:29.491374 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9611d7-dc8e-431f-a006-340dee568258 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:29.590768 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184ed3a-6819-4510-b190-2cbfad630b2a None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:29.598746 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9611d7-dc8e-431f-a006-340dee568258 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:29.615990 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:29.626534 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f634bc-7d49-47d6-9da8-b07e59740bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:29.627433 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f634bc-7d49-47d6-9da8-b07e59740bcb None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:29.627907 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f634bc-7d49-47d6-9da8-b07e59740bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:29.628147 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f634bc-7d49-47d6-9da8-b07e59740bcb None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:29.629008 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f634bc-7d49-47d6-9da8-b07e59740bcb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:29.629322 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f634bc-7d49-47d6-9da8-b07e59740bcb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:29.630778 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f634bc-7d49-47d6-9da8-b07e59740bcb None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:29.636169 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ded56-fb85-4753-8a8f-7b076d217647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:29.636866 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ded56-fb85-4753-8a8f-7b076d217647 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:29.637178 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ded56-fb85-4753-8a8f-7b076d217647 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:29.637448 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ded56-fb85-4753-8a8f-7b076d217647 None admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:29.638311 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ded56-fb85-4753-8a8f-7b076d217647 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:29.638522 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ded56-fb85-4753-8a8f-7b076d217647 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:29.640048 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ded56-fb85-4753-8a8f-7b076d217647 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:29.650066 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 309/629] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Jun 27 09:15:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:29.651425 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40632bca-eb2e-4fb0-8e5d-598f5e4b13b3 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:29.651983 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40632bca-eb2e-4fb0-8e5d-598f5e4b13b3 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:29.652288 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40632bca-eb2e-4fb0-8e5d-598f5e4b13b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:29.657393 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 321/630] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Jun 27 09:15:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:29.658681 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ded56-fb85-4753-8a8f-7b076d217647 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:29.670860 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:29.675703 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-40632bca-eb2e-4fb0-8e5d-598f5e4b13b3 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:29.677609 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-40632bca-eb2e-4fb0-8e5d-598f5e4b13b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:29.756915 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 310/631] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:15:29.757895 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40632bca-eb2e-4fb0-8e5d-598f5e4b13b3 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:29.768142 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ded56-fb85-4753-8a8f-7b076d217647 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:29.809127 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f3121-5df0-4b21-87aa-0fdc69595955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:29.809958 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f3121-5df0-4b21-87aa-0fdc69595955 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:29.810242 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f3121-5df0-4b21-87aa-0fdc69595955 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:29.810542 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f3121-5df0-4b21-87aa-0fdc69595955 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:29.822067 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596f3121-5df0-4b21-87aa-0fdc69595955 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:15:29.829849 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-596f3121-5df0-4b21-87aa-0fdc69595955 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 09:15:29.829849 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:29.829849 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:29.829849 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:29.829849 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:29.829849 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:29.829849 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:29.829849 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:29.829849 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:29.829849 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:29.829849 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:29.829849 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:29.829849 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:15:29.829849 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:15:29.829849 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:15:29.829849 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:15:29.830760 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:15:29.830760 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:15:29.830760 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:15:29.830760 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:15:29.830760 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:29.830760 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:29.830760 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:29.830760 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:29.830760 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:29.830760 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:29.830760 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:29.830760 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:29.830760 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:29.830760 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:29.830760 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:29.830760 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:29.831594 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:29.831594 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:29.831594 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:29.831594 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:29.831594 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:15:29.831594 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:15:29.831594 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:15:29.831594 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:15:29.831594 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:15:29.831594 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:15:29.831594 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 09:15:29.831594 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:29.831594 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 322/632] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Jun 27 09:15:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:29.832345 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f3121-5df0-4b21-87aa-0fdc69595955 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:29.882804 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40632bca-eb2e-4fb0-8e5d-598f5e4b13b3 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:29.897652 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:29.905432 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:29.923214 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ccadf1-a310-4da5-b623-cfe55973ba40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:29.924085 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccadf1-a310-4da5-b623-cfe55973ba40 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:29.925151 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccadf1-a310-4da5-b623-cfe55973ba40 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:29.925901 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccadf1-a310-4da5-b623-cfe55973ba40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:29.946155 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f3121-5df0-4b21-87aa-0fdc69595955 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:29.983741 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8cba5-78cd-4e47-9194-ece18745d116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:29.984643 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8cba5-78cd-4e47-9194-ece18745d116 None admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:29.984951 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8cba5-78cd-4e47-9194-ece18745d116 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:29.985202 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8cba5-78cd-4e47-9194-ece18745d116 None admin] PATH_INFO: `/v3/projects/4ba8e40538db4d89b93469b79322d20e/users/f5477b14dae24fd3a644c9cbd6ff85ec/roles/197a0da3099d45e4bcb9233039c21d8f` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:29.999938 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ccadf1-a310-4da5-b623-cfe55973ba40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:30.001084 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e8cba5-78cd-4e47-9194-ece18745d116 None admin] RBAC: Authorizing `identity:create_grant(project_id=4ba8e40538db4d89b93469b79322d20e, user_id=f5477b14dae24fd3a644c9cbd6ff85ec, role_id=197a0da3099d45e4bcb9233039c21d8f)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:30.001439 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ccadf1-a310-4da5-b623-cfe55973ba40 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:30.002526 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e8cba5-78cd-4e47-9194-ece18745d116 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:30.106775 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 311/634] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:15:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 09:15:30.106775 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ccadf1-a310-4da5-b623-cfe55973ba40 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:30.112569 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 323/634] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Jun 27 09:15:29 2022] PUT /identity/v3/projects/4ba8e40538db4d89b93469b79322d20e/users/f5477b14dae24fd3a644c9cbd6ff85ec/roles/197a0da3099d45e4bcb9233039c21d8f => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:15:30.113617 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8cba5-78cd-4e47-9194-ece18745d116 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:30.128636 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:30.234330 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ccadf1-a310-4da5-b623-cfe55973ba40 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:30.250957 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8cba5-78cd-4e47-9194-ece18745d116 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:30.275065 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:30.279061 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5492372-a24f-4ce1-9525-294422cbb3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:30.279910 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5492372-a24f-4ce1-9525-294422cbb3c0 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:30.280216 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5492372-a24f-4ce1-9525-294422cbb3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:30.280495 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5492372-a24f-4ce1-9525-294422cbb3c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:30.291522 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5492372-a24f-4ce1-9525-294422cbb3c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:15:30.292990 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d5925-f6a5-43e5-bc36-68b787949528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:30.293657 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d5925-f6a5-43e5-bc36-68b787949528 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:30.294066 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d5925-f6a5-43e5-bc36-68b787949528 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:30.296534 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d5925-f6a5-43e5-bc36-68b787949528 None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:30.297465 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d5925-f6a5-43e5-bc36-68b787949528 None admin] RBAC: Adding query filter params (name=service) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:30.297780 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d5925-f6a5-43e5-bc36-68b787949528 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:30.299290 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d5925-f6a5-43e5-bc36-68b787949528 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:30.299408 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-e5492372-a24f-4ce1-9525-294422cbb3c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 09:15:30.299408 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:30.299408 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:30.299408 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:30.299408 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:30.299408 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:30.299408 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:30.299408 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:30.299408 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:30.299408 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:30.299408 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:30.299408 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:30.299408 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:15:30.299408 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:15:30.299408 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:15:30.299408 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:15:30.300359 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:15:30.300359 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:15:30.300359 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:15:30.300359 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:15:30.300359 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:30.300359 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:30.300359 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:30.300359 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:30.300359 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:30.300359 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:30.300359 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:30.300359 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:30.300359 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:30.300359 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:30.300359 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:30.300359 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:30.301457 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:30.301457 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:30.301457 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:30.301457 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:30.301457 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:15:30.301457 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:15:30.301457 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:15:30.301457 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:15:30.301457 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:15:30.301457 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:15:30.301457 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 09:15:30.301457 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:30.301457 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 312/635] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Jun 27 09:15:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:30.302219 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5492372-a24f-4ce1-9525-294422cbb3c0 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:30.312155 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 324/636] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Jun 27 09:15:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:30.312155 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ff6d4-ce5b-4e49-a27e-53dcdbb60f76 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:30.312155 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ff6d4-ce5b-4e49-a27e-53dcdbb60f76 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:30.312155 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ff6d4-ce5b-4e49-a27e-53dcdbb60f76 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:30.316081 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 325/637] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:15:30.317513 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ff6d4-ce5b-4e49-a27e-53dcdbb60f76 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:30.394623 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:30.428725 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5492372-a24f-4ce1-9525-294422cbb3c0 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:30.436019 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ff6d4-ce5b-4e49-a27e-53dcdbb60f76 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:30.468432 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e624544c-49b8-4ad9-8201-bcbced4ed411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:30.469229 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624544c-49b8-4ad9-8201-bcbced4ed411 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:30.469516 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624544c-49b8-4ad9-8201-bcbced4ed411 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:30.469789 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624544c-49b8-4ad9-8201-bcbced4ed411 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:30.479029 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30e13d6-4db8-4822-8eb7-3f72d6d7242d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:30.480309 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e13d6-4db8-4822-8eb7-3f72d6d7242d None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:30.480782 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e13d6-4db8-4822-8eb7-3f72d6d7242d None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:30.481367 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e13d6-4db8-4822-8eb7-3f72d6d7242d None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:30.482074 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30e13d6-4db8-4822-8eb7-3f72d6d7242d None admin] RBAC: Adding query filter params (name=service) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:30.482190 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e624544c-49b8-4ad9-8201-bcbced4ed411 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:30.482497 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30e13d6-4db8-4822-8eb7-3f72d6d7242d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:30.483650 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e624544c-49b8-4ad9-8201-bcbced4ed411 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:30.484074 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30e13d6-4db8-4822-8eb7-3f72d6d7242d None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:30.493871 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 326/638] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Jun 27 09:15:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:30.494973 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30e13d6-4db8-4822-8eb7-3f72d6d7242d None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:30.507131 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-e624544c-49b8-4ad9-8201-bcbced4ed411 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:30.507131 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:30.507131 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:30.507131 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:30.507131 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:30.507131 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:30.507131 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:30.507131 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:30.507131 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:30.507131 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:30.507131 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:30.507131 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:30.507131 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:30.507131 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:30.507131 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:30.511257 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:30.511257 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:30.511257 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:30.511257 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:30.511257 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:30.511257 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:30.511257 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:30.511257 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:30.511257 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:30.511257 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:30.511257 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:30.511257 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:30.511257 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:30.511257 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:30.511257 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:30.511257 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:30.511257 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:30.512382 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:30.512382 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:30.512382 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:30.512382 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:30.512382 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 313/639] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:30.512382 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b0157-5980-478b-8657-07bf57be55e1 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:30.512875 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b0157-5980-478b-8657-07bf57be55e1 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:30.513184 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b0157-5980-478b-8657-07bf57be55e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:30.531390 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-4b7b0157-5980-478b-8657-07bf57be55e1 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:30.532635 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-4b7b0157-5980-478b-8657-07bf57be55e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:30.548314 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:30.605050 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 314/640] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:15:30.605910 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b0157-5980-478b-8657-07bf57be55e1 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:30.623042 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30e13d6-4db8-4822-8eb7-3f72d6d7242d None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:30.660773 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb0b98-72e9-4dbc-b24d-e344cb77fd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:30.661662 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb0b98-72e9-4dbc-b24d-e344cb77fd4a None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:30.661845 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb0b98-72e9-4dbc-b24d-e344cb77fd4a None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:30.662120 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb0b98-72e9-4dbc-b24d-e344cb77fd4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:30.668649 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:30.673208 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fb0b98-72e9-4dbc-b24d-e344cb77fd4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:30.674631 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fb0b98-72e9-4dbc-b24d-e344cb77fd4a None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:30.693500 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-e4fb0b98-72e9-4dbc-b24d-e344cb77fd4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:30.693500 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:30.693500 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:30.693500 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:30.693500 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:30.693500 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:30.693500 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:30.693500 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:30.693500 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:30.693500 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:30.693500 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:30.693500 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:30.693500 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:30.693500 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:30.693500 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:30.694447 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:30.694447 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:30.694447 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:30.694447 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:30.694447 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:30.694447 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:30.694447 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:30.694447 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:30.694447 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:30.694447 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:30.694447 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:30.694447 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:30.694447 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:30.694447 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:30.694447 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:30.694447 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:30.694447 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:30.695365 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:30.695365 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:30.695365 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:30.695365 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:30.695365 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 327/641] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:30.695636 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb0b98-72e9-4dbc-b24d-e344cb77fd4a None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:30.723752 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b0157-5980-478b-8657-07bf57be55e1 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:30.760366 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd49b305-e100-4e62-a77f-347d632eaa54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:30.761198 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49b305-e100-4e62-a77f-347d632eaa54 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:30.761557 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49b305-e100-4e62-a77f-347d632eaa54 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:30.761904 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49b305-e100-4e62-a77f-347d632eaa54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:30.772468 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd49b305-e100-4e62-a77f-347d632eaa54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:30.774019 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd49b305-e100-4e62-a77f-347d632eaa54 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:30.792222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-fd49b305-e100-4e62-a77f-347d632eaa54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:30.792222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:30.792222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:30.792222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:30.792222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:30.792222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:30.792222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:30.792222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:30.792222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:30.792222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:30.792222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:30.792222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:30.792222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:30.792222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:30.792222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:30.793217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:30.793217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:30.793217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:30.793217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:30.793217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:30.793217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:30.793217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:30.793217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:30.793217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:30.793217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:30.793217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:30.793217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:30.793217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:30.793217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:30.793217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:30.793217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:30.793217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:30.794128 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:30.794128 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:30.794128 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:30.794128 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:30.794128 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 315/642] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:30.794430 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd49b305-e100-4e62-a77f-347d632eaa54 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:30.800694 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:30.810029 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb0b98-72e9-4dbc-b24d-e344cb77fd4a None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:30.845626 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352bc5a0-48ae-48d3-b299-6e16e798ee45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:30.846284 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352bc5a0-48ae-48d3-b299-6e16e798ee45 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:30.846570 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352bc5a0-48ae-48d3-b299-6e16e798ee45 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:30.846843 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352bc5a0-48ae-48d3-b299-6e16e798ee45 None admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:30.847589 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352bc5a0-48ae-48d3-b299-6e16e798ee45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:30.847905 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352bc5a0-48ae-48d3-b299-6e16e798ee45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:30.849467 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352bc5a0-48ae-48d3-b299-6e16e798ee45 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:30.861240 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 328/643] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:30.865324 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352bc5a0-48ae-48d3-b299-6e16e798ee45 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:30.912395 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd49b305-e100-4e62-a77f-347d632eaa54 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:30.920013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:30.948935 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe477df-5d00-4e1c-9da6-762c8e8e1fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:30.949741 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe477df-5d00-4e1c-9da6-762c8e8e1fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:30.950028 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe477df-5d00-4e1c-9da6-762c8e8e1fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:30.950301 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe477df-5d00-4e1c-9da6-762c8e8e1fc5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:30.962582 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe477df-5d00-4e1c-9da6-762c8e8e1fc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:15:30.970324 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-4fe477df-5d00-4e1c-9da6-762c8e8e1fc5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 09:15:30.970324 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:30.970324 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:30.970324 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:30.970324 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:30.970324 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:30.970324 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:30.970324 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:30.970324 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:30.970324 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:30.970324 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:30.970324 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:30.970324 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:15:30.970324 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:15:30.970324 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:15:30.970324 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:15:30.971454 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:15:30.971454 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:15:30.971454 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:15:30.971454 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:15:30.971454 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:30.971454 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:30.971454 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:30.971454 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:30.971454 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:30.971454 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:30.971454 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:30.971454 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:30.971454 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:30.971454 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:30.971454 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:30.971454 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:30.972668 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:30.972668 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:30.972668 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:30.972668 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:30.972668 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:15:30.972668 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:15:30.972668 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:15:30.972668 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:15:30.972668 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:15:30.972668 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:15:30.972668 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 09:15:30.972668 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:30.976741 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 316/644] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Jun 27 09:15:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:30.977487 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe477df-5d00-4e1c-9da6-762c8e8e1fc5 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:30.978167 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352bc5a0-48ae-48d3-b299-6e16e798ee45 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:31.015709 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a8ce9-0347-437d-8e6c-635877555296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:31.016321 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a8ce9-0347-437d-8e6c-635877555296 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:31.016604 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a8ce9-0347-437d-8e6c-635877555296 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:31.016878 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a8ce9-0347-437d-8e6c-635877555296 None admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:31.017597 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6a8ce9-0347-437d-8e6c-635877555296 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:31.017903 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6a8ce9-0347-437d-8e6c-635877555296 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:31.019706 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6a8ce9-0347-437d-8e6c-635877555296 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:31.033408 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 329/645] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:31.034227 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a8ce9-0347-437d-8e6c-635877555296 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:31.050563 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:31.098848 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe477df-5d00-4e1c-9da6-762c8e8e1fc5 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:31.141500 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa141c-8b7d-490e-81b7-44e963b4dd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:31.142158 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa141c-8b7d-490e-81b7-44e963b4dd8d None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:31.142426 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa141c-8b7d-490e-81b7-44e963b4dd8d None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:31.142696 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa141c-8b7d-490e-81b7-44e963b4dd8d None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:31.143398 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aa141c-8b7d-490e-81b7-44e963b4dd8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:31.143703 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aa141c-8b7d-490e-81b7-44e963b4dd8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:31.145146 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aa141c-8b7d-490e-81b7-44e963b4dd8d None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:31.155616 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a8ce9-0347-437d-8e6c-635877555296 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:31.160059 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 317/646] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:31.165503 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa141c-8b7d-490e-81b7-44e963b4dd8d None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:31.193436 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:31.193621 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d83ab-a9be-4f54-999f-a920e487a8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:31.194319 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d83ab-a9be-4f54-999f-a920e487a8f7 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:31.194590 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d83ab-a9be-4f54-999f-a920e487a8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:31.194866 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d83ab-a9be-4f54-999f-a920e487a8f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:31.204241 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d83ab-a9be-4f54-999f-a920e487a8f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:31.204241 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d83ab-a9be-4f54-999f-a920e487a8f7 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:31.217836 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-366d83ab-a9be-4f54-999f-a920e487a8f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:15:31.217836 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:31.217836 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:31.217836 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:31.217836 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:31.217836 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:31.217836 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:31.217836 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:31.217836 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:31.217836 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:31.217836 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:31.217836 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:31.217836 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 09:15:31.217836 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 09:15:31.217836 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 09:15:31.219628 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 09:15:31.219628 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:31.219628 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:31.219628 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:31.219628 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:31.219628 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:31.219628 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:31.219628 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:31.219628 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:31.219628 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:31.219628 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:31.219628 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:31.219628 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:31.219628 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:31.219628 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:31.219628 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:31.219628 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:31.221568 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 09:15:31.221568 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 09:15:31.221568 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 09:15:31.221568 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 09:15:31.221568 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 09:15:31.221568 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 09:15:31.221568 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:15:31.221568 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:31.224102 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 330/647] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:15:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:31.225228 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d83ab-a9be-4f54-999f-a920e487a8f7 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:31.280813 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa141c-8b7d-490e-81b7-44e963b4dd8d None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:31.303556 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:31.317585 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ddb4a-ca81-4967-8cc7-42c71694ec2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:31.318257 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ddb4a-ca81-4967-8cc7-42c71694ec2e None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:31.319190 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ddb4a-ca81-4967-8cc7-42c71694ec2e None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:31.319190 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ddb4a-ca81-4967-8cc7-42c71694ec2e None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:31.319568 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ddb4a-ca81-4967-8cc7-42c71694ec2e None admin] RBAC: Adding query filter params (name=service) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:31.319840 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ddb4a-ca81-4967-8cc7-42c71694ec2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:31.321250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ddb4a-ca81-4967-8cc7-42c71694ec2e None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:31.329937 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 318/648] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Jun 27 09:15:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:31.333609 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d83ab-a9be-4f54-999f-a920e487a8f7 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:31.335465 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ddb4a-ca81-4967-8cc7-42c71694ec2e None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:31.374704 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba8438-cd2d-4776-a54a-e20b33999798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:31.376795 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba8438-cd2d-4776-a54a-e20b33999798 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:31.377429 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba8438-cd2d-4776-a54a-e20b33999798 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:31.377971 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba8438-cd2d-4776-a54a-e20b33999798 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:31.392404 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ba8438-cd2d-4776-a54a-e20b33999798 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:31.395608 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ba8438-cd2d-4776-a54a-e20b33999798 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:31.423354 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-d4ba8438-cd2d-4776-a54a-e20b33999798 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 27 09:15:31.423354 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:31.423354 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:31.423354 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:31.423354 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:31.423354 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:31.423354 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:31.423354 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:31.423354 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:31.423354 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:31.423354 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:31.423354 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:31.423354 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 09:15:31.423354 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 09:15:31.423354 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 09:15:31.423354 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 09:15:31.424496 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:31.424496 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:31.424496 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 09:15:31.424496 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:15:31.424496 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 09:15:31.424496 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:15:31.424496 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:31.424496 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:31.424496 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:31.424496 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:31.424496 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:31.424496 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:31.424496 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:31.424496 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:31.424496 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:31.424496 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:31.424496 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:31.424496 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:31.425470 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:31.425470 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:31.425470 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 09:15:31.425470 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 09:15:31.425470 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 09:15:31.425470 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 09:15:31.425470 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 09:15:31.425470 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 09:15:31.425470 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 27 09:15:31.425470 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:31.425470 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 331/649] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:15:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:31.426952 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba8438-cd2d-4776-a54a-e20b33999798 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:31.440844 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:31.453816 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ddb4a-ca81-4967-8cc7-42c71694ec2e None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:31.498861 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32dc3bd-8f05-4ea9-9a47-9e5ba585434f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:31.499682 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32dc3bd-8f05-4ea9-9a47-9e5ba585434f None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:31.500016 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32dc3bd-8f05-4ea9-9a47-9e5ba585434f None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:31.500326 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32dc3bd-8f05-4ea9-9a47-9e5ba585434f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:31.508309 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32dc3bd-8f05-4ea9-9a47-9e5ba585434f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:31.509931 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32dc3bd-8f05-4ea9-9a47-9e5ba585434f None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:31.525987 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-d32dc3bd-8f05-4ea9-9a47-9e5ba585434f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 27 09:15:31.525987 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:31.525987 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:31.525987 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:31.525987 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:31.525987 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:31.525987 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:31.525987 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:31.525987 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:31.525987 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:31.525987 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:31.525987 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:31.525987 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 09:15:31.525987 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 09:15:31.525987 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 09:15:31.525987 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 09:15:31.527217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:31.527217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:31.527217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 09:15:31.527217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:15:31.527217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 09:15:31.527217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:15:31.527217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:31.527217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:31.527217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:31.527217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:31.527217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:31.527217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:31.527217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:31.527217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:31.527217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:31.527217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:31.527217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:31.527217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:31.528135 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:31.528135 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:31.528135 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 09:15:31.528135 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 09:15:31.528135 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 09:15:31.528135 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 09:15:31.528135 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 09:15:31.528135 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 09:15:31.528135 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 27 09:15:31.528135 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:31.528135 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 319/650] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:15:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:31.529271 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32dc3bd-8f05-4ea9-9a47-9e5ba585434f None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:31.572665 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba8438-cd2d-4776-a54a-e20b33999798 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:31.604827 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:31.610494 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2d174-8dc0-479f-a774-fa0c59e17569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:31.611200 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2d174-8dc0-479f-a774-fa0c59e17569 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:31.611486 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2d174-8dc0-479f-a774-fa0c59e17569 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:31.611766 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2d174-8dc0-479f-a774-fa0c59e17569 None admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:31.612593 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc2d174-8dc0-479f-a774-fa0c59e17569 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:31.622673 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc2d174-8dc0-479f-a774-fa0c59e17569 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:31.622673 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc2d174-8dc0-479f-a774-fa0c59e17569 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:31.628265 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 332/651] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Jun 27 09:15:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:31.633334 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2d174-8dc0-479f-a774-fa0c59e17569 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:31.649632 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32dc3bd-8f05-4ea9-9a47-9e5ba585434f None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:31.687941 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cddc459-0f73-4cf9-817b-5c5202d6be38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:31.689065 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddc459-0f73-4cf9-817b-5c5202d6be38 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:31.689417 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddc459-0f73-4cf9-817b-5c5202d6be38 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:31.690041 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddc459-0f73-4cf9-817b-5c5202d6be38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:31.705104 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cddc459-0f73-4cf9-817b-5c5202d6be38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:31.707341 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cddc459-0f73-4cf9-817b-5c5202d6be38 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:31.719820 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:31.733248 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-1cddc459-0f73-4cf9-817b-5c5202d6be38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:31.733248 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:31.733248 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:31.733248 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:31.733248 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:31.733248 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:31.733248 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:31.733248 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:31.733248 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:31.733248 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:31.733248 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:31.733248 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:31.733248 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:31.733248 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:31.733248 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:31.734425 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:31.734425 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:31.734425 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:31.734425 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:31.734425 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:31.734425 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:31.734425 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:31.734425 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:31.734425 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:31.734425 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:31.734425 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:31.734425 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:31.734425 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:31.734425 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:31.734425 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:31.734425 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:31.734425 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:31.735698 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:31.735698 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:31.735698 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:31.735698 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:31.736332 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 320/652] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:31.737331 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cddc459-0f73-4cf9-817b-5c5202d6be38 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:31.749798 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2d174-8dc0-479f-a774-fa0c59e17569 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:31.793998 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd0222-e531-44b0-9601-8d6c0ebd9ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:31.794679 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd0222-e531-44b0-9601-8d6c0ebd9ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:31.794969 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd0222-e531-44b0-9601-8d6c0ebd9ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:31.795243 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd0222-e531-44b0-9601-8d6c0ebd9ed4 None admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:31.796096 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbd0222-e531-44b0-9601-8d6c0ebd9ed4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:31.796455 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbd0222-e531-44b0-9601-8d6c0ebd9ed4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:31.797918 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbd0222-e531-44b0-9601-8d6c0ebd9ed4 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:31.828340 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 333/653] 10.222.0.62 () {56 vars in 1137 bytes} [Mon Jun 27 09:15:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:31.834301 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd0222-e531-44b0-9601-8d6c0ebd9ed4 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:31.882834 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cddc459-0f73-4cf9-817b-5c5202d6be38 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:31.890591 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:31.920349 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ea4d9-d70e-48d1-867b-7d33e72783d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:31.923327 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ea4d9-d70e-48d1-867b-7d33e72783d7 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:31.923327 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ea4d9-d70e-48d1-867b-7d33e72783d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:31.923327 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ea4d9-d70e-48d1-867b-7d33e72783d7 None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:31.923327 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ea4d9-d70e-48d1-867b-7d33e72783d7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:31.923327 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ea4d9-d70e-48d1-867b-7d33e72783d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:31.924220 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ea4d9-d70e-48d1-867b-7d33e72783d7 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:31.943917 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 321/654] 10.222.0.62 () {56 vars in 1137 bytes} [Mon Jun 27 09:15:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:31.944511 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ea4d9-d70e-48d1-867b-7d33e72783d7 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:31.947123 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd0222-e531-44b0-9601-8d6c0ebd9ed4 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:31.984656 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c41fa2-1607-478a-bffc-4d14628b0bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:31.985316 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c41fa2-1607-478a-bffc-4d14628b0bbc None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:31.985593 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c41fa2-1607-478a-bffc-4d14628b0bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:31.985867 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c41fa2-1607-478a-bffc-4d14628b0bbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:31.986700 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c41fa2-1607-478a-bffc-4d14628b0bbc None admin] RBAC: Adding query filter params (role.id=197a0da3099d45e4bcb9233039c21d8f, scope.project.id=4ba8e40538db4d89b93469b79322d20e, user.id=2c1434a85b30411c9c59cc50c3980cd8) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:31.987007 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c41fa2-1607-478a-bffc-4d14628b0bbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:31.988506 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c41fa2-1607-478a-bffc-4d14628b0bbc None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:32.004236 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 334/655] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Jun 27 09:15:31 2022] GET /identity/v3/role_assignments?user.id=2c1434a85b30411c9c59cc50c3980cd8&scope.project.id=4ba8e40538db4d89b93469b79322d20e&role.id=197a0da3099d45e4bcb9233039c21d8f => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:32.004236 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c41fa2-1607-478a-bffc-4d14628b0bbc None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:32.024340 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:32.088322 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ea4d9-d70e-48d1-867b-7d33e72783d7 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:32.145824 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fd211-0816-4694-b680-8d76d0994da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:32.147323 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fd211-0816-4694-b680-8d76d0994da1 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:32.147776 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fd211-0816-4694-b680-8d76d0994da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:32.148240 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fd211-0816-4694-b680-8d76d0994da1 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:32.149184 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9fd211-0816-4694-b680-8d76d0994da1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:32.149746 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9fd211-0816-4694-b680-8d76d0994da1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:32.150499 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c41fa2-1607-478a-bffc-4d14628b0bbc None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:32.151788 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9fd211-0816-4694-b680-8d76d0994da1 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:32.175805 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:32.177019 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 322/656] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:32.178184 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fd211-0816-4694-b680-8d76d0994da1 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:32.200334 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d275967-4798-425b-96ab-26d97d1f1bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:32.200601 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d275967-4798-425b-96ab-26d97d1f1bdc None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:32.200875 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d275967-4798-425b-96ab-26d97d1f1bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:32.201551 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d275967-4798-425b-96ab-26d97d1f1bdc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:32.283328 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d275967-4798-425b-96ab-26d97d1f1bdc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:32.285317 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d275967-4798-425b-96ab-26d97d1f1bdc None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:32.297710 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fd211-0816-4694-b680-8d76d0994da1 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:32.316768 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:32.334694 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3463dfed-7ec1-4a0f-a040-d577448f8589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:32.335345 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3463dfed-7ec1-4a0f-a040-d577448f8589 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:32.335621 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3463dfed-7ec1-4a0f-a040-d577448f8589 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:32.335898 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3463dfed-7ec1-4a0f-a040-d577448f8589 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:32.404504 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 335/657] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:15:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 09:15:32.405639 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d275967-4798-425b-96ab-26d97d1f1bdc None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:32.425268 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:32.427796 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3463dfed-7ec1-4a0f-a040-d577448f8589 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:32.429334 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3463dfed-7ec1-4a0f-a040-d577448f8589 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:32.517769 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d275967-4798-425b-96ab-26d97d1f1bdc None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:32.546787 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 323/658] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:15:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 09:15:32.548135 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26afb581-b8f7-49cd-867b-448adba12b07 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:32.548658 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26afb581-b8f7-49cd-867b-448adba12b07 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:32.548767 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26afb581-b8f7-49cd-867b-448adba12b07 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:32.554855 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 324/659] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:15:32.554855 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26afb581-b8f7-49cd-867b-448adba12b07 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:32.563468 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb071b-602b-4ee5-985f-572d96dd9e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:32.564290 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb071b-602b-4ee5-985f-572d96dd9e63 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:32.564572 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb071b-602b-4ee5-985f-572d96dd9e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:32.564841 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb071b-602b-4ee5-985f-572d96dd9e63 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:32.572727 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bb071b-602b-4ee5-985f-572d96dd9e63 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:32.574171 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bb071b-602b-4ee5-985f-572d96dd9e63 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:32.577969 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:32.589530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-63bb071b-602b-4ee5-985f-572d96dd9e63 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 27 09:15:32.589530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:32.589530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:32.589530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:32.589530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:32.589530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:32.589530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:32.589530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:32.589530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:32.589530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:32.589530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:32.589530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:32.589530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 09:15:32.589530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 09:15:32.589530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 09:15:32.589530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 09:15:32.590537 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:32.590537 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:32.590537 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 09:15:32.590537 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:15:32.590537 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 09:15:32.590537 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:15:32.590537 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:32.590537 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:32.590537 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:32.590537 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:32.590537 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:32.590537 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:32.590537 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:32.590537 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:32.590537 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:32.590537 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:32.590537 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:32.590537 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:32.591466 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:32.591466 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:32.591466 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 09:15:32.591466 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 09:15:32.591466 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 09:15:32.591466 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 09:15:32.591466 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 09:15:32.591466 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 09:15:32.591466 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 27 09:15:32.591466 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:32.591466 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 336/660] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Jun 27 09:15:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:32.592064 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb071b-602b-4ee5-985f-572d96dd9e63 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:32.673856 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:32.678683 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26afb581-b8f7-49cd-867b-448adba12b07 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:32.700626 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb071b-602b-4ee5-985f-572d96dd9e63 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:32.720813 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ae84c-623c-4311-9a0b-94ca84749537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:32.721803 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ae84c-623c-4311-9a0b-94ca84749537 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:32.722232 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ae84c-623c-4311-9a0b-94ca84749537 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:32.722610 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ae84c-623c-4311-9a0b-94ca84749537 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:32.736127 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ae84c-623c-4311-9a0b-94ca84749537 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:32.737717 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ae84c-623c-4311-9a0b-94ca84749537 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:32.747421 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4d432-5d5b-43f4-a455-6546b67701a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:32.748443 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4d432-5d5b-43f4-a455-6546b67701a6 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:32.748825 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4d432-5d5b-43f4-a455-6546b67701a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:32.749202 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4d432-5d5b-43f4-a455-6546b67701a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:32.758854 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-140ae84c-623c-4311-9a0b-94ca84749537 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:32.758854 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:32.758854 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:32.758854 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:32.758854 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:32.758854 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:32.758854 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:32.758854 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:32.758854 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:32.758854 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:32.758854 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:32.758854 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:32.758854 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:32.758854 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:32.758854 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:32.760013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:32.760013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:32.760013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:32.760013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:32.760013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:32.760013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:32.760013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:32.760013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:32.760013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:32.760013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:32.760013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:32.760013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:32.760013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:32.760013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:32.760013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:32.760013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:32.760013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:32.761035 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:32.761035 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:32.761035 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:32.761035 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:32.761035 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 325/661] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:32.762393 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192f74c-3b45-4a66-a955-1893d5090cde None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:32.762393 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192f74c-3b45-4a66-a955-1893d5090cde None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:32.762393 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192f74c-3b45-4a66-a955-1893d5090cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:32.765781 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af4d432-5d5b-43f4-a455-6546b67701a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:32.769517 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af4d432-5d5b-43f4-a455-6546b67701a6 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:32.780146 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-8192f74c-3b45-4a66-a955-1893d5090cde None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:32.781464 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-8192f74c-3b45-4a66-a955-1893d5090cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:32.794617 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-0af4d432-5d5b-43f4-a455-6546b67701a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:32.794617 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:32.794617 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:32.794617 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:32.794617 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:32.794617 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:32.794617 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:32.794617 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:32.794617 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:32.794617 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:32.794617 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:32.794617 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:32.794617 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:32.794617 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:32.794617 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:32.795550 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:32.795550 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:32.795550 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:32.795550 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:32.795550 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:32.795550 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:32.795550 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:32.795550 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:32.795550 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:32.795550 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:32.795550 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:32.795550 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:32.795550 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:32.795550 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:32.795550 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:32.795550 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:32.795550 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:32.797088 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:32.797088 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:32.797088 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:32.797088 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:32.797088 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 337/662] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:32.797088 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4d432-5d5b-43f4-a455-6546b67701a6 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:32.859388 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:32.868251 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 326/663] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:15:32.868251 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8192f74c-3b45-4a66-a955-1893d5090cde None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:32.920502 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4d432-5d5b-43f4-a455-6546b67701a6 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:32.949981 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:32.959204 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74573243-5247-44a5-9f86-870fdbe20607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:32.959868 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74573243-5247-44a5-9f86-870fdbe20607 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:32.960148 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74573243-5247-44a5-9f86-870fdbe20607 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:32.960449 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74573243-5247-44a5-9f86-870fdbe20607 None admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:32.961280 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74573243-5247-44a5-9f86-870fdbe20607 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:32.968326 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74573243-5247-44a5-9f86-870fdbe20607 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:32.968326 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74573243-5247-44a5-9f86-870fdbe20607 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:32.971567 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8192f74c-3b45-4a66-a955-1893d5090cde None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:32.981573 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 338/664] 10.222.0.62 () {56 vars in 1139 bytes} [Mon Jun 27 09:15:32 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:32.982398 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74573243-5247-44a5-9f86-870fdbe20607 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:33.012102 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c59a1f-1142-476e-9348-63f409973155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:33.012792 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c59a1f-1142-476e-9348-63f409973155 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:33.013074 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c59a1f-1142-476e-9348-63f409973155 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:33.013345 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c59a1f-1142-476e-9348-63f409973155 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:33.014105 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c59a1f-1142-476e-9348-63f409973155 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:33.014359 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c59a1f-1142-476e-9348-63f409973155 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:33.015736 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c59a1f-1142-476e-9348-63f409973155 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:33.027618 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 327/665] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:33.029103 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c59a1f-1142-476e-9348-63f409973155 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:33.104121 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:33.107495 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74573243-5247-44a5-9f86-870fdbe20607 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:33.147926 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c59a1f-1142-476e-9348-63f409973155 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:33.149503 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180157f7-17f2-408b-b921-d34d565e5748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:33.150400 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180157f7-17f2-408b-b921-d34d565e5748 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:33.151467 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180157f7-17f2-408b-b921-d34d565e5748 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:33.152003 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180157f7-17f2-408b-b921-d34d565e5748 None admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:33.152763 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180157f7-17f2-408b-b921-d34d565e5748 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:33.153073 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180157f7-17f2-408b-b921-d34d565e5748 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:33.154441 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180157f7-17f2-408b-b921-d34d565e5748 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:33.167777 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 339/666] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:33.168647 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180157f7-17f2-408b-b921-d34d565e5748 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:33.192510 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c78f1-10eb-4d59-b3d0-e6dd459db20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:33.193527 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c78f1-10eb-4d59-b3d0-e6dd459db20a None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:33.194040 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c78f1-10eb-4d59-b3d0-e6dd459db20a None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:33.194547 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c78f1-10eb-4d59-b3d0-e6dd459db20a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:33.207319 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c78f1-10eb-4d59-b3d0-e6dd459db20a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:15:33.215960 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-bc7c78f1-10eb-4d59-b3d0-e6dd459db20a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 09:15:33.215960 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:33.215960 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:33.215960 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:33.215960 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:33.215960 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:33.215960 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:33.215960 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:33.215960 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:33.215960 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:33.215960 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:33.215960 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:33.215960 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:15:33.215960 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:15:33.215960 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:15:33.215960 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:15:33.217183 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:15:33.217183 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:15:33.217183 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:15:33.217183 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:15:33.217183 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:33.217183 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:33.217183 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:33.217183 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:33.217183 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:33.217183 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:33.217183 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:33.217183 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:33.217183 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:33.217183 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:33.217183 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:33.217183 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:33.218013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:33.218013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:33.218013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:33.218013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:33.218013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:15:33.218013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:15:33.218013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:15:33.218013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:15:33.218013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:15:33.218013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:15:33.218013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 09:15:33.218013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:33.218013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 328/667] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Jun 27 09:15:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:33.218013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c78f1-10eb-4d59-b3d0-e6dd459db20a None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:33.226467 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:33.294383 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180157f7-17f2-408b-b921-d34d565e5748 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:33.329781 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c90e7-125b-480f-bfe9-27e12506ef3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:33.330537 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c90e7-125b-480f-bfe9-27e12506ef3c None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:33.330844 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c90e7-125b-480f-bfe9-27e12506ef3c None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:33.331091 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c90e7-125b-480f-bfe9-27e12506ef3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:33.332307 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c78f1-10eb-4d59-b3d0-e6dd459db20a None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:33.355301 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:33.369312 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe22b5-f4f5-4ee3-9545-14746fda8e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:33.370109 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe22b5-f4f5-4ee3-9545-14746fda8e5a None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:33.370415 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe22b5-f4f5-4ee3-9545-14746fda8e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:33.370684 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe22b5-f4f5-4ee3-9545-14746fda8e5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:33.377468 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfe22b5-f4f5-4ee3-9545-14746fda8e5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:33.378935 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfe22b5-f4f5-4ee3-9545-14746fda8e5a None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:33.394689 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-3bfe22b5-f4f5-4ee3-9545-14746fda8e5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:15:33.394689 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:33.394689 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:33.394689 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:33.394689 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:33.394689 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:33.394689 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:33.394689 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:33.394689 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:33.394689 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:33.394689 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:33.394689 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:33.394689 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 09:15:33.394689 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 09:15:33.394689 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 09:15:33.396246 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 09:15:33.396246 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:33.396246 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:33.396246 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:33.396246 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:33.396246 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:33.396246 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:33.396246 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:33.396246 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:33.396246 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:33.396246 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:33.396246 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:33.396246 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:33.396246 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:33.396246 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:33.396246 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:33.396246 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:33.397171 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 09:15:33.397171 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 09:15:33.397171 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 09:15:33.397171 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 09:15:33.397171 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 09:15:33.397171 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 09:15:33.397171 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:15:33.397171 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:33.399721 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 329/668] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:15:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:33.400584 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe22b5-f4f5-4ee3-9545-14746fda8e5a None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:33.411348 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951c90e7-125b-480f-bfe9-27e12506ef3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:33.413404 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951c90e7-125b-480f-bfe9-27e12506ef3c None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:33.464010 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:33.510261 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe22b5-f4f5-4ee3-9545-14746fda8e5a None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:33.530104 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 340/669] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:15:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 09:15:33.531124 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c90e7-125b-480f-bfe9-27e12506ef3c None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:33.558741 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e8aa5-f701-423a-883a-f40d69e52862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:33.559774 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e8aa5-f701-423a-883a-f40d69e52862 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:33.559962 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e8aa5-f701-423a-883a-f40d69e52862 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:33.560328 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e8aa5-f701-423a-883a-f40d69e52862 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:33.568836 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e8aa5-f701-423a-883a-f40d69e52862 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:33.570275 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e8aa5-f701-423a-883a-f40d69e52862 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:33.584578 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-e20e8aa5-f701-423a-883a-f40d69e52862 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:15:33.584578 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:33.584578 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:33.584578 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:33.584578 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:33.584578 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:33.584578 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:33.584578 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:33.584578 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:33.584578 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:33.584578 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:33.584578 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:33.584578 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 09:15:33.584578 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 09:15:33.584578 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 09:15:33.585496 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 09:15:33.585496 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:33.585496 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:33.585496 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:33.585496 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:33.585496 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:33.585496 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:33.585496 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:33.585496 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:33.585496 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:33.585496 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:33.585496 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:33.585496 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:33.585496 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:33.585496 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:33.585496 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:33.585496 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:33.586388 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 09:15:33.586388 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 09:15:33.586388 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 09:15:33.586388 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 09:15:33.586388 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 09:15:33.586388 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 09:15:33.586388 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:15:33.586388 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:33.586388 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 330/670] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:15:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:33.586901 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e8aa5-f701-423a-883a-f40d69e52862 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:33.630421 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:33.653343 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c90e7-125b-480f-bfe9-27e12506ef3c None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:33.694644 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce00bb-79cd-4b3b-90a6-2f42a51ef044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:33.695309 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce00bb-79cd-4b3b-90a6-2f42a51ef044 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:33.695419 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e8aa5-f701-423a-883a-f40d69e52862 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:33.695583 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce00bb-79cd-4b3b-90a6-2f42a51ef044 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:33.695858 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce00bb-79cd-4b3b-90a6-2f42a51ef044 None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:33.696646 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce00bb-79cd-4b3b-90a6-2f42a51ef044 None admin] RBAC: Adding query filter params (name=service) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:33.696955 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce00bb-79cd-4b3b-90a6-2f42a51ef044 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:33.698396 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce00bb-79cd-4b3b-90a6-2f42a51ef044 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:33.711901 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 341/671] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Jun 27 09:15:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:33.711901 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce00bb-79cd-4b3b-90a6-2f42a51ef044 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:33.719778 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:33.738478 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e3c251-70c7-44d6-aa27-1a11f740e74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:33.739679 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3c251-70c7-44d6-aa27-1a11f740e74e None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:33.739978 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3c251-70c7-44d6-aa27-1a11f740e74e None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:33.740271 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3c251-70c7-44d6-aa27-1a11f740e74e None admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:33.741056 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e3c251-70c7-44d6-aa27-1a11f740e74e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:33.741368 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e3c251-70c7-44d6-aa27-1a11f740e74e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:33.742800 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e3c251-70c7-44d6-aa27-1a11f740e74e None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:33.761281 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 331/672] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Jun 27 09:15:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:33.761281 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e3c251-70c7-44d6-aa27-1a11f740e74e None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:33.819644 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce00bb-79cd-4b3b-90a6-2f42a51ef044 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:33.859781 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6809b-8166-49c1-babd-68855748f28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:33.860597 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6809b-8166-49c1-babd-68855748f28d None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:33.860881 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6809b-8166-49c1-babd-68855748f28d None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:33.861152 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6809b-8166-49c1-babd-68855748f28d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:33.865908 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:33.869335 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e3c251-70c7-44d6-aa27-1a11f740e74e None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:33.873227 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de6809b-8166-49c1-babd-68855748f28d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:33.874805 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de6809b-8166-49c1-babd-68855748f28d None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:33.892900 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-2de6809b-8166-49c1-babd-68855748f28d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:33.892900 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:33.892900 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:33.892900 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:33.892900 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:33.892900 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:33.892900 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:33.892900 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:33.892900 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:33.892900 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:33.892900 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:33.892900 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:33.892900 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:33.892900 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:33.892900 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:33.893851 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:33.893851 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:33.893851 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:33.893851 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:33.893851 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:33.893851 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:33.893851 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:33.893851 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:33.893851 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:33.893851 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:33.893851 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:33.893851 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:33.893851 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:33.893851 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:33.893851 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:33.893851 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:33.893851 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:33.894785 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:33.894785 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:33.894785 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:33.894785 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:33.894785 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 342/673] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:33.895152 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6809b-8166-49c1-babd-68855748f28d None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:33.911683 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7763156-63d8-4196-885b-b8af0c8ceec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:33.912382 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7763156-63d8-4196-885b-b8af0c8ceec7 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:33.912668 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7763156-63d8-4196-885b-b8af0c8ceec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:33.912944 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7763156-63d8-4196-885b-b8af0c8ceec7 None admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:33.913731 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7763156-63d8-4196-885b-b8af0c8ceec7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:33.914040 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7763156-63d8-4196-885b-b8af0c8ceec7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:33.915476 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7763156-63d8-4196-885b-b8af0c8ceec7 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:33.933533 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 332/674] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Jun 27 09:15:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:33.933533 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7763156-63d8-4196-885b-b8af0c8ceec7 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:33.964111 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:34.007691 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6809b-8166-49c1-babd-68855748f28d None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:34.042037 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7763156-63d8-4196-885b-b8af0c8ceec7 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:34.043104 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5763c6d-fe4d-43ee-81df-0320a0f60a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:34.043898 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5763c6d-fe4d-43ee-81df-0320a0f60a36 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:34.044178 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5763c6d-fe4d-43ee-81df-0320a0f60a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:34.045031 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5763c6d-fe4d-43ee-81df-0320a0f60a36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:34.056325 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5763c6d-fe4d-43ee-81df-0320a0f60a36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:34.057819 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5763c6d-fe4d-43ee-81df-0320a0f60a36 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:34.075833 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-d5763c6d-fe4d-43ee-81df-0320a0f60a36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:34.075833 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:34.075833 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:34.075833 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:34.075833 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:34.075833 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:34.075833 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:34.075833 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:34.075833 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:34.075833 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:34.075833 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:34.075833 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:34.075833 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:34.075833 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:34.075833 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:34.076996 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:34.076996 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:34.076996 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:34.076996 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:34.076996 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:34.076996 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:34.076996 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:34.076996 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:34.076996 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:34.076996 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:34.076996 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:34.076996 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:34.076996 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:34.076996 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:34.076996 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:34.076996 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:34.076996 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:34.077925 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:34.077925 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:34.077925 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:34.077925 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:34.077925 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 343/675] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:34.078217 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5763c6d-fe4d-43ee-81df-0320a0f60a36 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:34.084498 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dcf991-53b1-483b-84af-39b54d82db36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:34.085159 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dcf991-53b1-483b-84af-39b54d82db36 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:34.085528 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dcf991-53b1-483b-84af-39b54d82db36 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:34.085804 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dcf991-53b1-483b-84af-39b54d82db36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:34.086647 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dcf991-53b1-483b-84af-39b54d82db36 None admin] RBAC: Adding query filter params (role.id=197a0da3099d45e4bcb9233039c21d8f, scope.project.id=4ba8e40538db4d89b93469b79322d20e, user.id=e6f97b803a28453c8b78fd8380ac64ad) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:34.086961 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dcf991-53b1-483b-84af-39b54d82db36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:34.088429 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dcf991-53b1-483b-84af-39b54d82db36 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:34.100496 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 333/676] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Jun 27 09:15:33 2022] GET /identity/v3/role_assignments?user.id=e6f97b803a28453c8b78fd8380ac64ad&scope.project.id=4ba8e40538db4d89b93469b79322d20e&role.id=197a0da3099d45e4bcb9233039c21d8f => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:34.100496 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dcf991-53b1-483b-84af-39b54d82db36 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:34.147591 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:34.218041 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5763c6d-fe4d-43ee-81df-0320a0f60a36 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:34.230076 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:34.241932 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dcf991-53b1-483b-84af-39b54d82db36 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:34.254939 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d90ce8d-065b-4c31-8439-808058e0e85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:34.255782 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90ce8d-065b-4c31-8439-808058e0e85c None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:34.256072 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90ce8d-065b-4c31-8439-808058e0e85c None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:34.256403 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90ce8d-065b-4c31-8439-808058e0e85c None admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:34.257153 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d90ce8d-065b-4c31-8439-808058e0e85c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:34.257478 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d90ce8d-065b-4c31-8439-808058e0e85c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:34.258917 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d90ce8d-065b-4c31-8439-808058e0e85c None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:34.272826 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 344/677] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:34.273250 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d90ce8d-065b-4c31-8439-808058e0e85c None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:34.290228 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5898e8eb-a566-4d41-9741-2a023469a006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:34.290997 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898e8eb-a566-4d41-9741-2a023469a006 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:34.291347 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898e8eb-a566-4d41-9741-2a023469a006 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:34.291632 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898e8eb-a566-4d41-9741-2a023469a006 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:34.292902 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5898e8eb-a566-4d41-9741-2a023469a006 None admin] RBAC: Adding query filter params (role.id=197a0da3099d45e4bcb9233039c21d8f, scope.project.id=4ba8e40538db4d89b93469b79322d20e, user.id=333bceb4a90749df97595b7f38bf7ea6) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:34.292902 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5898e8eb-a566-4d41-9741-2a023469a006 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:34.294283 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5898e8eb-a566-4d41-9741-2a023469a006 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:34.302195 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 334/678] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Jun 27 09:15:34 2022] GET /identity/v3/role_assignments?user.id=333bceb4a90749df97595b7f38bf7ea6&scope.project.id=4ba8e40538db4d89b93469b79322d20e&role.id=197a0da3099d45e4bcb9233039c21d8f => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:34.304449 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f96be-fdc1-4b7f-b94d-ece532e9ef2a None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:34.305055 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f96be-fdc1-4b7f-b94d-ece532e9ef2a None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:34.305836 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f96be-fdc1-4b7f-b94d-ece532e9ef2a None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:34.307889 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 335/679] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:15:34.309735 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f96be-fdc1-4b7f-b94d-ece532e9ef2a None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:34.405056 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d90ce8d-065b-4c31-8439-808058e0e85c None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:34.432627 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:34.446017 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb021261-bf39-4e38-bdaf-3f3ffc6660af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:34.446700 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb021261-bf39-4e38-bdaf-3f3ffc6660af None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:34.446983 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb021261-bf39-4e38-bdaf-3f3ffc6660af None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:34.447259 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb021261-bf39-4e38-bdaf-3f3ffc6660af None admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:34.447432 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f96be-fdc1-4b7f-b94d-ece532e9ef2a None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:34.448028 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb021261-bf39-4e38-bdaf-3f3ffc6660af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:34.448355 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb021261-bf39-4e38-bdaf-3f3ffc6660af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:34.449783 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb021261-bf39-4e38-bdaf-3f3ffc6660af None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:34.464609 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 345/680] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:34.465927 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf84137-5f8d-4296-bb42-c626715ebd3d None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:34.466213 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf84137-5f8d-4296-bb42-c626715ebd3d None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:34.466491 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf84137-5f8d-4296-bb42-c626715ebd3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:34.487051 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f6bc6-0bb5-4fc0-80e9-2e93dd0da1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:34.487846 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f6bc6-0bb5-4fc0-80e9-2e93dd0da1d5 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:34.488122 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f6bc6-0bb5-4fc0-80e9-2e93dd0da1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:34.488427 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f6bc6-0bb5-4fc0-80e9-2e93dd0da1d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:34.493097 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-8bf84137-5f8d-4296-bb42-c626715ebd3d None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:34.494286 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-8bf84137-5f8d-4296-bb42-c626715ebd3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:34.509556 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f6bc6-0bb5-4fc0-80e9-2e93dd0da1d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:34.510940 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f6bc6-0bb5-4fc0-80e9-2e93dd0da1d5 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:34.523493 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:34.527759 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-e28f6bc6-0bb5-4fc0-80e9-2e93dd0da1d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:15:34.527759 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:34.527759 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:34.527759 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:34.527759 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:34.527759 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:34.527759 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:34.527759 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:34.527759 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:34.527759 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:34.527759 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:34.527759 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:34.527759 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 09:15:34.527759 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 09:15:34.527759 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 09:15:34.528704 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 09:15:34.528704 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:34.528704 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:34.528704 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:34.528704 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:34.528704 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:34.528704 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:34.528704 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:34.528704 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:34.528704 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:34.528704 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:34.528704 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:34.528704 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:34.528704 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:34.528704 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:34.528704 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:34.528704 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:34.529608 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 09:15:34.529608 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 09:15:34.529608 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 09:15:34.529608 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 09:15:34.529608 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 09:15:34.529608 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 09:15:34.529608 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:15:34.529608 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:34.529608 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 336/681] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:15:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:34.530102 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f6bc6-0bb5-4fc0-80e9-2e93dd0da1d5 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:34.580081 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 346/682] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:15:34.581162 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf84137-5f8d-4296-bb42-c626715ebd3d None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:34.685259 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f6bc6-0bb5-4fc0-80e9-2e93dd0da1d5 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:34.695504 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf84137-5f8d-4296-bb42-c626715ebd3d None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:34.733634 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba78385-4f4b-4e3d-9fb9-c312ca568aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:34.734407 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba78385-4f4b-4e3d-9fb9-c312ca568aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:34.734753 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba78385-4f4b-4e3d-9fb9-c312ca568aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:34.734990 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecfb9a0-da38-4e51-b4d6-033d5e675638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:34.735107 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba78385-4f4b-4e3d-9fb9-c312ca568aa4 None admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:34.735942 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba78385-4f4b-4e3d-9fb9-c312ca568aa4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:34.736299 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecfb9a0-da38-4e51-b4d6-033d5e675638 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:34.736417 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba78385-4f4b-4e3d-9fb9-c312ca568aa4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:34.736862 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecfb9a0-da38-4e51-b4d6-033d5e675638 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:34.737310 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecfb9a0-da38-4e51-b4d6-033d5e675638 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:34.737999 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba78385-4f4b-4e3d-9fb9-c312ca568aa4 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:34.748327 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecfb9a0-da38-4e51-b4d6-033d5e675638 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:34.750933 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecfb9a0-da38-4e51-b4d6-033d5e675638 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:34.753178 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 347/683] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Jun 27 09:15:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:34.755117 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba78385-4f4b-4e3d-9fb9-c312ca568aa4 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:34.771301 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-7ecfb9a0-da38-4e51-b4d6-033d5e675638 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 27 09:15:34.771301 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:34.771301 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:34.771301 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:34.771301 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:34.771301 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:34.771301 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:34.771301 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:34.771301 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:34.771301 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:34.771301 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:34.771301 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:34.771301 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 09:15:34.771301 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 09:15:34.771301 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 09:15:34.771301 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 09:15:34.772480 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:34.772480 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:34.772480 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 09:15:34.772480 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:15:34.772480 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 09:15:34.772480 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:15:34.772480 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:34.772480 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:34.772480 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:34.772480 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:34.772480 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:34.772480 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:34.772480 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:34.772480 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:34.772480 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:34.772480 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:34.772480 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:34.772480 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:34.773640 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:34.773640 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:34.773640 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 09:15:34.773640 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 09:15:34.773640 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 09:15:34.773640 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 09:15:34.773640 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 09:15:34.773640 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 09:15:34.773640 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 27 09:15:34.773640 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:34.776391 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 337/684] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Jun 27 09:15:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:34.777911 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecfb9a0-da38-4e51-b4d6-033d5e675638 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:34.782455 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:34.791386 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:34.883813 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba78385-4f4b-4e3d-9fb9-c312ca568aa4 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:34.890746 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecfb9a0-da38-4e51-b4d6-033d5e675638 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:34.920395 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f553f2-6888-48f2-82f3-b9db617d84e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:34.921428 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f553f2-6888-48f2-82f3-b9db617d84e4 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:34.921836 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f553f2-6888-48f2-82f3-b9db617d84e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:34.922231 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f553f2-6888-48f2-82f3-b9db617d84e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:34.933393 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f553f2-6888-48f2-82f3-b9db617d84e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:15:34.937451 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440dda05-48fc-4b21-982f-1f7d6d051d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:34.938303 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440dda05-48fc-4b21-982f-1f7d6d051d8a None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:34.938732 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440dda05-48fc-4b21-982f-1f7d6d051d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:34.939152 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440dda05-48fc-4b21-982f-1f7d6d051d8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:34.940143 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440dda05-48fc-4b21-982f-1f7d6d051d8a None admin] RBAC: Adding query filter params (role.id=197a0da3099d45e4bcb9233039c21d8f, scope.project.id=4ba8e40538db4d89b93469b79322d20e, user.id=097b991d67164cda94cc5aa24397f414) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:34.940711 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440dda05-48fc-4b21-982f-1f7d6d051d8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:34.941606 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-f6f553f2-6888-48f2-82f3-b9db617d84e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:15:34.941606 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:34.941606 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:34.941606 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:34.941606 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:34.941606 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:34.941606 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:34.941606 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:34.941606 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:34.941606 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:34.941606 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:34.941606 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:34.941606 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:15:34.941606 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:15:34.941606 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:15:34.941606 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:15:34.943126 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:15:34.943126 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:15:34.943126 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:15:34.943126 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:15:34.943126 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:34.943126 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:34.943126 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:34.943126 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:34.943126 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:34.943126 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:34.943126 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:34.943126 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:34.943126 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:34.943126 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:34.943126 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:34.943126 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:34.943964 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:34.943964 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:34.943964 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:34.943964 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:34.943964 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:15:34.943964 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:15:34.943964 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:15:34.943964 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:15:34.943964 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:15:34.943964 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:15:34.943964 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:15:34.943964 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:34.945548 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440dda05-48fc-4b21-982f-1f7d6d051d8a None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:34.948412 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 348/685] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Jun 27 09:15:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:34.949834 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f553f2-6888-48f2-82f3-b9db617d84e4 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:34.953196 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 338/686] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Jun 27 09:15:34 2022] GET /identity/v3/role_assignments?user.id=097b991d67164cda94cc5aa24397f414&scope.project.id=4ba8e40538db4d89b93469b79322d20e&role.id=197a0da3099d45e4bcb9233039c21d8f => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:34.954225 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440dda05-48fc-4b21-982f-1f7d6d051d8a None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:35.105518 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:35.143547 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:35.165402 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f553f2-6888-48f2-82f3-b9db617d84e4 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:35.169439 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440dda05-48fc-4b21-982f-1f7d6d051d8a None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:35.212725 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c5e9b-765c-4cf8-b04a-f39a7f3f0db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:35.213480 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af94fced-47a3-4c02-b65a-df172053c7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:35.213632 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c5e9b-765c-4cf8-b04a-f39a7f3f0db6 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:35.213825 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c5e9b-765c-4cf8-b04a-f39a7f3f0db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:35.214149 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c5e9b-765c-4cf8-b04a-f39a7f3f0db6 None admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:35.214899 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94fced-47a3-4c02-b65a-df172053c7b0 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:35.215388 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94fced-47a3-4c02-b65a-df172053c7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:35.215911 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94fced-47a3-4c02-b65a-df172053c7b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:35.218000 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5c5e9b-765c-4cf8-b04a-f39a7f3f0db6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:35.218120 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5c5e9b-765c-4cf8-b04a-f39a7f3f0db6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:35.218938 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af94fced-47a3-4c02-b65a-df172053c7b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:35.219476 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af94fced-47a3-4c02-b65a-df172053c7b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:35.221111 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af94fced-47a3-4c02-b65a-df172053c7b0 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:35.222281 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5c5e9b-765c-4cf8-b04a-f39a7f3f0db6 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:35.241819 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 339/687] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:15:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:35.246024 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af94fced-47a3-4c02-b65a-df172053c7b0 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:35.255680 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 349/688] 10.222.0.62 () {56 vars in 1135 bytes} [Mon Jun 27 09:15:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:35.261193 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c5e9b-765c-4cf8-b04a-f39a7f3f0db6 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:35.373619 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af94fced-47a3-4c02-b65a-df172053c7b0 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:35.392025 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c5e9b-765c-4cf8-b04a-f39a7f3f0db6 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:35.415778 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55593fd-f236-4a46-84e9-cf1a93a030e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:35.416647 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55593fd-f236-4a46-84e9-cf1a93a030e4 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:35.416930 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55593fd-f236-4a46-84e9-cf1a93a030e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:35.417205 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55593fd-f236-4a46-84e9-cf1a93a030e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:35.424590 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:35.440977 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55593fd-f236-4a46-84e9-cf1a93a030e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:35.442474 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55593fd-f236-4a46-84e9-cf1a93a030e4 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:35.462335 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65798fdc-be1d-4399-b944-b5103a2cbb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:35.462994 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65798fdc-be1d-4399-b944-b5103a2cbb56 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:35.463275 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65798fdc-be1d-4399-b944-b5103a2cbb56 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:35.463547 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65798fdc-be1d-4399-b944-b5103a2cbb56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:35.472052 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-f55593fd-f236-4a46-84e9-cf1a93a030e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:35.472052 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:35.472052 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:35.472052 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:35.472052 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:35.472052 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:35.472052 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:35.472052 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:35.472052 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:35.472052 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:35.472052 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:35.472052 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:35.472052 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:35.472052 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:35.472052 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:35.473557 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:35.473557 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:35.473557 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:35.473557 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:35.473557 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:35.473557 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:35.473557 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:35.473557 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:35.473557 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:35.473557 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:35.473557 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:35.473557 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:35.473557 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:35.473557 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:35.473557 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:35.473557 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:35.473557 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:35.474697 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:35.474697 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:35.474697 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:35.474697 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:35.474697 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 340/689] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:35.482193 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55593fd-f236-4a46-84e9-cf1a93a030e4 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:35.492549 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:35.595215 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65798fdc-be1d-4399-b944-b5103a2cbb56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:35.597204 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65798fdc-be1d-4399-b944-b5103a2cbb56 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:35.617910 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55593fd-f236-4a46-84e9-cf1a93a030e4 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:35.653591 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182791db-6592-4bb5-bc79-c5acb98aeae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:35.654335 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182791db-6592-4bb5-bc79-c5acb98aeae3 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:35.654730 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182791db-6592-4bb5-bc79-c5acb98aeae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:35.655113 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182791db-6592-4bb5-bc79-c5acb98aeae3 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:35.655989 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182791db-6592-4bb5-bc79-c5acb98aeae3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:35.656475 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182791db-6592-4bb5-bc79-c5acb98aeae3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:35.658086 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182791db-6592-4bb5-bc79-c5acb98aeae3 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:35.676963 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 341/690] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:15:35.678340 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182791db-6592-4bb5-bc79-c5acb98aeae3 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:35.739590 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 350/691] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:15:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 27 09:15:35.748238 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65798fdc-be1d-4399-b944-b5103a2cbb56 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:35.766143 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:35.812409 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:35.866412 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182791db-6592-4bb5-bc79-c5acb98aeae3 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:35.933773 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65798fdc-be1d-4399-b944-b5103a2cbb56 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:35.935755 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3e495-dac9-48ef-bb53-6633d217fc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:35.936581 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3e495-dac9-48ef-bb53-6633d217fc2c None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:35.936857 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3e495-dac9-48ef-bb53-6633d217fc2c None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:35.937125 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3e495-dac9-48ef-bb53-6633d217fc2c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:35.951526 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3e495-dac9-48ef-bb53-6633d217fc2c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:35.953029 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3e495-dac9-48ef-bb53-6633d217fc2c None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:35.980688 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-15a3e495-dac9-48ef-bb53-6633d217fc2c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 27 09:15:35.980688 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:35.980688 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:35.980688 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:35.980688 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:35.980688 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:35.980688 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:35.980688 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:35.980688 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:35.980688 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:35.980688 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:35.980688 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:35.980688 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 09:15:35.980688 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 09:15:35.980688 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 09:15:35.980688 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 09:15:35.981705 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:35.981705 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:35.981705 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 09:15:35.981705 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:15:35.981705 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 09:15:35.981705 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:15:35.981705 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:35.981705 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:35.981705 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:35.981705 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:35.981705 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:35.981705 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:35.981705 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:35.981705 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:35.981705 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:35.981705 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:35.981705 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:35.981705 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:35.982737 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:35.982737 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:35.982737 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 09:15:35.982737 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 09:15:35.982737 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 09:15:35.982737 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 09:15:35.982737 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 09:15:35.982737 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 09:15:35.982737 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 27 09:15:35.982737 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:35.985009 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 342/692] 10.222.0.62 () {56 vars in 1093 bytes} [Mon Jun 27 09:15:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:35.990617 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3e495-dac9-48ef-bb53-6633d217fc2c None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:36.011234 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7a0d5-67bf-4ffb-a477-69cfb792f043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:36.012034 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7a0d5-67bf-4ffb-a477-69cfb792f043 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:36.012421 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7a0d5-67bf-4ffb-a477-69cfb792f043 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:36.012886 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7a0d5-67bf-4ffb-a477-69cfb792f043 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:36.035274 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d7a0d5-67bf-4ffb-a477-69cfb792f043 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:36.037405 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d7a0d5-67bf-4ffb-a477-69cfb792f043 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:36.071200 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-72d7a0d5-67bf-4ffb-a477-69cfb792f043 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:36.071200 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:36.071200 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:36.071200 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:36.071200 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:36.071200 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:36.071200 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:36.071200 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:36.071200 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:36.071200 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:36.071200 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:36.071200 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:36.071200 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:36.071200 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:36.071200 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:36.072165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:36.072165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:36.072165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:36.072165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:36.072165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:36.072165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:36.072165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:36.072165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:36.072165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:36.072165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:36.072165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:36.072165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:36.072165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:36.072165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:36.072165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:36.072165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:36.072165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:36.073301 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:36.073301 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:36.073301 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:36.073301 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:36.073301 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 351/693] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:36.079949 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7a0d5-67bf-4ffb-a477-69cfb792f043 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:36.217702 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3e495-dac9-48ef-bb53-6633d217fc2c None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:36.228543 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:36.244568 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:36.252776 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7a0d5-67bf-4ffb-a477-69cfb792f043 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:36.291450 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cefefe-b54a-4de3-8179-1a0d202c7a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:36.292129 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cefefe-b54a-4de3-8179-1a0d202c7a9a None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:36.292431 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cefefe-b54a-4de3-8179-1a0d202c7a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:36.292707 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cefefe-b54a-4de3-8179-1a0d202c7a9a None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:36.293556 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cefefe-b54a-4de3-8179-1a0d202c7a9a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:36.293872 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cefefe-b54a-4de3-8179-1a0d202c7a9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:36.295307 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cefefe-b54a-4de3-8179-1a0d202c7a9a None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:36.323364 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ef36f-ba67-429a-8716-7e592969b68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:36.324034 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ef36f-ba67-429a-8716-7e592969b68e None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:36.324344 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ef36f-ba67-429a-8716-7e592969b68e None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:36.324626 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ef36f-ba67-429a-8716-7e592969b68e None admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:36.325360 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ef36f-ba67-429a-8716-7e592969b68e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:36.325668 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ef36f-ba67-429a-8716-7e592969b68e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:36.327050 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ef36f-ba67-429a-8716-7e592969b68e None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:36.335111 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 343/694] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Jun 27 09:15:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:36.340266 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cefefe-b54a-4de3-8179-1a0d202c7a9a None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:36.344396 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 352/695] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:36.345585 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ef36f-ba67-429a-8716-7e592969b68e None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:36.452236 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ef36f-ba67-429a-8716-7e592969b68e None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:36.485754 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c1977-9eed-44d8-b81d-d9db5d514b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:36.486476 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c1977-9eed-44d8-b81d-d9db5d514b3f None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:36.486756 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c1977-9eed-44d8-b81d-d9db5d514b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:36.487026 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c1977-9eed-44d8-b81d-d9db5d514b3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:36.496122 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c1977-9eed-44d8-b81d-d9db5d514b3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:36.497819 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c1977-9eed-44d8-b81d-d9db5d514b3f None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:36.516724 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-194c1977-9eed-44d8-b81d-d9db5d514b3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:15:36.516724 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:36.516724 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:36.516724 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:36.516724 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:36.516724 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:36.516724 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:36.516724 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:36.516724 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:36.516724 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:36.516724 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:36.516724 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:36.516724 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 09:15:36.516724 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 09:15:36.516724 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 09:15:36.517751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 09:15:36.517751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:36.517751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:36.517751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:36.517751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:36.517751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:36.517751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:36.517751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:36.517751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:36.517751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:36.517751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:36.517751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:36.517751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:36.517751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:36.517751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:36.517751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:36.517751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:36.518652 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 09:15:36.518652 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 09:15:36.518652 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 09:15:36.518652 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 09:15:36.518652 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 09:15:36.518652 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 09:15:36.518652 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:15:36.518652 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:36.518652 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 353/696] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:15:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 09:15:36.520771 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d6699-e91e-4aca-975c-ea7984ff06ca None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:36.521061 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d6699-e91e-4aca-975c-ea7984ff06ca None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:36.521965 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d6699-e91e-4aca-975c-ea7984ff06ca None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:36.528686 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 354/697] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:36 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:15:36.530153 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d6699-e91e-4aca-975c-ea7984ff06ca None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:36.539675 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cefefe-b54a-4de3-8179-1a0d202c7a9a None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:36.552592 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:36.587240 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667962e8-3541-4f8b-8266-93a66d54e295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:36.588173 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667962e8-3541-4f8b-8266-93a66d54e295 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:36.588490 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667962e8-3541-4f8b-8266-93a66d54e295 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:36.588821 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667962e8-3541-4f8b-8266-93a66d54e295 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:36.632109 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:36.652241 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d6699-e91e-4aca-975c-ea7984ff06ca None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:36.674731 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667962e8-3541-4f8b-8266-93a66d54e295 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:36.676860 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667962e8-3541-4f8b-8266-93a66d54e295 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:36.689936 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf3f27-06b1-4a62-8340-b09a62db8de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:36.690727 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf3f27-06b1-4a62-8340-b09a62db8de3 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:36.691115 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf3f27-06b1-4a62-8340-b09a62db8de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:36.691391 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf3f27-06b1-4a62-8340-b09a62db8de3 None admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:36.692790 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf3f27-06b1-4a62-8340-b09a62db8de3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:36.693085 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf3f27-06b1-4a62-8340-b09a62db8de3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:36.694498 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf3f27-06b1-4a62-8340-b09a62db8de3 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:36.707248 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 355/698] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Jun 27 09:15:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:36.708483 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744dc988-fbeb-42cd-ae8d-225c4ed22e3d None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:36.708783 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744dc988-fbeb-42cd-ae8d-225c4ed22e3d None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:36.709030 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744dc988-fbeb-42cd-ae8d-225c4ed22e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:36.725650 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-744dc988-fbeb-42cd-ae8d-225c4ed22e3d None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:36.726998 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-744dc988-fbeb-42cd-ae8d-225c4ed22e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:36.787582 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 344/699] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:15:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 27 09:15:36.787582 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e38d8-a461-413e-b04b-bb302da85f7c None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:36.787582 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e38d8-a461-413e-b04b-bb302da85f7c None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:36.787582 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e38d8-a461-413e-b04b-bb302da85f7c None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:36.787582 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 345/700] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:15:36.787582 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e38d8-a461-413e-b04b-bb302da85f7c None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:36.799957 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:36.816245 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 356/701] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:15:36.816245 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744dc988-fbeb-42cd-ae8d-225c4ed22e3d None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:36.877667 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:36.917964 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e38d8-a461-413e-b04b-bb302da85f7c None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:36.923288 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744dc988-fbeb-42cd-ae8d-225c4ed22e3d None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:36.956468 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a9727-362e-415e-8988-903d0b271e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:36.957126 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a9727-362e-415e-8988-903d0b271e98 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:36.957958 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a9727-362e-415e-8988-903d0b271e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:36.958243 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a9727-362e-415e-8988-903d0b271e98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:36.959094 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315a9727-362e-415e-8988-903d0b271e98 None admin] RBAC: Adding query filter params (role.id=197a0da3099d45e4bcb9233039c21d8f, scope.project.id=4ba8e40538db4d89b93469b79322d20e, user.id=f5477b14dae24fd3a644c9cbd6ff85ec) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:36.959393 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315a9727-362e-415e-8988-903d0b271e98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:36.960870 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315a9727-362e-415e-8988-903d0b271e98 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:36.961714 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f5eb5-303c-4f33-94df-35b05bd778e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:36.962751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f5eb5-303c-4f33-94df-35b05bd778e5 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:36.963248 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f5eb5-303c-4f33-94df-35b05bd778e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:36.963762 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f5eb5-303c-4f33-94df-35b05bd778e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:36.967007 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 346/702] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Jun 27 09:15:36 2022] GET /identity/v3/role_assignments?user.id=f5477b14dae24fd3a644c9cbd6ff85ec&scope.project.id=4ba8e40538db4d89b93469b79322d20e&role.id=197a0da3099d45e4bcb9233039c21d8f => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:36.968436 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40230b8e-6548-4020-9179-107e645657eb None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:36.968889 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40230b8e-6548-4020-9179-107e645657eb None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:36.969311 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40230b8e-6548-4020-9179-107e645657eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:36.979601 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447f5eb5-303c-4f33-94df-35b05bd778e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:36.981277 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447f5eb5-303c-4f33-94df-35b05bd778e5 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:36.995946 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-40230b8e-6548-4020-9179-107e645657eb None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:36.997507 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-40230b8e-6548-4020-9179-107e645657eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:37.001907 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-447f5eb5-303c-4f33-94df-35b05bd778e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:37.001907 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:37.001907 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:37.001907 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:37.001907 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:37.001907 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:37.001907 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:37.001907 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:37.001907 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:37.001907 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:37.001907 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:37.001907 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:37.001907 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:37.001907 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:37.001907 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:37.003070 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:37.003070 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:37.003070 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:37.003070 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:37.003070 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:37.003070 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:37.003070 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:37.003070 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:37.003070 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:37.003070 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:37.003070 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:37.003070 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:37.003070 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:37.003070 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:37.003070 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:37.003070 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:37.003070 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:37.004859 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:37.004859 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:37.004859 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:37.004859 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:37.010478 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 357/703] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:37.011550 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f5eb5-303c-4f33-94df-35b05bd778e5 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:37.075053 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:37.128241 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 347/704] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:15:37.128241 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40230b8e-6548-4020-9179-107e645657eb None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:37.158924 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f5eb5-303c-4f33-94df-35b05bd778e5 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:37.200637 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d45a8-208e-4642-b266-216041fc9df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:37.200880 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:37.201824 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d45a8-208e-4642-b266-216041fc9df8 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:37.202106 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d45a8-208e-4642-b266-216041fc9df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:37.202382 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d45a8-208e-4642-b266-216041fc9df8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:37.215688 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d45a8-208e-4642-b266-216041fc9df8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:37.217596 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d45a8-208e-4642-b266-216041fc9df8 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:37.239675 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-370d45a8-208e-4642-b266-216041fc9df8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:37.239675 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:37.239675 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:37.239675 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:37.239675 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:37.239675 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:37.239675 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:37.239675 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:37.239675 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:37.239675 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:37.239675 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:37.239675 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:37.239675 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:37.239675 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:37.239675 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:37.240941 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:37.240941 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:37.240941 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:37.240941 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:37.240941 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:37.240941 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:37.240941 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:37.240941 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:37.240941 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:37.240941 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:37.240941 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:37.240941 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:37.240941 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:37.240941 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:37.240941 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:37.240941 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:37.240941 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:37.241844 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:37.241844 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:37.241844 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:37.241844 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:37.243732 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 358/705] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:37.244843 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d45a8-208e-4642-b266-216041fc9df8 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:37.265607 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40230b8e-6548-4020-9179-107e645657eb None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:37.320314 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14abb4-857d-44ab-b226-343b81d4b4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:37.320984 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14abb4-857d-44ab-b226-343b81d4b4c9 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:37.321286 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14abb4-857d-44ab-b226-343b81d4b4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:37.321689 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14abb4-857d-44ab-b226-343b81d4b4c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:37.322743 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e14abb4-857d-44ab-b226-343b81d4b4c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:37.323058 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e14abb4-857d-44ab-b226-343b81d4b4c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:37.324735 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e14abb4-857d-44ab-b226-343b81d4b4c9 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:37.340175 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 348/706] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:37.341076 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14abb4-857d-44ab-b226-343b81d4b4c9 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:37.366337 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d45a8-208e-4642-b266-216041fc9df8 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:37.369209 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:37.403592 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf5a84-7b54-4e30-aef4-9a2a795e47fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:37.404737 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf5a84-7b54-4e30-aef4-9a2a795e47fc None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:37.405334 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf5a84-7b54-4e30-aef4-9a2a795e47fc None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:37.405818 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf5a84-7b54-4e30-aef4-9a2a795e47fc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:37.406661 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf5a84-7b54-4e30-aef4-9a2a795e47fc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:37.408331 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf5a84-7b54-4e30-aef4-9a2a795e47fc None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:37.424737 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-7bbf5a84-7b54-4e30-aef4-9a2a795e47fc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 27 09:15:37.424737 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:37.424737 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 09:15:37.424737 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 09:15:37.424737 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 09:15:37.424737 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 09:15:37.424737 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 09:15:37.424737 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 09:15:37.424737 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 27 09:15:37.424737 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:37.424737 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 09:15:37.424737 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:37.424737 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:37.424737 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:37.424737 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:37.424737 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:37.426526 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:37.426526 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:37.426526 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:37.426526 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:37.426526 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:37.426526 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:37.426526 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:37.426526 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 09:15:37.426526 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 09:15:37.426526 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 09:15:37.426526 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 09:15:37.426526 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:37.426526 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:37.426526 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:37.426526 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:37.426526 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:37.427606 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:37.427606 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:37.427606 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:37.427606 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:37.427606 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:37.427606 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:37.427606 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:37.427606 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:37.427606 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:37.427606 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:37.427606 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:37.427606 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 09:15:37.427606 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 09:15:37.427606 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 27 09:15:37.427606 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:37.429281 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 359/707] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Jun 27 09:15:37 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:37.434991 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf5a84-7b54-4e30-aef4-9a2a795e47fc None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:37.469304 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14abb4-857d-44ab-b226-343b81d4b4c9 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:37.489093 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:37.511085 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369fdfd-3fe2-4a45-868d-4eb0f2b8b89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:37.511800 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369fdfd-3fe2-4a45-868d-4eb0f2b8b89b None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:37.512086 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369fdfd-3fe2-4a45-868d-4eb0f2b8b89b None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:37.512398 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369fdfd-3fe2-4a45-868d-4eb0f2b8b89b None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:37.513139 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c369fdfd-3fe2-4a45-868d-4eb0f2b8b89b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:37.513432 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c369fdfd-3fe2-4a45-868d-4eb0f2b8b89b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:37.514802 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c369fdfd-3fe2-4a45-868d-4eb0f2b8b89b None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:37.530553 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 349/708] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:37.531610 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369fdfd-3fe2-4a45-868d-4eb0f2b8b89b None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:37.565950 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf5a84-7b54-4e30-aef4-9a2a795e47fc None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:37.606365 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad6147-c8c5-462f-abae-7e17c70a9617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:37.607081 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad6147-c8c5-462f-abae-7e17c70a9617 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:37.607355 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad6147-c8c5-462f-abae-7e17c70a9617 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:37.607624 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad6147-c8c5-462f-abae-7e17c70a9617 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:37.615170 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ad6147-c8c5-462f-abae-7e17c70a9617 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:37.616676 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ad6147-c8c5-462f-abae-7e17c70a9617 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:37.632003 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-63ad6147-c8c5-462f-abae-7e17c70a9617 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:15:37.632003 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:37.632003 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:37.632003 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:37.632003 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:37.632003 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:37.632003 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:37.632003 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:37.632003 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:37.632003 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:37.632003 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:37.632003 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:37.632003 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 09:15:37.632003 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 09:15:37.632003 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 09:15:37.633281 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 09:15:37.633281 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:37.633281 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:37.633281 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:37.633281 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:37.633281 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:37.633281 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:37.633281 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:37.633281 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:37.633281 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:37.633281 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:37.633281 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:37.633281 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:37.633281 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:37.633281 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:37.633281 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:37.633281 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:37.634182 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 09:15:37.634182 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 09:15:37.634182 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 09:15:37.634182 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 09:15:37.634182 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 09:15:37.634182 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 09:15:37.634182 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:15:37.634182 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:37.634182 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 360/709] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:15:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:37.634657 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ba675-28f3-40a4-bebf-92d11b51aa14 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:37.635226 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ba675-28f3-40a4-bebf-92d11b51aa14 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:37.635226 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ba675-28f3-40a4-bebf-92d11b51aa14 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:37.636444 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 361/710] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:15:37.636963 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ba675-28f3-40a4-bebf-92d11b51aa14 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:37.648180 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369fdfd-3fe2-4a45-868d-4eb0f2b8b89b None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:37.669442 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:37.686830 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b1dc41-2fc2-41fe-9251-7da06bd6fcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:37.687614 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1dc41-2fc2-41fe-9251-7da06bd6fcd5 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:37.688070 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1dc41-2fc2-41fe-9251-7da06bd6fcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:37.688402 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1dc41-2fc2-41fe-9251-7da06bd6fcd5 None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:37.689110 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b1dc41-2fc2-41fe-9251-7da06bd6fcd5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:37.689423 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b1dc41-2fc2-41fe-9251-7da06bd6fcd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:37.690797 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b1dc41-2fc2-41fe-9251-7da06bd6fcd5 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:37.695322 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 350/711] 10.222.0.62 () {56 vars in 1124 bytes} [Mon Jun 27 09:15:37 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:37.696573 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5d98f-c37a-4a85-abcf-9679f86c518a None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:37.696862 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5d98f-c37a-4a85-abcf-9679f86c518a None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:37.697139 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5d98f-c37a-4a85-abcf-9679f86c518a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:37.714703 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-faf5d98f-c37a-4a85-abcf-9679f86c518a None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:37.715946 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-faf5d98f-c37a-4a85-abcf-9679f86c518a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:37.752858 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ba675-28f3-40a4-bebf-92d11b51aa14 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:37.754321 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:37.787256 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 351/712] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:15:37.788107 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf5d98f-c37a-4a85-abcf-9679f86c518a None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:37.801929 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5b270-dece-4516-9f19-74939eadf29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:37.803502 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5b270-dece-4516-9f19-74939eadf29c None admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:37.803990 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5b270-dece-4516-9f19-74939eadf29c None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:37.804681 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5b270-dece-4516-9f19-74939eadf29c None admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:37.806122 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5b270-dece-4516-9f19-74939eadf29c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:37.808319 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5b270-dece-4516-9f19-74939eadf29c None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:37.890701 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf5d98f-c37a-4a85-abcf-9679f86c518a None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:37.907724 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 362/713] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Jun 27 09:15:37 2022] POST /identity/v3/users => generated 254 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:15:37.910985 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5b270-dece-4516-9f19-74939eadf29c None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:37.943485 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa29b72-8c25-484f-b2f0-64d0054eaa1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:37.944542 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa29b72-8c25-484f-b2f0-64d0054eaa1c None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:37.945010 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa29b72-8c25-484f-b2f0-64d0054eaa1c None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:37.945627 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa29b72-8c25-484f-b2f0-64d0054eaa1c None admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:37.946622 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa29b72-8c25-484f-b2f0-64d0054eaa1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:37.947124 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa29b72-8c25-484f-b2f0-64d0054eaa1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:37.948847 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa29b72-8c25-484f-b2f0-64d0054eaa1c None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:37.963118 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 352/714] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Jun 27 09:15:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:37.964342 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa29b72-8c25-484f-b2f0-64d0054eaa1c None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:38.004594 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:38.039952 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:38.058841 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5b270-dece-4516-9f19-74939eadf29c None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:38.113194 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa29b72-8c25-484f-b2f0-64d0054eaa1c None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:38.119914 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5a113-1e73-4630-8997-e663b1beaedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:38.121817 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5a113-1e73-4630-8997-e663b1beaedd None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:38.121817 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5a113-1e73-4630-8997-e663b1beaedd None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:38.121817 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5a113-1e73-4630-8997-e663b1beaedd None admin] PATH_INFO: `/v3/services` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:38.122821 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5a113-1e73-4630-8997-e663b1beaedd None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:38.123882 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5a113-1e73-4630-8997-e663b1beaedd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:38.125343 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5a113-1e73-4630-8997-e663b1beaedd None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:38.140606 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 363/715] 10.222.0.62 () {56 vars in 1124 bytes} [Mon Jun 27 09:15:37 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:38.141707 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5a113-1e73-4630-8997-e663b1beaedd None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:38.159964 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846f21d-dd7f-4d86-b160-fee6489918b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:38.161428 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846f21d-dd7f-4d86-b160-fee6489918b3 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:38.161707 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846f21d-dd7f-4d86-b160-fee6489918b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:38.162046 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846f21d-dd7f-4d86-b160-fee6489918b3 None admin] PATH_INFO: `/v3/services/network` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:38.163167 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9846f21d-dd7f-4d86-b160-fee6489918b3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:38.164385 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9846f21d-dd7f-4d86-b160-fee6489918b3 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:38.180273 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-9846f21d-dd7f-4d86-b160-fee6489918b3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 27 09:15:38.180273 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:38.180273 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 09:15:38.180273 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 09:15:38.180273 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 09:15:38.180273 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 09:15:38.180273 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 09:15:38.180273 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 09:15:38.180273 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 27 09:15:38.180273 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:38.180273 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 09:15:38.180273 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:38.180273 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:38.180273 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:38.180273 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:38.180273 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:38.180273 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:38.181379 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:38.181379 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:38.181379 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:38.181379 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:38.181379 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:38.181379 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:38.181379 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 09:15:38.181379 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 09:15:38.181379 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 09:15:38.181379 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 09:15:38.181379 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:38.181379 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:38.181379 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:38.181379 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:38.181379 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:38.181379 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:38.182250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:38.182250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:38.182250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:38.182250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:38.182250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:38.182250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:38.182250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:38.182250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:38.182250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:38.182250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:38.182250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 09:15:38.182250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 09:15:38.182250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 27 09:15:38.182250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:38.182250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 353/716] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:15:37 2022] GET /identity/v3/services/network => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:38.187880 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846f21d-dd7f-4d86-b160-fee6489918b3 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:38.296818 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5a113-1e73-4630-8997-e663b1beaedd None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:38.313489 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:38.319989 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846f21d-dd7f-4d86-b160-fee6489918b3 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:38.355085 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f6b9e-2e59-41f2-8aed-245592dee617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:38.356143 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f6b9e-2e59-41f2-8aed-245592dee617 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:38.357776 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f6b9e-2e59-41f2-8aed-245592dee617 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:38.359029 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f6b9e-2e59-41f2-8aed-245592dee617 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:38.360098 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f6b9e-2e59-41f2-8aed-245592dee617 None admin] RBAC: Adding query filter params (role.id=91c77942515d45f1ad8189c9fddf4424, scope.project.id=4ba8e40538db4d89b93469b79322d20e, user.id=2c1434a85b30411c9c59cc50c3980cd8) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:38.360657 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f6b9e-2e59-41f2-8aed-245592dee617 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:38.363250 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f6b9e-2e59-41f2-8aed-245592dee617 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:38.369621 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 364/717] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Jun 27 09:15:38 2022] GET /identity/v3/role_assignments?user.id=2c1434a85b30411c9c59cc50c3980cd8&scope.project.id=4ba8e40538db4d89b93469b79322d20e&role.id=91c77942515d45f1ad8189c9fddf4424 => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:38.379435 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b8e26-2659-4c9e-9e5e-26e5f8109c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:38.380884 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b8e26-2659-4c9e-9e5e-26e5f8109c1b None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:38.381371 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b8e26-2659-4c9e-9e5e-26e5f8109c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:38.381823 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b8e26-2659-4c9e-9e5e-26e5f8109c1b None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:38.382743 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b8e26-2659-4c9e-9e5e-26e5f8109c1b None admin] RBAC: Adding query filter params (name=network) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:38.383235 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b8e26-2659-4c9e-9e5e-26e5f8109c1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:38.384899 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b8e26-2659-4c9e-9e5e-26e5f8109c1b None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:38.394070 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 354/718] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Jun 27 09:15:38 2022] GET /identity/v3/services?name=network => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:15:38.400075 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f6b9e-2e59-41f2-8aed-245592dee617 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:38.418791 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:38.527217 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f6b9e-2e59-41f2-8aed-245592dee617 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:38.574512 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f2eb3-97a4-49d8-b3f5-94f85393b70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:38.575184 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f2eb3-97a4-49d8-b3f5-94f85393b70e None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:38.575466 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f2eb3-97a4-49d8-b3f5-94f85393b70e None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:38.575741 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f2eb3-97a4-49d8-b3f5-94f85393b70e None admin] PATH_INFO: `/v3/services` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:38.576481 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f2eb3-97a4-49d8-b3f5-94f85393b70e None admin] RBAC: Adding query filter params (type=network) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:38.576788 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f2eb3-97a4-49d8-b3f5-94f85393b70e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:38.578175 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f2eb3-97a4-49d8-b3f5-94f85393b70e None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:38.583982 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 365/719] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Jun 27 09:15:38 2022] GET /identity/v3/services?type=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:39.295313 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60742128-eb13-467f-ad34-db2f64bd7b2c None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:39.295660 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60742128-eb13-467f-ad34-db2f64bd7b2c None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:39.295875 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60742128-eb13-467f-ad34-db2f64bd7b2c None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:39.297552 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 355/720] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:15:39.303032 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959f92d-2347-4607-9d52-6243c3928854 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:39.303475 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959f92d-2347-4607-9d52-6243c3928854 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:39.303640 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959f92d-2347-4607-9d52-6243c3928854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:39.466677 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-5959f92d-2347-4607-9d52-6243c3928854 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:39.467806 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-5959f92d-2347-4607-9d52-6243c3928854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:39.558658 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 366/721] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:15:39.600708 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60742128-eb13-467f-ad34-db2f64bd7b2c None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:39.741925 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60742128-eb13-467f-ad34-db2f64bd7b2c None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:39.791465 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9758db-219c-48c9-8d85-a8f0620926f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:39.792360 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9758db-219c-48c9-8d85-a8f0620926f0 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:39.792643 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9758db-219c-48c9-8d85-a8f0620926f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:39.792916 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9758db-219c-48c9-8d85-a8f0620926f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:39.809679 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9758db-219c-48c9-8d85-a8f0620926f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:15:39.817551 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-0d9758db-219c-48c9-8d85-a8f0620926f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:15:39.817551 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:39.817551 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:39.817551 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:39.817551 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:39.817551 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:39.817551 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:39.817551 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:39.817551 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:39.817551 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:39.817551 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:39.817551 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:39.817551 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:15:39.817551 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:15:39.817551 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:15:39.817551 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:15:39.819630 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:15:39.819630 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:15:39.819630 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:15:39.819630 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:15:39.819630 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:39.819630 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:39.819630 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:39.819630 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:39.819630 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:39.819630 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:39.819630 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:39.819630 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:39.819630 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:39.819630 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:39.819630 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:39.819630 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:39.821540 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:39.821540 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:39.821540 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:39.821540 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:39.821540 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:15:39.821540 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:15:39.821540 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:15:39.821540 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:15:39.821540 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:15:39.821540 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:15:39.821540 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:15:39.821540 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:39.821540 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 356/722] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Jun 27 09:15:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:39.827866 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959f92d-2347-4607-9d52-6243c3928854 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:39.850559 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:40.012744 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959f92d-2347-4607-9d52-6243c3928854 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:40.081562 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4274fe2f-c2ab-4cf6-afc0-77426b755075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:40.083337 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274fe2f-c2ab-4cf6-afc0-77426b755075 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:40.083818 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274fe2f-c2ab-4cf6-afc0-77426b755075 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:40.084327 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274fe2f-c2ab-4cf6-afc0-77426b755075 None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:40.085754 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4274fe2f-c2ab-4cf6-afc0-77426b755075 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:40.086285 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4274fe2f-c2ab-4cf6-afc0-77426b755075 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:40.088910 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4274fe2f-c2ab-4cf6-afc0-77426b755075 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:40.108943 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 367/723] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:15:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:15:40.117535 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9758db-219c-48c9-8d85-a8f0620926f0 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:40.195688 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:40.336327 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9758db-219c-48c9-8d85-a8f0620926f0 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:40.382710 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db933512-799b-46df-b800-458d9c37ee6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:40.383502 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db933512-799b-46df-b800-458d9c37ee6d None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:40.383786 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db933512-799b-46df-b800-458d9c37ee6d None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:40.384061 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db933512-799b-46df-b800-458d9c37ee6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:40.399971 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db933512-799b-46df-b800-458d9c37ee6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:40.401722 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db933512-799b-46df-b800-458d9c37ee6d None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:40.423591 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-db933512-799b-46df-b800-458d9c37ee6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:40.423591 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:40.423591 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:40.423591 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:40.423591 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:40.423591 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:40.423591 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:40.423591 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:40.423591 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:40.423591 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:40.423591 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:40.423591 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:40.423591 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:40.423591 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:40.423591 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:40.425735 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:40.425735 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:40.425735 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:40.425735 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:40.425735 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:40.425735 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:40.425735 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:40.425735 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:40.425735 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:40.425735 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:40.425735 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:40.425735 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:40.425735 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:40.425735 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:40.425735 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:40.425735 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:40.425735 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:40.429384 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:40.429384 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:40.429384 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:40.429384 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:40.429384 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 357/724] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:40.437980 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4274fe2f-c2ab-4cf6-afc0-77426b755075 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:40.597774 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:40.642252 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4274fe2f-c2ab-4cf6-afc0-77426b755075 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:40.690239 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae6b367-aa56-4135-a034-617b872bb7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:40.690902 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6b367-aa56-4135-a034-617b872bb7da None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:40.691183 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6b367-aa56-4135-a034-617b872bb7da None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:40.691483 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6b367-aa56-4135-a034-617b872bb7da None admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:40.692231 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae6b367-aa56-4135-a034-617b872bb7da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:40.692544 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae6b367-aa56-4135-a034-617b872bb7da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:40.693914 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae6b367-aa56-4135-a034-617b872bb7da None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:40.713315 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 368/725] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:40.720756 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db933512-799b-46df-b800-458d9c37ee6d None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:40.833558 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:40.874954 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db933512-799b-46df-b800-458d9c37ee6d None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:40.909055 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921992c-75f1-428c-9fe0-e2c2a319b3d7 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:40.909499 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921992c-75f1-428c-9fe0-e2c2a319b3d7 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:40.909742 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921992c-75f1-428c-9fe0-e2c2a319b3d7 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:40.911762 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 369/726] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 09:15:40.916725 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aadbda-6898-4598-8978-e061ef356ae1 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:40.917195 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aadbda-6898-4598-8978-e061ef356ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:40.917473 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aadbda-6898-4598-8978-e061ef356ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:40.928709 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668672f0-e1df-48ef-8229-8e7853555376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:40.929506 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668672f0-e1df-48ef-8229-8e7853555376 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:40.929785 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668672f0-e1df-48ef-8229-8e7853555376 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:40.930058 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668672f0-e1df-48ef-8229-8e7853555376 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:40.947142 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668672f0-e1df-48ef-8229-8e7853555376 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:40.948636 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668672f0-e1df-48ef-8229-8e7853555376 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:40.950017 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-02aadbda-6898-4598-8978-e061ef356ae1 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:40.951224 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-02aadbda-6898-4598-8978-e061ef356ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:40.976773 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-668672f0-e1df-48ef-8229-8e7853555376 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 27 09:15:40.976773 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:40.976773 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:40.976773 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:40.976773 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:40.976773 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:40.976773 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:40.976773 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:40.976773 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:40.976773 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:40.976773 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:40.976773 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:40.976773 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 09:15:40.976773 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 09:15:40.976773 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 09:15:40.976773 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 09:15:40.977795 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:40.977795 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:40.977795 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 09:15:40.977795 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:15:40.977795 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 09:15:40.977795 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:15:40.977795 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:40.977795 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:40.977795 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:40.977795 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:40.977795 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:40.977795 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:40.977795 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:40.977795 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:40.977795 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:40.977795 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:40.977795 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:40.977795 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:40.978725 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:40.978725 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:40.978725 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 09:15:40.978725 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 09:15:40.978725 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 09:15:40.978725 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 09:15:40.978725 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 09:15:40.978725 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 09:15:40.978725 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 27 09:15:40.978725 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:40.979481 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 358/727] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Jun 27 09:15:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:40.992246 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668672f0-e1df-48ef-8229-8e7853555376 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:41.151826 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 370/728] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 09:15:41.194933 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aadbda-6898-4598-8978-e061ef356ae1 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:41.240187 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668672f0-e1df-48ef-8229-8e7853555376 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:41.275115 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:41.299525 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:41.313655 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf58d4-1928-44fc-9e2a-1bd1417b6ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:41.314411 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf58d4-1928-44fc-9e2a-1bd1417b6ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:41.314655 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf58d4-1928-44fc-9e2a-1bd1417b6ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:41.314891 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf58d4-1928-44fc-9e2a-1bd1417b6ea4 None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:41.315742 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbf58d4-1928-44fc-9e2a-1bd1417b6ea4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:41.316029 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbf58d4-1928-44fc-9e2a-1bd1417b6ea4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:41.317530 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbf58d4-1928-44fc-9e2a-1bd1417b6ea4 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:41.324729 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aadbda-6898-4598-8978-e061ef356ae1 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:41.338522 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 359/729] 10.222.0.62 () {56 vars in 1135 bytes} [Mon Jun 27 09:15:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:41.339894 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4708898-bf3f-4543-921d-2ec6b8b1e7e9 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:41.340191 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4708898-bf3f-4543-921d-2ec6b8b1e7e9 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:41.340502 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4708898-bf3f-4543-921d-2ec6b8b1e7e9 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:41.341723 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 360/730] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:15:41.342768 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b4c64-575e-4253-9c0c-e9cea2616d68 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:41.343210 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b4c64-575e-4253-9c0c-e9cea2616d68 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:41.343458 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b4c64-575e-4253-9c0c-e9cea2616d68 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:41.344689 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 361/731] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:15:41.345754 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2a232-7384-449a-a358-4d014de433ad None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:41.346686 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2a232-7384-449a-a358-4d014de433ad None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:41.347324 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2a232-7384-449a-a358-4d014de433ad None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:41.349781 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 362/732] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:15:41.350430 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2a232-7384-449a-a358-4d014de433ad None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:41.369664 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eaf8ca-2c9d-4fa7-a02a-1be9747b3f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:41.370455 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eaf8ca-2c9d-4fa7-a02a-1be9747b3f6f None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:41.370737 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eaf8ca-2c9d-4fa7-a02a-1be9747b3f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:41.371012 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eaf8ca-2c9d-4fa7-a02a-1be9747b3f6f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:41.381109 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eaf8ca-2c9d-4fa7-a02a-1be9747b3f6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:15:41.388702 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-c9eaf8ca-2c9d-4fa7-a02a-1be9747b3f6f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 09:15:41.388702 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:41.388702 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:41.388702 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:41.388702 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:41.388702 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:41.388702 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:41.388702 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:41.388702 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:41.388702 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:41.388702 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:41.388702 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:41.388702 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:15:41.388702 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:15:41.388702 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:15:41.388702 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:15:41.389913 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:15:41.389913 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:15:41.389913 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:15:41.389913 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:15:41.389913 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:41.389913 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:41.389913 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:41.389913 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:41.389913 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:41.389913 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:41.389913 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:41.389913 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:41.389913 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:41.389913 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:41.389913 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:41.389913 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:41.390753 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:41.390753 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:41.390753 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:41.390753 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:41.390753 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:15:41.390753 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:15:41.390753 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:15:41.390753 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:15:41.390753 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:15:41.390753 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:15:41.390753 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 09:15:41.390753 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:41.390753 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 371/733] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Jun 27 09:15:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 09:15:41.391432 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629bfb1-f7bc-45a0-9093-d4ae49a11fed None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:41.391432 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629bfb1-f7bc-45a0-9093-d4ae49a11fed None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:41.391646 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629bfb1-f7bc-45a0-9093-d4ae49a11fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:41.408554 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-c629bfb1-f7bc-45a0-9093-d4ae49a11fed None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:41.409674 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-c629bfb1-f7bc-45a0-9093-d4ae49a11fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:41.454429 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2a232-7384-449a-a358-4d014de433ad None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:41.475393 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 372/734] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:15:41.477344 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33369043-7917-40bd-b0c0-8a793927fbb1 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:41.477626 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33369043-7917-40bd-b0c0-8a793927fbb1 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:41.481305 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33369043-7917-40bd-b0c0-8a793927fbb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:41.494418 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-33369043-7917-40bd-b0c0-8a793927fbb1 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:41.495608 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-33369043-7917-40bd-b0c0-8a793927fbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:41.495714 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aeace6-57c2-4156-9e2c-94735d7d096c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:41.496418 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aeace6-57c2-4156-9e2c-94735d7d096c None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:41.496698 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aeace6-57c2-4156-9e2c-94735d7d096c None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:41.496973 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aeace6-57c2-4156-9e2c-94735d7d096c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:41.539436 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:41.554999 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:41.561704 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 373/735] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:15:41.563018 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073a516-bdaf-4800-af52-e1a5b1fdfc9d None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:41.563753 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073a516-bdaf-4800-af52-e1a5b1fdfc9d None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:41.563753 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073a516-bdaf-4800-af52-e1a5b1fdfc9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:41.565766 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aeace6-57c2-4156-9e2c-94735d7d096c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:41.567807 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aeace6-57c2-4156-9e2c-94735d7d096c None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:41.581247 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-f073a516-bdaf-4800-af52-e1a5b1fdfc9d None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:41.583026 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-f073a516-bdaf-4800-af52-e1a5b1fdfc9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:41.649193 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 374/736] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 09:15:41.650050 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f073a516-bdaf-4800-af52-e1a5b1fdfc9d None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:41.670344 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 363/737] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:15:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 09:15:41.671161 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aeace6-57c2-4156-9e2c-94735d7d096c None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:41.761471 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f073a516-bdaf-4800-af52-e1a5b1fdfc9d None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:41.771194 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:41.779731 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:41.788922 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aeace6-57c2-4156-9e2c-94735d7d096c None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:41.794792 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c56873-b664-430c-8d9e-e4df674d7195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:41.795452 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c56873-b664-430c-8d9e-e4df674d7195 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:41.795728 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c56873-b664-430c-8d9e-e4df674d7195 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:41.795997 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c56873-b664-430c-8d9e-e4df674d7195 None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:41.796752 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c56873-b664-430c-8d9e-e4df674d7195 None admin] RBAC: Adding query filter params (name=service) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:41.797053 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c56873-b664-430c-8d9e-e4df674d7195 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:41.798401 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c56873-b664-430c-8d9e-e4df674d7195 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:41.807293 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 375/738] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Jun 27 09:15:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:41.808079 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c56873-b664-430c-8d9e-e4df674d7195 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:41.823174 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6900e49-b952-41e5-b9d2-efdecb4f9e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:41.823838 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6900e49-b952-41e5-b9d2-efdecb4f9e27 None admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:41.824120 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6900e49-b952-41e5-b9d2-efdecb4f9e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:41.824430 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6900e49-b952-41e5-b9d2-efdecb4f9e27 None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:41.825152 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6900e49-b952-41e5-b9d2-efdecb4f9e27 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:41.826555 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6900e49-b952-41e5-b9d2-efdecb4f9e27 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:41.902258 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c56873-b664-430c-8d9e-e4df674d7195 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:41.933999 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 364/739] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Jun 27 09:15:41 2022] POST /identity/v3/services => generated 251 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:15:41.933999 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6900e49-b952-41e5-b9d2-efdecb4f9e27 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:41.950136 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825efa37-13d2-4699-9ee3-c11275ab1ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:41.951043 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825efa37-13d2-4699-9ee3-c11275ab1ff5 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:41.951534 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825efa37-13d2-4699-9ee3-c11275ab1ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:41.951743 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825efa37-13d2-4699-9ee3-c11275ab1ff5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:41.965053 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825efa37-13d2-4699-9ee3-c11275ab1ff5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:15:41.973375 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-825efa37-13d2-4699-9ee3-c11275ab1ff5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:15:41.973375 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:41.973375 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:41.973375 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:41.973375 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:41.973375 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:41.973375 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:41.973375 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:41.973375 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:41.973375 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:41.973375 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:41.973375 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:41.973375 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:15:41.973375 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:15:41.973375 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:15:41.973375 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:15:41.974390 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:15:41.974390 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:15:41.974390 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:15:41.974390 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:15:41.974390 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:41.974390 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:41.974390 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:41.974390 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:41.974390 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:41.974390 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:41.974390 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:41.974390 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:41.974390 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:41.974390 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:41.974390 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:41.974390 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:41.975244 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:41.975244 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:41.975244 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:41.975244 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:41.975244 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:15:41.975244 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:15:41.975244 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:15:41.975244 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:15:41.975244 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:15:41.975244 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:15:41.975244 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:15:41.975244 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:41.975244 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 376/740] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Jun 27 09:15:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:41.976460 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825efa37-13d2-4699-9ee3-c11275ab1ff5 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:42.008600 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:42.079999 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6900e49-b952-41e5-b9d2-efdecb4f9e27 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:42.104649 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825efa37-13d2-4699-9ee3-c11275ab1ff5 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:42.127673 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6701cce-2e4b-4e0b-ab2a-9f30211f682f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:42.128388 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6701cce-2e4b-4e0b-ab2a-9f30211f682f None admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:42.128670 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6701cce-2e4b-4e0b-ab2a-9f30211f682f None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:42.129631 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6701cce-2e4b-4e0b-ab2a-9f30211f682f None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:42.130363 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6701cce-2e4b-4e0b-ab2a-9f30211f682f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:42.131761 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6701cce-2e4b-4e0b-ab2a-9f30211f682f None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:42.145643 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf8bef7-88aa-464d-b75e-7330c35e5a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:42.146440 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8bef7-88aa-464d-b75e-7330c35e5a1d None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:42.146717 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8bef7-88aa-464d-b75e-7330c35e5a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:42.146992 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8bef7-88aa-464d-b75e-7330c35e5a1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:42.157647 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf8bef7-88aa-464d-b75e-7330c35e5a1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:42.159080 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf8bef7-88aa-464d-b75e-7330c35e5a1d None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:42.177676 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-ebf8bef7-88aa-464d-b75e-7330c35e5a1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:42.177676 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:42.177676 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:42.177676 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:42.177676 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:42.177676 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:42.177676 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:42.177676 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:42.177676 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:42.177676 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:42.177676 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:42.177676 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:42.177676 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:42.177676 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:42.177676 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:42.178641 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:42.178641 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:42.178641 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:42.178641 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:42.178641 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:42.178641 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:42.178641 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:42.178641 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:42.178641 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:42.178641 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:42.178641 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:42.178641 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:42.178641 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:42.178641 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:42.178641 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:42.178641 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:42.178641 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:42.179937 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:42.179937 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:42.179937 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:42.179937 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:42.179937 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 377/741] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:42.179937 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf8bef7-88aa-464d-b75e-7330c35e5a1d None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:42.199174 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 365/742] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Jun 27 09:15:41 2022] POST /identity/v3/services => generated 240 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:15:42.199926 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6701cce-2e4b-4e0b-ab2a-9f30211f682f None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:42.223534 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:42.289260 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:42.317246 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf8bef7-88aa-464d-b75e-7330c35e5a1d None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:42.357391 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6701cce-2e4b-4e0b-ab2a-9f30211f682f None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:42.359735 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34600f38-f00d-4e29-a276-bede81b9c3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:42.360976 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34600f38-f00d-4e29-a276-bede81b9c3ab None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:42.361096 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34600f38-f00d-4e29-a276-bede81b9c3ab None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:42.361286 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34600f38-f00d-4e29-a276-bede81b9c3ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:42.387948 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34600f38-f00d-4e29-a276-bede81b9c3ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:42.390067 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34600f38-f00d-4e29-a276-bede81b9c3ab None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:42.408447 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b6eef-a865-4365-972a-9dee71cf68f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:42.409366 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b6eef-a865-4365-972a-9dee71cf68f9 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:42.409816 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b6eef-a865-4365-972a-9dee71cf68f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:42.410775 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b6eef-a865-4365-972a-9dee71cf68f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:42.411685 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b6eef-a865-4365-972a-9dee71cf68f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:42.412137 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b6eef-a865-4365-972a-9dee71cf68f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:42.413329 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-34600f38-f00d-4e29-a276-bede81b9c3ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:42.413329 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:42.413329 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:42.413329 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:42.413329 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:42.413329 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:42.413329 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:42.413329 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:42.413329 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:42.413329 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:42.413329 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:42.413329 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:42.413329 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:42.413329 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:42.413329 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:42.414258 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:42.414258 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:42.414258 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:42.414258 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:42.414258 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:42.414258 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:42.414258 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:42.414258 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:42.414258 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:42.414258 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:42.414258 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:42.414258 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:42.414258 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:42.414258 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:42.414258 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:42.414258 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:42.414258 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:42.415376 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:42.415376 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:42.415376 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:42.415376 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:42.415376 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 378/743] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:42.415891 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34600f38-f00d-4e29-a276-bede81b9c3ab None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:42.416485 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b6eef-a865-4365-972a-9dee71cf68f9 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:42.429743 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 366/744] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:15:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:42.430966 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b6eef-a865-4365-972a-9dee71cf68f9 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:42.508254 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:42.546430 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b6eef-a865-4365-972a-9dee71cf68f9 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:42.559209 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34600f38-f00d-4e29-a276-bede81b9c3ab None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:42.590464 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ee3c7-d545-4745-911f-6d155e2f7ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:42.591702 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ee3c7-d545-4745-911f-6d155e2f7ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:42.592310 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ee3c7-d545-4745-911f-6d155e2f7ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:42.592765 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ee3c7-d545-4745-911f-6d155e2f7ba3 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:42.594243 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ee3c7-d545-4745-911f-6d155e2f7ba3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:42.594734 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ee3c7-d545-4745-911f-6d155e2f7ba3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:42.595597 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:42.596672 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ee3c7-d545-4745-911f-6d155e2f7ba3 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:42.603773 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399267ff-00e9-4272-b858-53fab13b86dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:42.604676 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399267ff-00e9-4272-b858-53fab13b86dd None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:42.605038 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399267ff-00e9-4272-b858-53fab13b86dd None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:42.605390 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399267ff-00e9-4272-b858-53fab13b86dd None admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:42.606191 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399267ff-00e9-4272-b858-53fab13b86dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:42.607231 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399267ff-00e9-4272-b858-53fab13b86dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:42.608838 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399267ff-00e9-4272-b858-53fab13b86dd None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:42.613881 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 367/745] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:42.614990 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ee3c7-d545-4745-911f-6d155e2f7ba3 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:42.630140 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 379/746] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:42.631121 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399267ff-00e9-4272-b858-53fab13b86dd None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:42.748494 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ee3c7-d545-4745-911f-6d155e2f7ba3 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:42.755708 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399267ff-00e9-4272-b858-53fab13b86dd None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:42.778317 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:42.787597 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58fc68-21db-4d89-8a31-de3b5c3837ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:42.788417 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58fc68-21db-4d89-8a31-de3b5c3837ae None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:42.795055 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58fc68-21db-4d89-8a31-de3b5c3837ae None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:42.795055 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58fc68-21db-4d89-8a31-de3b5c3837ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:42.795241 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d780c9d-950c-459a-a3dc-24e45154d4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:42.795241 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d780c9d-950c-459a-a3dc-24e45154d4b3 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:42.795241 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d780c9d-950c-459a-a3dc-24e45154d4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:42.795241 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d780c9d-950c-459a-a3dc-24e45154d4b3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:42.799329 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa58fc68-21db-4d89-8a31-de3b5c3837ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:42.800859 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa58fc68-21db-4d89-8a31-de3b5c3837ae None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:42.803267 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d780c9d-950c-459a-a3dc-24e45154d4b3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:42.804919 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d780c9d-950c-459a-a3dc-24e45154d4b3 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:42.819596 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-aa58fc68-21db-4d89-8a31-de3b5c3837ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:42.819596 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:42.819596 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:42.819596 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:42.819596 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:42.819596 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:42.819596 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:42.819596 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:42.819596 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:42.819596 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:42.819596 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:42.819596 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:42.819596 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:42.819596 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:42.819596 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:42.820681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:42.820681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:42.820681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:42.820681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:42.820681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:42.820681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:42.820681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:42.820681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:42.820681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:42.820681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:42.820681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:42.820681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:42.820681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:42.820681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:42.820681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:42.820681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:42.820681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:42.821911 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:42.821911 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:42.821911 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:42.821911 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:42.821911 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 368/747] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:42.822252 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58fc68-21db-4d89-8a31-de3b5c3837ae None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:42.822578 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-8d780c9d-950c-459a-a3dc-24e45154d4b3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 09:15:42.822578 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:42.822578 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:42.822578 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:42.822578 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:42.822578 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:42.822578 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:42.822578 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:42.822578 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:42.822578 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:42.822578 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:42.822578 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:42.822578 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 09:15:42.822578 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 09:15:42.822578 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 09:15:42.822578 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 09:15:42.823704 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:42.823704 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:42.823704 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 09:15:42.823704 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:15:42.823704 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 09:15:42.823704 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:15:42.823704 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:42.823704 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:42.823704 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:42.823704 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:42.823704 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:42.823704 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:42.823704 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:42.823704 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:42.823704 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:42.823704 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:42.823704 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:42.823704 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:42.824684 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:42.824684 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:42.824684 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 09:15:42.824684 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 09:15:42.824684 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 09:15:42.824684 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 09:15:42.824684 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 09:15:42.824684 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 09:15:42.824684 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 09:15:42.824684 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:42.826851 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 380/748] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Jun 27 09:15:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:42.827901 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d780c9d-950c-459a-a3dc-24e45154d4b3 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:42.883583 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:42.948549 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d780c9d-950c-459a-a3dc-24e45154d4b3 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:42.956922 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58fc68-21db-4d89-8a31-de3b5c3837ae None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:42.994412 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec14f24-580f-467e-abc0-9076c28ebf4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:42.995204 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7396443-abd9-4010-a800-dcefc838438c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:42.995334 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec14f24-580f-467e-abc0-9076c28ebf4e None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:42.995696 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec14f24-580f-467e-abc0-9076c28ebf4e None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:42.996065 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec14f24-580f-467e-abc0-9076c28ebf4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:42.996475 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7396443-abd9-4010-a800-dcefc838438c None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:42.997081 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7396443-abd9-4010-a800-dcefc838438c None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:42.997535 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7396443-abd9-4010-a800-dcefc838438c None admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:42.998574 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7396443-abd9-4010-a800-dcefc838438c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:42.999020 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7396443-abd9-4010-a800-dcefc838438c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:43.000906 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7396443-abd9-4010-a800-dcefc838438c None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:43.004498 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec14f24-580f-467e-abc0-9076c28ebf4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:43.006159 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec14f24-580f-467e-abc0-9076c28ebf4e None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:43.017293 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 381/749] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:43.018148 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7396443-abd9-4010-a800-dcefc838438c None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:43.026147 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-3ec14f24-580f-467e-abc0-9076c28ebf4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:15:43.026147 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:43.026147 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:43.026147 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:43.026147 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:43.026147 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:43.026147 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:43.026147 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:43.026147 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:43.026147 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:43.026147 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:43.026147 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:43.026147 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 09:15:43.026147 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 09:15:43.026147 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 09:15:43.027510 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 09:15:43.027510 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:43.027510 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:43.027510 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:43.027510 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:43.027510 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:43.027510 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:43.027510 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:43.027510 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:43.027510 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:43.027510 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:43.027510 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:43.027510 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:43.027510 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:43.027510 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:43.027510 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:43.027510 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:43.028715 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 09:15:43.028715 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 09:15:43.028715 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 09:15:43.028715 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 09:15:43.028715 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 09:15:43.028715 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 09:15:43.028715 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:15:43.028715 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:43.031343 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 369/750] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:15:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:43.032336 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec14f24-580f-467e-abc0-9076c28ebf4e None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:43.087885 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:43.147435 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7396443-abd9-4010-a800-dcefc838438c None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:43.157838 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec14f24-580f-467e-abc0-9076c28ebf4e None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:43.160406 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:43.189733 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e429b-bed7-4297-ae4b-7eb9cc7def08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:43.190361 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e429b-bed7-4297-ae4b-7eb9cc7def08 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:43.190804 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e429b-bed7-4297-ae4b-7eb9cc7def08 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:43.191143 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e429b-bed7-4297-ae4b-7eb9cc7def08 None admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:43.192586 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e429b-bed7-4297-ae4b-7eb9cc7def08 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:43.193115 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e429b-bed7-4297-ae4b-7eb9cc7def08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:43.194677 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e429b-bed7-4297-ae4b-7eb9cc7def08 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:43.199940 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b1603-a975-4397-9302-65ce388c18ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:43.200943 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b1603-a975-4397-9302-65ce388c18ea None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:43.201364 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b1603-a975-4397-9302-65ce388c18ea None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:43.201797 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b1603-a975-4397-9302-65ce388c18ea None admin] PATH_INFO: `/v3/users/nova` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:43.210623 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b1603-a975-4397-9302-65ce388c18ea None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:43.212405 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b1603-a975-4397-9302-65ce388c18ea None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:43.219812 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 382/751] 10.222.0.62 () {56 vars in 1149 bytes} [Mon Jun 27 09:15:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:43.220910 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e429b-bed7-4297-ae4b-7eb9cc7def08 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:43.227859 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-d59b1603-a975-4397-9302-65ce388c18ea None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 27 09:15:43.227859 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:43.227859 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:43.227859 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:43.227859 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:43.227859 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:43.227859 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:43.227859 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:43.227859 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:43.227859 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:43.227859 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:43.227859 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:43.227859 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 09:15:43.227859 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 09:15:43.227859 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 09:15:43.227859 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 09:15:43.229011 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:43.229011 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:43.229011 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 09:15:43.229011 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:15:43.229011 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 09:15:43.229011 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:15:43.229011 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:43.229011 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:43.229011 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:43.229011 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:43.229011 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:43.229011 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:43.229011 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:43.229011 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:43.229011 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:43.229011 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:43.229011 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:43.229011 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:43.230162 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:43.230162 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:43.230162 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 09:15:43.230162 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 09:15:43.230162 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 09:15:43.230162 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 09:15:43.230162 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 09:15:43.230162 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 09:15:43.230162 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 27 09:15:43.230162 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:43.232515 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 370/752] 10.222.0.62 () {56 vars in 1093 bytes} [Mon Jun 27 09:15:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:43.233537 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b1603-a975-4397-9302-65ce388c18ea None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:43.331269 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e429b-bed7-4297-ae4b-7eb9cc7def08 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:43.338422 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:43.341591 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b1603-a975-4397-9302-65ce388c18ea None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:43.370322 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5808f0-3f2c-4df9-9e83-b5d6463bbff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:43.371080 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5808f0-3f2c-4df9-9e83-b5d6463bbff6 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:43.371441 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5808f0-3f2c-4df9-9e83-b5d6463bbff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:43.371789 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5808f0-3f2c-4df9-9e83-b5d6463bbff6 None admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:43.372680 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5808f0-3f2c-4df9-9e83-b5d6463bbff6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:43.373153 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5808f0-3f2c-4df9-9e83-b5d6463bbff6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:43.374780 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5808f0-3f2c-4df9-9e83-b5d6463bbff6 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:43.379818 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25402c05-7cc7-48ed-99db-9a8b7bed224b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:43.380698 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25402c05-7cc7-48ed-99db-9a8b7bed224b None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:43.381119 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25402c05-7cc7-48ed-99db-9a8b7bed224b None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:43.381530 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25402c05-7cc7-48ed-99db-9a8b7bed224b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:43.393778 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 383/753] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Jun 27 09:15:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:43.393778 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5808f0-3f2c-4df9-9e83-b5d6463bbff6 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:43.424828 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:43.463665 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25402c05-7cc7-48ed-99db-9a8b7bed224b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:43.465433 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25402c05-7cc7-48ed-99db-9a8b7bed224b None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:43.505309 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5808f0-3f2c-4df9-9e83-b5d6463bbff6 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:43.543369 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a86840f-a075-414f-ad0e-ecee5388acfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:43.544298 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86840f-a075-414f-ad0e-ecee5388acfe None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:43.544656 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86840f-a075-414f-ad0e-ecee5388acfe None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:43.545004 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86840f-a075-414f-ad0e-ecee5388acfe None admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:43.546252 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a86840f-a075-414f-ad0e-ecee5388acfe None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:43.546536 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a86840f-a075-414f-ad0e-ecee5388acfe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:43.548037 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a86840f-a075-414f-ad0e-ecee5388acfe None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:43.602277 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 384/754] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Jun 27 09:15:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:43.603180 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a86840f-a075-414f-ad0e-ecee5388acfe None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:43.628695 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:43.639347 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 371/755] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:15:43 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 09:15:43.640892 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25402c05-7cc7-48ed-99db-9a8b7bed224b None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:43.721715 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:43.742326 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a86840f-a075-414f-ad0e-ecee5388acfe None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:43.785710 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25402c05-7cc7-48ed-99db-9a8b7bed224b None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:43.792007 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdcf47c-593a-401d-9593-3772a399ba19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:43.792966 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdcf47c-593a-401d-9593-3772a399ba19 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:43.793962 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdcf47c-593a-401d-9593-3772a399ba19 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:43.794472 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdcf47c-593a-401d-9593-3772a399ba19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:43.795962 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdcf47c-593a-401d-9593-3772a399ba19 None admin] RBAC: Adding query filter params (role.id=91c77942515d45f1ad8189c9fddf4424, scope.project.id=4ba8e40538db4d89b93469b79322d20e, user.id=f5477b14dae24fd3a644c9cbd6ff85ec) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:43.796524 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdcf47c-593a-401d-9593-3772a399ba19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:43.798868 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdcf47c-593a-401d-9593-3772a399ba19 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:43.808124 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 385/756] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Jun 27 09:15:43 2022] GET /identity/v3/role_assignments?user.id=f5477b14dae24fd3a644c9cbd6ff85ec&scope.project.id=4ba8e40538db4d89b93469b79322d20e&role.id=91c77942515d45f1ad8189c9fddf4424 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:43.809602 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdcf47c-593a-401d-9593-3772a399ba19 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:43.823533 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed67a8-a912-49a3-a7d4-7f866b2ccea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:43.824386 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed67a8-a912-49a3-a7d4-7f866b2ccea2 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:43.824670 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed67a8-a912-49a3-a7d4-7f866b2ccea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:43.824943 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed67a8-a912-49a3-a7d4-7f866b2ccea2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:43.837030 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed67a8-a912-49a3-a7d4-7f866b2ccea2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:43.838410 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed67a8-a912-49a3-a7d4-7f866b2ccea2 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:43.858713 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-d2ed67a8-a912-49a3-a7d4-7f866b2ccea2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:43.858713 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:43.858713 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:43.858713 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:43.858713 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:43.858713 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:43.858713 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:43.858713 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:43.858713 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:43.858713 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:43.858713 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:43.858713 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:43.858713 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:43.858713 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:43.858713 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:43.859749 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:43.859749 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:43.859749 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:43.859749 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:43.859749 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:43.859749 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:43.859749 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:43.859749 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:43.859749 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:43.859749 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:43.859749 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:43.859749 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:43.859749 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:43.859749 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:43.859749 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:43.859749 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:43.859749 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:43.860695 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:43.860695 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:43.860695 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:43.860695 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:43.860695 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 372/757] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:43.866238 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed67a8-a912-49a3-a7d4-7f866b2ccea2 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:43.924816 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:43.939169 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdcf47c-593a-401d-9593-3772a399ba19 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:43.978036 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed67a8-a912-49a3-a7d4-7f866b2ccea2 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:43.980514 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cdbd0b-a6ef-451e-8510-b5bd29b27898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:43.981716 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cdbd0b-a6ef-451e-8510-b5bd29b27898 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:43.982232 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cdbd0b-a6ef-451e-8510-b5bd29b27898 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:43.982702 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cdbd0b-a6ef-451e-8510-b5bd29b27898 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:43.995699 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cdbd0b-a6ef-451e-8510-b5bd29b27898 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:43.997784 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cdbd0b-a6ef-451e-8510-b5bd29b27898 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:44.015921 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ce476-f494-4e45-84b8-8f31722da2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:44.016625 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ce476-f494-4e45-84b8-8f31722da2a1 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:44.016912 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ce476-f494-4e45-84b8-8f31722da2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:44.017191 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ce476-f494-4e45-84b8-8f31722da2a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:44.017916 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ce476-f494-4e45-84b8-8f31722da2a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:44.018226 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ce476-f494-4e45-84b8-8f31722da2a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:44.018632 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-58cdbd0b-a6ef-451e-8510-b5bd29b27898 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:44.018632 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:44.018632 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:44.018632 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:44.018632 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:44.018632 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:44.018632 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:44.018632 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:44.018632 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:44.018632 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:44.018632 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:44.018632 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:44.018632 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:44.018632 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:44.018632 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:44.020023 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:44.020023 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:44.020023 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:44.020023 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:44.020023 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:44.020023 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:44.020023 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:44.020023 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:44.020023 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:44.020023 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:44.020023 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:44.020023 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:44.020023 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:44.020023 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:44.020023 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:44.020023 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:44.020023 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:44.020975 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:44.020975 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:44.020975 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:44.020975 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:44.021207 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ce476-f494-4e45-84b8-8f31722da2a1 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:44.023483 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 386/758] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:44.036283 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cdbd0b-a6ef-451e-8510-b5bd29b27898 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:44.037681 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:44.048443 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 373/759] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:44.055117 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ce476-f494-4e45-84b8-8f31722da2a1 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:44.194939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ce476-f494-4e45-84b8-8f31722da2a1 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:44.210684 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:44.244557 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25d0bd-d671-487b-a749-afa74840477a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:44.245768 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25d0bd-d671-487b-a749-afa74840477a None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:44.246373 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25d0bd-d671-487b-a749-afa74840477a None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:44.246849 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25d0bd-d671-487b-a749-afa74840477a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:44.254673 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d25d0bd-d671-487b-a749-afa74840477a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:44.256526 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d25d0bd-d671-487b-a749-afa74840477a None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:44.269258 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cdbd0b-a6ef-451e-8510-b5bd29b27898 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:44.272733 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-9d25d0bd-d671-487b-a749-afa74840477a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:15:44.272733 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:44.272733 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:44.272733 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:44.272733 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:44.272733 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:44.272733 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:44.272733 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:44.272733 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:44.272733 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:44.272733 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:44.272733 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:44.272733 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 09:15:44.272733 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 09:15:44.272733 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 09:15:44.273587 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 09:15:44.273587 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:44.273587 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:44.273587 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:44.273587 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:44.273587 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:44.273587 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:44.273587 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:44.273587 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:44.273587 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:44.273587 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:44.273587 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:44.273587 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:44.273587 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:44.273587 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:44.273587 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:44.273587 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:44.274490 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 09:15:44.274490 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 09:15:44.274490 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 09:15:44.274490 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 09:15:44.274490 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 09:15:44.274490 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 09:15:44.274490 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:15:44.274490 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:44.277284 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 374/760] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:15:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:44.278741 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a531135-2b8a-45de-a32b-127415b290d6 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:44.279229 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a531135-2b8a-45de-a32b-127415b290d6 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:44.279761 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a531135-2b8a-45de-a32b-127415b290d6 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:44.285926 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 375/761] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:15:44.287049 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a531135-2b8a-45de-a32b-127415b290d6 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:44.310762 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ecedd-42d2-448d-ad87-d91cb07841f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:44.311738 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ecedd-42d2-448d-ad87-d91cb07841f5 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:44.311738 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ecedd-42d2-448d-ad87-d91cb07841f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:44.312018 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ecedd-42d2-448d-ad87-d91cb07841f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:44.312864 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ecedd-42d2-448d-ad87-d91cb07841f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:44.313171 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ecedd-42d2-448d-ad87-d91cb07841f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:44.314547 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ecedd-42d2-448d-ad87-d91cb07841f5 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:44.328459 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 387/762] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:44.334274 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263ca5b-1fcd-4a7d-ab92-f1e329d2c4ff None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:44.334274 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263ca5b-1fcd-4a7d-ab92-f1e329d2c4ff None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:44.334623 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263ca5b-1fcd-4a7d-ab92-f1e329d2c4ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:44.353174 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-8263ca5b-1fcd-4a7d-ab92-f1e329d2c4ff None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:44.354672 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-8263ca5b-1fcd-4a7d-ab92-f1e329d2c4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:44.400640 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a531135-2b8a-45de-a32b-127415b290d6 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:44.423239 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:44.434800 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 388/763] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 09:15:44.443513 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8263ca5b-1fcd-4a7d-ab92-f1e329d2c4ff None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:44.443649 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95a412-32b0-4b5e-a6c9-b7f2bf5aa4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:44.443649 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95a412-32b0-4b5e-a6c9-b7f2bf5aa4aa None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:44.443649 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95a412-32b0-4b5e-a6c9-b7f2bf5aa4aa None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:44.443649 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95a412-32b0-4b5e-a6c9-b7f2bf5aa4aa None admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:44.443973 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95a412-32b0-4b5e-a6c9-b7f2bf5aa4aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:44.443973 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95a412-32b0-4b5e-a6c9-b7f2bf5aa4aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:44.443973 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95a412-32b0-4b5e-a6c9-b7f2bf5aa4aa None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:44.454244 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 376/764] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Jun 27 09:15:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:44.455711 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd936a-3085-4bb3-b5c2-7a3ba27d8fe0 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:44.455997 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd936a-3085-4bb3-b5c2-7a3ba27d8fe0 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:44.456302 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd936a-3085-4bb3-b5c2-7a3ba27d8fe0 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:44.458232 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 377/765] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:15:44.459953 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd936a-3085-4bb3-b5c2-7a3ba27d8fe0 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:44.495853 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:44.549896 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8263ca5b-1fcd-4a7d-ab92-f1e329d2c4ff None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:44.570341 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd936a-3085-4bb3-b5c2-7a3ba27d8fe0 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:44.585838 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543f8e8-5b9e-4b8d-8674-ad2a161f8e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:44.586738 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543f8e8-5b9e-4b8d-8674-ad2a161f8e03 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:44.587016 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543f8e8-5b9e-4b8d-8674-ad2a161f8e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:44.587288 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543f8e8-5b9e-4b8d-8674-ad2a161f8e03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:44.594533 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3543f8e8-5b9e-4b8d-8674-ad2a161f8e03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:44.596230 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3543f8e8-5b9e-4b8d-8674-ad2a161f8e03 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:44.606912 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1654927c-0414-47f2-ad77-1ea525415cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:44.607718 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654927c-0414-47f2-ad77-1ea525415cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:44.608005 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654927c-0414-47f2-ad77-1ea525415cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:44.608307 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654927c-0414-47f2-ad77-1ea525415cc1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:44.608952 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1654927c-0414-47f2-ad77-1ea525415cc1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:44.610374 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1654927c-0414-47f2-ad77-1ea525415cc1 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:44.610946 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-3543f8e8-5b9e-4b8d-8674-ad2a161f8e03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:15:44.610946 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:44.610946 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:44.610946 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:44.610946 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:44.610946 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:44.610946 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:44.610946 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:44.610946 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:44.610946 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:44.610946 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:44.610946 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:44.610946 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 09:15:44.610946 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 09:15:44.610946 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 09:15:44.612150 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 09:15:44.612150 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:44.612150 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:44.612150 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:44.612150 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:44.612150 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:44.612150 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:44.612150 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:44.612150 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:44.612150 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:44.612150 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:44.612150 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:44.612150 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:44.612150 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:44.612150 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:44.612150 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:44.612150 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:44.613085 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 09:15:44.613085 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 09:15:44.613085 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 09:15:44.613085 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 09:15:44.613085 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 09:15:44.613085 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 09:15:44.613085 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:15:44.613085 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:44.613085 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 389/766] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:15:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:44.613085 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543f8e8-5b9e-4b8d-8674-ad2a161f8e03 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:44.629886 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-1654927c-0414-47f2-ad77-1ea525415cc1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 27 09:15:44.629886 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:44.629886 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 09:15:44.629886 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 09:15:44.629886 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 09:15:44.629886 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 09:15:44.629886 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 09:15:44.629886 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 09:15:44.629886 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 27 09:15:44.629886 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:44.629886 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 09:15:44.629886 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:44.629886 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:44.629886 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:44.629886 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:44.629886 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:44.630944 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:44.630944 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:44.630944 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:44.630944 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:44.630944 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:44.630944 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:44.630944 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:44.630944 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 09:15:44.630944 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 09:15:44.630944 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 09:15:44.630944 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 09:15:44.630944 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:44.630944 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:44.630944 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:44.630944 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:44.630944 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:44.631764 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:44.631764 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:44.631764 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:44.631764 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:44.631764 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:44.631764 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:44.631764 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:44.631764 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:44.631764 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:44.631764 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:44.631764 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:44.631764 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 09:15:44.631764 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 09:15:44.631764 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 27 09:15:44.631764 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:44.636060 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 378/767] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Jun 27 09:15:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 09:15:44.637459 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402dbb1-a381-4383-ae23-7d1c0f2a5743 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:44.637745 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402dbb1-a381-4383-ae23-7d1c0f2a5743 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:44.638017 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402dbb1-a381-4383-ae23-7d1c0f2a5743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:44.655618 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-3402dbb1-a381-4383-ae23-7d1c0f2a5743 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:44.656763 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-3402dbb1-a381-4383-ae23-7d1c0f2a5743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:44.673633 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:44.727916 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 379/768] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 09:15:44.728623 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402dbb1-a381-4383-ae23-7d1c0f2a5743 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:44.739423 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543f8e8-5b9e-4b8d-8674-ad2a161f8e03 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:44.756638 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:44.782332 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac31dd-b6ee-46e7-81ec-78383ee559cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:44.783315 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac31dd-b6ee-46e7-81ec-78383ee559cc None admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:44.783654 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac31dd-b6ee-46e7-81ec-78383ee559cc None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:44.783932 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac31dd-b6ee-46e7-81ec-78383ee559cc None admin] PATH_INFO: `/v3/projects/4ba8e40538db4d89b93469b79322d20e/users/2c1434a85b30411c9c59cc50c3980cd8/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:44.786028 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac31dd-b6ee-46e7-81ec-78383ee559cc None admin] RBAC: Authorizing `identity:create_grant(project_id=4ba8e40538db4d89b93469b79322d20e, user_id=2c1434a85b30411c9c59cc50c3980cd8, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:44.787462 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac31dd-b6ee-46e7-81ec-78383ee559cc None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:44.829919 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402dbb1-a381-4383-ae23-7d1c0f2a5743 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:44.850314 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 390/769] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Jun 27 09:15:44 2022] PUT /identity/v3/projects/4ba8e40538db4d89b93469b79322d20e/users/2c1434a85b30411c9c59cc50c3980cd8/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:15:44.851430 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac31dd-b6ee-46e7-81ec-78383ee559cc None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:44.879920 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be8847-af22-4b63-a608-223aadb44ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:44.881540 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be8847-af22-4b63-a608-223aadb44ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:44.882050 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be8847-af22-4b63-a608-223aadb44ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:44.882578 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be8847-af22-4b63-a608-223aadb44ba2 None admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:44.883637 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38be8847-af22-4b63-a608-223aadb44ba2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:44.884258 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38be8847-af22-4b63-a608-223aadb44ba2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:44.887121 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38be8847-af22-4b63-a608-223aadb44ba2 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:44.911915 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 380/770] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Jun 27 09:15:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:44.911915 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be8847-af22-4b63-a608-223aadb44ba2 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:45.001189 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac31dd-b6ee-46e7-81ec-78383ee559cc None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:45.012180 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:45.020074 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:45.030603 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be8847-af22-4b63-a608-223aadb44ba2 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:45.044392 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24fb3d-46ef-4af2-9eae-83bbafa0c70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:45.045602 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24fb3d-46ef-4af2-9eae-83bbafa0c70f None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:45.045888 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24fb3d-46ef-4af2-9eae-83bbafa0c70f None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:45.046168 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24fb3d-46ef-4af2-9eae-83bbafa0c70f None admin] PATH_INFO: `/v3/services` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:45.047063 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24fb3d-46ef-4af2-9eae-83bbafa0c70f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:45.047806 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24fb3d-46ef-4af2-9eae-83bbafa0c70f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:45.049596 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24fb3d-46ef-4af2-9eae-83bbafa0c70f None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:45.057953 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 391/771] 10.222.0.62 () {56 vars in 1124 bytes} [Mon Jun 27 09:15:44 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:45.059290 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24fb3d-46ef-4af2-9eae-83bbafa0c70f None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:45.077243 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ca212-c2a7-4cdd-be1d-87f7592af3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:45.078049 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ca212-c2a7-4cdd-be1d-87f7592af3af None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:45.078334 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ca212-c2a7-4cdd-be1d-87f7592af3af None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:45.078674 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ca212-c2a7-4cdd-be1d-87f7592af3af None admin] PATH_INFO: `/v3/services/network` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:45.079331 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544ca212-c2a7-4cdd-be1d-87f7592af3af None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:45.080747 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544ca212-c2a7-4cdd-be1d-87f7592af3af None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:45.092986 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-544ca212-c2a7-4cdd-be1d-87f7592af3af None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 27 09:15:45.092986 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:45.092986 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 09:15:45.092986 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 09:15:45.092986 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 09:15:45.092986 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 09:15:45.092986 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 09:15:45.092986 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 09:15:45.092986 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 27 09:15:45.092986 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:45.092986 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 09:15:45.092986 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:45.092986 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:45.092986 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:45.092986 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:45.092986 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:45.092986 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:45.094077 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:45.094077 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:45.094077 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:45.094077 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:45.094077 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:45.094077 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:45.094077 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 09:15:45.094077 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 09:15:45.094077 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 09:15:45.094077 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 09:15:45.094077 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:45.094077 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:45.094077 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:45.094077 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:45.094077 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:45.094077 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:45.094907 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:45.094907 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:45.094907 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:45.094907 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:45.094907 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:45.094907 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:45.094907 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:45.094907 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:45.094907 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:45.094907 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:45.094907 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 09:15:45.094907 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 09:15:45.094907 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 27 09:15:45.094907 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:45.094907 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 381/772] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:15:44 2022] GET /identity/v3/services/network => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:45.095690 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ca212-c2a7-4cdd-be1d-87f7592af3af None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:45.204295 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24fb3d-46ef-4af2-9eae-83bbafa0c70f None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:45.241369 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6609bd-5cee-4e5a-8f71-179b215a2985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:45.242031 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6609bd-5cee-4e5a-8f71-179b215a2985 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:45.242318 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6609bd-5cee-4e5a-8f71-179b215a2985 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:45.242595 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6609bd-5cee-4e5a-8f71-179b215a2985 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:45.243429 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6609bd-5cee-4e5a-8f71-179b215a2985 None admin] RBAC: Adding query filter params (role.id=197a0da3099d45e4bcb9233039c21d8f, scope.project.id=4ba8e40538db4d89b93469b79322d20e, user.id=8f5d1f2327914f9fb070c6212582b6dc) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:45.243741 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6609bd-5cee-4e5a-8f71-179b215a2985 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:45.244588 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ca212-c2a7-4cdd-be1d-87f7592af3af None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:45.245218 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6609bd-5cee-4e5a-8f71-179b215a2985 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:45.256340 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 392/773] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Jun 27 09:15:45 2022] GET /identity/v3/role_assignments?user.id=8f5d1f2327914f9fb070c6212582b6dc&scope.project.id=4ba8e40538db4d89b93469b79322d20e&role.id=197a0da3099d45e4bcb9233039c21d8f => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:45.257386 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6609bd-5cee-4e5a-8f71-179b215a2985 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:45.292917 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f0e0e-d13e-4d55-a0cf-40c942339606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:45.293911 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f0e0e-d13e-4d55-a0cf-40c942339606 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:45.295549 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f0e0e-d13e-4d55-a0cf-40c942339606 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:45.296017 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f0e0e-d13e-4d55-a0cf-40c942339606 None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:45.297180 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2f0e0e-d13e-4d55-a0cf-40c942339606 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:45.299425 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2f0e0e-d13e-4d55-a0cf-40c942339606 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:45.303438 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2f0e0e-d13e-4d55-a0cf-40c942339606 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:45.319666 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 382/774] 10.222.0.62 () {56 vars in 1124 bytes} [Mon Jun 27 09:15:45 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:45.325269 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f0e0e-d13e-4d55-a0cf-40c942339606 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:45.354448 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:45.356326 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:45.454446 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6609bd-5cee-4e5a-8f71-179b215a2985 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:45.502709 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae4a20-0639-4a8d-823f-43f077e6ec23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:45.503715 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae4a20-0639-4a8d-823f-43f077e6ec23 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:45.504243 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae4a20-0639-4a8d-823f-43f077e6ec23 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:45.504691 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae4a20-0639-4a8d-823f-43f077e6ec23 None admin] PATH_INFO: `/v3/services` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:45.505591 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae4a20-0639-4a8d-823f-43f077e6ec23 None admin] RBAC: Adding query filter params (name=network) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:45.506066 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae4a20-0639-4a8d-823f-43f077e6ec23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:45.507603 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae4a20-0639-4a8d-823f-43f077e6ec23 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:45.520103 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 393/775] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Jun 27 09:15:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:45.528083 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae4a20-0639-4a8d-823f-43f077e6ec23 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:45.543125 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f0e0e-d13e-4d55-a0cf-40c942339606 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:45.640986 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a51a68-9640-46e1-a012-2e8872f6726a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:45.641666 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a51a68-9640-46e1-a012-2e8872f6726a None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:45.641950 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a51a68-9640-46e1-a012-2e8872f6726a None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:45.642223 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a51a68-9640-46e1-a012-2e8872f6726a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:45.643023 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a51a68-9640-46e1-a012-2e8872f6726a None admin] RBAC: Adding query filter params (interface=public, service_id=06820b7440e94103a8ace294fe0bccbc, region_id=RegionOne) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:45.643331 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a51a68-9640-46e1-a012-2e8872f6726a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:45.648849 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a51a68-9640-46e1-a012-2e8872f6726a None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:45.676304 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 383/776] 10.222.0.62 () {56 vars in 1251 bytes} [Mon Jun 27 09:15:45 2022] GET /identity/v3/endpoints?service_id=06820b7440e94103a8ace294fe0bccbc&interface=public®ion_id=RegionOne => generated 194 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:15:45.677525 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae4a20-0639-4a8d-823f-43f077e6ec23 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:45.679863 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a51a68-9640-46e1-a012-2e8872f6726a None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:45.679980 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:45.724052 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2eb67-bca3-4bca-8946-dc87e4cac5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:45.724669 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2eb67-bca3-4bca-8946-dc87e4cac5b2 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:45.724967 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2eb67-bca3-4bca-8946-dc87e4cac5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:45.725288 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2eb67-bca3-4bca-8946-dc87e4cac5b2 None admin] PATH_INFO: `/v3/services` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:45.726003 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c2eb67-bca3-4bca-8946-dc87e4cac5b2 None admin] RBAC: Adding query filter params (type=network) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:45.726305 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c2eb67-bca3-4bca-8946-dc87e4cac5b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:45.733559 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c2eb67-bca3-4bca-8946-dc87e4cac5b2 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:45.740423 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 394/777] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Jun 27 09:15:45 2022] GET /identity/v3/services?type=network => generated 350 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:45.753291 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2eb67-bca3-4bca-8946-dc87e4cac5b2 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:45.794614 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:45.845045 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a51a68-9640-46e1-a012-2e8872f6726a None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:45.920858 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116cce00-dfe6-4797-ab78-d68e7a34ebf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:45.921901 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116cce00-dfe6-4797-ab78-d68e7a34ebf2 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:45.922393 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116cce00-dfe6-4797-ab78-d68e7a34ebf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:45.923077 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116cce00-dfe6-4797-ab78-d68e7a34ebf2 None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:45.924016 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116cce00-dfe6-4797-ab78-d68e7a34ebf2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:45.925653 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116cce00-dfe6-4797-ab78-d68e7a34ebf2 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:45.932413 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 384/778] 10.222.0.62 () {56 vars in 1087 bytes} [Mon Jun 27 09:15:45 2022] GET /identity/v3/services => generated 772 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:45.975426 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2eb67-bca3-4bca-8946-dc87e4cac5b2 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:46.036985 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faf381f-050e-4802-a36a-1f52a08057ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:46.037666 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf381f-050e-4802-a36a-1f52a08057ec None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:46.037949 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf381f-050e-4802-a36a-1f52a08057ec None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:46.038224 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf381f-050e-4802-a36a-1f52a08057ec None admin] PATH_INFO: `/v3/endpoints` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:46.039037 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faf381f-050e-4802-a36a-1f52a08057ec None admin] RBAC: Adding query filter params (interface=public, service_id=b41e7bfe13954ef2955c8481b3d174c5, region_id=RegionOne) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:46.039352 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faf381f-050e-4802-a36a-1f52a08057ec None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:46.040770 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faf381f-050e-4802-a36a-1f52a08057ec None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:46.050179 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 395/779] 10.222.0.62 () {56 vars in 1251 bytes} [Mon Jun 27 09:15:45 2022] GET /identity/v3/endpoints?service_id=b41e7bfe13954ef2955c8481b3d174c5&interface=public®ion_id=RegionOne => generated 194 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:46.055917 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116cce00-dfe6-4797-ab78-d68e7a34ebf2 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:46.142053 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110ea35-e0b1-46cf-8fd9-dfc3fe685ebb None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:46.142371 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110ea35-e0b1-46cf-8fd9-dfc3fe685ebb None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:46.142611 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110ea35-e0b1-46cf-8fd9-dfc3fe685ebb None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:46.148330 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 396/780] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 09:15:46.153748 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835236f-66fb-4f69-887b-8e42e7166d2b None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:46.154102 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835236f-66fb-4f69-887b-8e42e7166d2b None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:46.154301 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835236f-66fb-4f69-887b-8e42e7166d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:46.185190 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-a835236f-66fb-4f69-887b-8e42e7166d2b None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:46.186853 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-a835236f-66fb-4f69-887b-8e42e7166d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:46.249443 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:46.249733 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116cce00-dfe6-4797-ab78-d68e7a34ebf2 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:46.292032 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaaf929-d8e4-481a-8d57-590a8a6c862e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:46.292736 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaaf929-d8e4-481a-8d57-590a8a6c862e None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:46.293026 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaaf929-d8e4-481a-8d57-590a8a6c862e None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:46.293305 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaaf929-d8e4-481a-8d57-590a8a6c862e None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:46.294096 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaaf929-d8e4-481a-8d57-590a8a6c862e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:46.295522 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaaf929-d8e4-481a-8d57-590a8a6c862e None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:46.301988 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 385/781] 10.222.0.62 () {56 vars in 1087 bytes} [Mon Jun 27 09:15:46 2022] GET /identity/v3/services => generated 772 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:46.339650 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 397/782] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 09:15:46.377191 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaaf929-d8e4-481a-8d57-590a8a6c862e None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:46.388770 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:46.510696 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaaf929-d8e4-481a-8d57-590a8a6c862e None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:46.546339 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f79ee-19d4-4265-a93a-324426ffa147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:46.547186 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f79ee-19d4-4265-a93a-324426ffa147 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:46.547472 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f79ee-19d4-4265-a93a-324426ffa147 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:46.547750 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f79ee-19d4-4265-a93a-324426ffa147 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:46.559434 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246f79ee-19d4-4265-a93a-324426ffa147 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:15:46.568845 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-246f79ee-19d4-4265-a93a-324426ffa147 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:15:46.568845 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:46.568845 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:46.568845 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:46.568845 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:46.568845 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:46.568845 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:46.568845 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:46.568845 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:46.568845 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:46.568845 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:46.568845 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:46.568845 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:15:46.568845 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:15:46.568845 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:15:46.568845 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:15:46.569763 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:15:46.569763 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:15:46.569763 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:15:46.569763 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:15:46.569763 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:46.569763 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:46.569763 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:46.569763 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:46.569763 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:46.569763 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:46.569763 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:46.569763 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:46.569763 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:46.569763 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:46.569763 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:46.569763 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:46.570829 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:46.570829 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:46.570829 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:46.570829 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:46.570829 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:15:46.570829 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:15:46.570829 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:15:46.570829 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:15:46.570829 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:15:46.570829 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:15:46.570829 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:15:46.570829 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:46.570829 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 386/783] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Jun 27 09:15:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:46.576217 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835236f-66fb-4f69-887b-8e42e7166d2b None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:46.708299 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835236f-66fb-4f69-887b-8e42e7166d2b None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:46.769508 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9d304-cb48-445f-92aa-6c7e3ba31f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:46.770111 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9d304-cb48-445f-92aa-6c7e3ba31f64 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:46.770397 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9d304-cb48-445f-92aa-6c7e3ba31f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:46.770675 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9d304-cb48-445f-92aa-6c7e3ba31f64 None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:46.771486 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a9d304-cb48-445f-92aa-6c7e3ba31f64 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:46.771798 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a9d304-cb48-445f-92aa-6c7e3ba31f64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:46.773446 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a9d304-cb48-445f-92aa-6c7e3ba31f64 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:46.789289 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 398/784] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:15:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:46.794705 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f79ee-19d4-4265-a93a-324426ffa147 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:46.920648 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:46.974613 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f79ee-19d4-4265-a93a-324426ffa147 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:47.022904 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf0a7cb-4dcd-481b-8e6c-4373d31cd4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:47.023628 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0a7cb-4dcd-481b-8e6c-4373d31cd4b9 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:47.023913 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0a7cb-4dcd-481b-8e6c-4373d31cd4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:47.024192 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0a7cb-4dcd-481b-8e6c-4373d31cd4b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:47.041799 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf0a7cb-4dcd-481b-8e6c-4373d31cd4b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:47.043274 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf0a7cb-4dcd-481b-8e6c-4373d31cd4b9 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:47.066915 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-ccf0a7cb-4dcd-481b-8e6c-4373d31cd4b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:47.066915 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:47.066915 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:47.066915 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:47.066915 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:47.066915 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:47.066915 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:47.066915 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:47.066915 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:47.066915 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:47.066915 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:47.066915 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:47.066915 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:47.066915 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:47.066915 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:47.068013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:47.068013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:47.068013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:47.068013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:47.068013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:47.068013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:47.068013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:47.068013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:47.068013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:47.068013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:47.068013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:47.068013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:47.068013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:47.068013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:47.068013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:47.068013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:47.068013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:47.069683 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:47.069683 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:47.069683 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:47.069683 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:47.069683 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 387/785] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:47.074093 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9d304-cb48-445f-92aa-6c7e3ba31f64 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:47.101138 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:47.226362 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9d304-cb48-445f-92aa-6c7e3ba31f64 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:47.269455 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b1c2c-7865-4e91-ae5d-892c2e133ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:47.270136 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b1c2c-7865-4e91-ae5d-892c2e133ecd None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:47.270421 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b1c2c-7865-4e91-ae5d-892c2e133ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:47.270783 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b1c2c-7865-4e91-ae5d-892c2e133ecd None admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:47.271537 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b1c2c-7865-4e91-ae5d-892c2e133ecd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:47.271846 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b1c2c-7865-4e91-ae5d-892c2e133ecd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:47.273341 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b1c2c-7865-4e91-ae5d-892c2e133ecd None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:47.286601 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 399/786] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:47.291779 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf0a7cb-4dcd-481b-8e6c-4373d31cd4b9 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:47.446089 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf0a7cb-4dcd-481b-8e6c-4373d31cd4b9 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:47.474064 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:47.502376 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a419e02-439b-4d91-b528-c0e4216d8d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:47.503189 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a419e02-439b-4d91-b528-c0e4216d8d92 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:47.503473 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a419e02-439b-4d91-b528-c0e4216d8d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:47.503780 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a419e02-439b-4d91-b528-c0e4216d8d92 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:47.513299 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a419e02-439b-4d91-b528-c0e4216d8d92 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:47.514755 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a419e02-439b-4d91-b528-c0e4216d8d92 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:47.538137 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-4a419e02-439b-4d91-b528-c0e4216d8d92 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 27 09:15:47.538137 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:47.538137 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:47.538137 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:47.538137 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:47.538137 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:47.538137 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:47.538137 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:47.538137 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:47.538137 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:47.538137 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:47.538137 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:47.538137 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 09:15:47.538137 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 09:15:47.538137 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 09:15:47.538137 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 09:15:47.539125 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:47.539125 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:47.539125 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 09:15:47.539125 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:15:47.539125 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 09:15:47.539125 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:15:47.539125 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:47.539125 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:47.539125 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:47.539125 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:47.539125 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:47.539125 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:47.539125 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:47.539125 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:47.539125 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:47.539125 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:47.539125 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:47.539125 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:47.540500 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:47.540500 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:47.540500 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 09:15:47.540500 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 09:15:47.540500 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 09:15:47.540500 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 09:15:47.540500 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 09:15:47.540500 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 09:15:47.540500 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 27 09:15:47.540500 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:47.540500 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 388/787] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Jun 27 09:15:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:47.545418 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b1c2c-7865-4e91-ae5d-892c2e133ecd None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:47.612520 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849fdb4-113a-40bb-9c4b-579a9b4cb317 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:47.612871 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849fdb4-113a-40bb-9c4b-579a9b4cb317 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:47.613137 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849fdb4-113a-40bb-9c4b-579a9b4cb317 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:47.615367 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 389/788] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:15:47.620622 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f3b62-be17-475b-a192-3347ca6284f8 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:47.620910 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f3b62-be17-475b-a192-3347ca6284f8 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:47.621190 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f3b62-be17-475b-a192-3347ca6284f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:47.648274 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-ea4f3b62-be17-475b-a192-3347ca6284f8 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:47.649494 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-ea4f3b62-be17-475b-a192-3347ca6284f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:47.711746 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:47.746946 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b1c2c-7865-4e91-ae5d-892c2e133ecd None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:47.775913 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 390/789] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 09:15:47.783246 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d8356-9479-4bf7-82d7-f27e0a6f4d18 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:47.783537 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d8356-9479-4bf7-82d7-f27e0a6f4d18 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:47.783814 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d8356-9479-4bf7-82d7-f27e0a6f4d18 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:47.786048 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 391/790] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:15:47.793437 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3527c-48aa-4176-a68d-cfee763b1fe2 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:47.793654 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3527c-48aa-4176-a68d-cfee763b1fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:47.793936 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3527c-48aa-4176-a68d-cfee763b1fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:47.803627 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74844fd3-5475-4988-9287-d6d7e6817fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:47.804420 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74844fd3-5475-4988-9287-d6d7e6817fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:47.804767 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74844fd3-5475-4988-9287-d6d7e6817fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:47.805115 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74844fd3-5475-4988-9287-d6d7e6817fb6 None admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:47.806015 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74844fd3-5475-4988-9287-d6d7e6817fb6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:47.806386 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74844fd3-5475-4988-9287-d6d7e6817fb6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:47.807870 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74844fd3-5475-4988-9287-d6d7e6817fb6 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:47.822999 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-e1a3527c-48aa-4176-a68d-cfee763b1fe2 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:47.824235 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-e1a3527c-48aa-4176-a68d-cfee763b1fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:47.827998 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 400/791] 10.222.0.62 () {56 vars in 1135 bytes} [Mon Jun 27 09:15:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:47.829069 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74844fd3-5475-4988-9287-d6d7e6817fb6 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:47.912220 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 392/792] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 09:15:47.912220 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a3527c-48aa-4176-a68d-cfee763b1fe2 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:47.963463 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74844fd3-5475-4988-9287-d6d7e6817fb6 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:47.969520 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:48.000433 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa502c-d60b-411d-a72d-93d04940032d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:48.001373 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa502c-d60b-411d-a72d-93d04940032d None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:48.001757 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa502c-d60b-411d-a72d-93d04940032d None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:48.002131 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa502c-d60b-411d-a72d-93d04940032d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:48.015309 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa502c-d60b-411d-a72d-93d04940032d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:15:48.026420 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-d5fa502c-d60b-411d-a72d-93d04940032d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:15:48.026420 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:48.026420 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:48.026420 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:48.026420 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:48.026420 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:48.026420 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:48.026420 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:48.026420 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:48.026420 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:48.026420 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:48.026420 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:48.026420 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:15:48.026420 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:15:48.026420 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:15:48.026420 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:15:48.027578 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:15:48.027578 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:15:48.027578 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:15:48.027578 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:15:48.027578 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:48.027578 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:48.027578 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:48.027578 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:48.027578 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:48.027578 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:48.027578 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:48.027578 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:48.027578 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:48.027578 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:48.027578 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:48.027578 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:48.028525 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:48.028525 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:48.028525 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:48.028525 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:48.028525 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:15:48.028525 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:15:48.028525 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:15:48.028525 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:15:48.028525 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:15:48.028525 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:15:48.028525 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:15:48.028525 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:48.032272 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 401/793] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Jun 27 09:15:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:48.033301 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa502c-d60b-411d-a72d-93d04940032d None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:48.039967 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:48.052604 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a3527c-48aa-4176-a68d-cfee763b1fe2 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:48.095064 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed006f-5782-474d-ad3c-a1a41dbbb338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:48.096515 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed006f-5782-474d-ad3c-a1a41dbbb338 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:48.097239 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed006f-5782-474d-ad3c-a1a41dbbb338 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:48.098726 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed006f-5782-474d-ad3c-a1a41dbbb338 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:48.114023 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbed006f-5782-474d-ad3c-a1a41dbbb338 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:48.116126 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbed006f-5782-474d-ad3c-a1a41dbbb338 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:48.140131 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-dbed006f-5782-474d-ad3c-a1a41dbbb338 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:48.140131 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:48.140131 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:48.140131 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:48.140131 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:48.140131 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:48.140131 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:48.140131 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:48.140131 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:48.140131 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:48.140131 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:48.140131 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:48.140131 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:48.140131 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:48.140131 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:48.141115 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:48.141115 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:48.141115 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:48.141115 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:48.141115 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:48.141115 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:48.141115 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:48.141115 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:48.141115 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:48.141115 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:48.141115 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:48.141115 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:48.141115 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:48.141115 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:48.141115 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:48.141115 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:48.141115 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:48.142012 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:48.142012 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:48.142012 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:48.142012 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:48.142012 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 393/794] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:48.142812 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed006f-5782-474d-ad3c-a1a41dbbb338 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:48.157315 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa502c-d60b-411d-a72d-93d04940032d None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:48.200661 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054c967-9b68-4ed2-b0fb-a431e3f49dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:48.201472 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054c967-9b68-4ed2-b0fb-a431e3f49dbc None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:48.201752 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054c967-9b68-4ed2-b0fb-a431e3f49dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:48.202023 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054c967-9b68-4ed2-b0fb-a431e3f49dbc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:48.216824 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8054c967-9b68-4ed2-b0fb-a431e3f49dbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:15:48.227610 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-8054c967-9b68-4ed2-b0fb-a431e3f49dbc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 09:15:48.227610 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:48.227610 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:48.227610 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:48.227610 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:48.227610 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:48.227610 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:48.227610 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:48.227610 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:48.227610 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:48.227610 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:48.227610 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:48.227610 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:15:48.227610 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:15:48.227610 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:15:48.227610 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:15:48.228615 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:15:48.228615 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:15:48.228615 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:15:48.228615 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:15:48.228615 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:48.228615 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:48.228615 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:48.228615 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:48.228615 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:48.228615 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:48.228615 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:48.228615 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:48.228615 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:48.228615 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:48.228615 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:48.228615 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:48.229442 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:48.229442 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:48.229442 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:48.229442 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:48.229442 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:15:48.229442 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:15:48.229442 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:15:48.229442 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:15:48.229442 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:15:48.229442 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:15:48.229442 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 09:15:48.229442 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:48.233854 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 402/795] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Jun 27 09:15:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:48.234807 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054c967-9b68-4ed2-b0fb-a431e3f49dbc None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:48.262804 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:48.274319 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed006f-5782-474d-ad3c-a1a41dbbb338 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:48.312467 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da10b1-c285-4718-8141-4cfd7380395d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:48.313471 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da10b1-c285-4718-8141-4cfd7380395d None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:48.313979 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da10b1-c285-4718-8141-4cfd7380395d None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:48.314465 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da10b1-c285-4718-8141-4cfd7380395d None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:48.315415 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56da10b1-c285-4718-8141-4cfd7380395d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:48.315699 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:48.317164 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56da10b1-c285-4718-8141-4cfd7380395d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:48.318872 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56da10b1-c285-4718-8141-4cfd7380395d None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:48.328504 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 394/796] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:15:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:48.329613 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da10b1-c285-4718-8141-4cfd7380395d None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:48.368515 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054c967-9b68-4ed2-b0fb-a431e3f49dbc None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:48.406196 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab975a7-f4a0-44a5-ac30-a79b1a70bdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:48.407258 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab975a7-f4a0-44a5-ac30-a79b1a70bdf5 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:48.407773 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab975a7-f4a0-44a5-ac30-a79b1a70bdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:48.408275 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab975a7-f4a0-44a5-ac30-a79b1a70bdf5 None admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:48.409208 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab975a7-f4a0-44a5-ac30-a79b1a70bdf5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:48.409737 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab975a7-f4a0-44a5-ac30-a79b1a70bdf5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:48.411353 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab975a7-f4a0-44a5-ac30-a79b1a70bdf5 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:48.424824 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 403/797] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:48.426006 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab975a7-f4a0-44a5-ac30-a79b1a70bdf5 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:48.460835 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da10b1-c285-4718-8141-4cfd7380395d None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:48.502099 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5c04b-99be-4334-955e-59ce28582fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:48.503128 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5c04b-99be-4334-955e-59ce28582fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:48.504177 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5c04b-99be-4334-955e-59ce28582fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:48.504718 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5c04b-99be-4334-955e-59ce28582fc2 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:48.505668 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f5c04b-99be-4334-955e-59ce28582fc2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:48.506176 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f5c04b-99be-4334-955e-59ce28582fc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:48.507858 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f5c04b-99be-4334-955e-59ce28582fc2 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:48.517606 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 395/798] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Jun 27 09:15:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:48.518697 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5c04b-99be-4334-955e-59ce28582fc2 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:48.538469 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:48.549584 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab975a7-f4a0-44a5-ac30-a79b1a70bdf5 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:48.582633 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:48.602996 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b50fa-1184-41e1-a3e8-1072e3b3b2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:48.604327 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b50fa-1184-41e1-a3e8-1072e3b3b2d5 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:48.604544 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b50fa-1184-41e1-a3e8-1072e3b3b2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:48.604818 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b50fa-1184-41e1-a3e8-1072e3b3b2d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:48.621307 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1b50fa-1184-41e1-a3e8-1072e3b3b2d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:48.622760 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1b50fa-1184-41e1-a3e8-1072e3b3b2d5 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:48.640829 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5c04b-99be-4334-955e-59ce28582fc2 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:48.645745 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-0d1b50fa-1184-41e1-a3e8-1072e3b3b2d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:48.645745 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:48.645745 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:48.645745 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:48.645745 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:48.645745 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:48.645745 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:48.645745 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:48.645745 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:48.645745 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:48.645745 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:48.645745 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:48.645745 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:48.645745 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:48.645745 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:48.646650 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:48.646650 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:48.646650 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:48.646650 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:48.646650 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:48.646650 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:48.646650 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:48.646650 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:48.646650 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:48.646650 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:48.646650 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:48.646650 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:48.646650 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:48.646650 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:48.646650 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:48.646650 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:48.646650 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:48.647540 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:48.647540 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:48.647540 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:48.647540 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:48.648355 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 404/799] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:48.649168 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b50fa-1184-41e1-a3e8-1072e3b3b2d5 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:48.682573 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f4962-b528-4457-bb1f-d5ebf3437f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:48.683363 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f4962-b528-4457-bb1f-d5ebf3437f84 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:48.683641 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f4962-b528-4457-bb1f-d5ebf3437f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:48.683913 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f4962-b528-4457-bb1f-d5ebf3437f84 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:48.690905 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24f4962-b528-4457-bb1f-d5ebf3437f84 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:48.692966 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24f4962-b528-4457-bb1f-d5ebf3437f84 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:48.707440 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-f24f4962-b528-4457-bb1f-d5ebf3437f84 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:15:48.707440 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:48.707440 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:48.707440 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:48.707440 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:48.707440 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:48.707440 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:48.707440 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:48.707440 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:48.707440 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:48.707440 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:48.707440 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:48.707440 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 09:15:48.707440 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 09:15:48.707440 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 09:15:48.708571 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 09:15:48.708571 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:48.708571 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:48.708571 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:48.708571 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:48.708571 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:48.708571 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:48.708571 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:48.708571 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:48.708571 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:48.708571 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:48.708571 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:48.708571 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:48.708571 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:48.708571 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:48.708571 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:48.708571 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:48.709459 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 09:15:48.709459 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 09:15:48.709459 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 09:15:48.709459 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 09:15:48.709459 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 09:15:48.709459 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 09:15:48.709459 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:15:48.709459 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:48.709459 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 396/800] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:15:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:48.710144 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac03d7d-ba99-4e3e-ac6b-f6a0980676a0 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:48.710427 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac03d7d-ba99-4e3e-ac6b-f6a0980676a0 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:48.710702 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac03d7d-ba99-4e3e-ac6b-f6a0980676a0 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:48.715708 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 397/801] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:15:48.715708 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac03d7d-ba99-4e3e-ac6b-f6a0980676a0 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:48.753231 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b50fa-1184-41e1-a3e8-1072e3b3b2d5 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:48.786457 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0fc1d9-e0e0-4d25-96a8-1f7c67ad1ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:48.787244 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0fc1d9-e0e0-4d25-96a8-1f7c67ad1ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:48.787524 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0fc1d9-e0e0-4d25-96a8-1f7c67ad1ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:48.787799 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0fc1d9-e0e0-4d25-96a8-1f7c67ad1ce9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:48.790733 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:48.798206 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0fc1d9-e0e0-4d25-96a8-1f7c67ad1ce9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:48.800355 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0fc1d9-e0e0-4d25-96a8-1f7c67ad1ce9 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:48.816932 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac03d7d-ba99-4e3e-ac6b-f6a0980676a0 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:48.817743 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-bb0fc1d9-e0e0-4d25-96a8-1f7c67ad1ce9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:48.817743 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:48.817743 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:48.817743 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:48.817743 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:48.817743 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:48.817743 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:48.817743 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:48.817743 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:48.817743 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:48.817743 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:48.817743 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:48.817743 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:48.817743 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:48.817743 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:48.818776 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:48.818776 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:48.818776 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:48.818776 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:48.818776 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:48.818776 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:48.818776 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:48.818776 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:48.818776 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:48.818776 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:48.818776 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:48.818776 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:48.818776 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:48.818776 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:48.818776 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:48.818776 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:48.818776 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:48.824110 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:48.824110 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:48.824110 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:48.824110 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:48.824110 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 405/802] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:48.824110 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f0d3d-b050-4c26-b560-3e449e00ed56 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:48.824110 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f0d3d-b050-4c26-b560-3e449e00ed56 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:48.824110 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f0d3d-b050-4c26-b560-3e449e00ed56 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:48.824110 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 406/803] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:15:48.824637 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9815cd4-85c1-47cd-99e9-36c232dc27a6 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:48.824637 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9815cd4-85c1-47cd-99e9-36c232dc27a6 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:48.824637 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9815cd4-85c1-47cd-99e9-36c232dc27a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:48.840176 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-b9815cd4-85c1-47cd-99e9-36c232dc27a6 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:48.841343 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-b9815cd4-85c1-47cd-99e9-36c232dc27a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:48.858178 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76570f5-f349-4a69-b057-60623501c109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:48.858841 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76570f5-f349-4a69-b057-60623501c109 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:48.859131 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76570f5-f349-4a69-b057-60623501c109 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:48.859410 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76570f5-f349-4a69-b057-60623501c109 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:48.860129 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76570f5-f349-4a69-b057-60623501c109 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:48.860469 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76570f5-f349-4a69-b057-60623501c109 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:48.861347 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:48.861858 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76570f5-f349-4a69-b057-60623501c109 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:48.879710 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 398/804] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:48.880698 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76570f5-f349-4a69-b057-60623501c109 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:48.913512 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 407/805] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 09:15:48.914367 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9815cd4-85c1-47cd-99e9-36c232dc27a6 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:48.981824 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76570f5-f349-4a69-b057-60623501c109 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:49.015130 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e319718-9cb6-4671-b3f6-e66d73095067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:49.015787 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e319718-9cb6-4671-b3f6-e66d73095067 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:49.016067 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e319718-9cb6-4671-b3f6-e66d73095067 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:49.016377 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e319718-9cb6-4671-b3f6-e66d73095067 None admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:49.017155 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e319718-9cb6-4671-b3f6-e66d73095067 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:49.017461 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e319718-9cb6-4671-b3f6-e66d73095067 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:49.018899 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e319718-9cb6-4671-b3f6-e66d73095067 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:49.019139 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9815cd4-85c1-47cd-99e9-36c232dc27a6 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:49.020575 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:49.032255 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 399/806] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Jun 27 09:15:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:49.033459 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608e083-e175-4dbd-8e69-268ddcf423e2 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:49.037271 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608e083-e175-4dbd-8e69-268ddcf423e2 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:49.037271 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608e083-e175-4dbd-8e69-268ddcf423e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:49.051466 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-1608e083-e175-4dbd-8e69-268ddcf423e2 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:49.052696 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-1608e083-e175-4dbd-8e69-268ddcf423e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:49.054556 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23ef91-6a21-44b5-a0ea-1ce54c040117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:49.055275 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23ef91-6a21-44b5-a0ea-1ce54c040117 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:49.055506 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23ef91-6a21-44b5-a0ea-1ce54c040117 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:49.055781 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23ef91-6a21-44b5-a0ea-1ce54c040117 None admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:49.056530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce23ef91-6a21-44b5-a0ea-1ce54c040117 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:49.056837 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce23ef91-6a21-44b5-a0ea-1ce54c040117 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:49.058193 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce23ef91-6a21-44b5-a0ea-1ce54c040117 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:49.069559 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 408/807] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:49.070494 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23ef91-6a21-44b5-a0ea-1ce54c040117 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:49.087930 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:49.130437 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 400/808] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 09:15:49.131128 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608e083-e175-4dbd-8e69-268ddcf423e2 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:49.171977 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23ef91-6a21-44b5-a0ea-1ce54c040117 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:49.207333 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a214a128-ff2f-4f8a-9ebf-eb02614788d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:49.208132 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214a128-ff2f-4f8a-9ebf-eb02614788d4 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:49.208441 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214a128-ff2f-4f8a-9ebf-eb02614788d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:49.208736 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214a128-ff2f-4f8a-9ebf-eb02614788d4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:49.219252 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a214a128-ff2f-4f8a-9ebf-eb02614788d4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:49.221110 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a214a128-ff2f-4f8a-9ebf-eb02614788d4 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:49.244485 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-a214a128-ff2f-4f8a-9ebf-eb02614788d4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 27 09:15:49.244485 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:49.244485 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:49.244485 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:49.244485 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:49.244485 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:49.244485 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:49.244485 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:49.244485 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:49.244485 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:49.244485 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:49.244485 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:49.244485 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 09:15:49.244485 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 09:15:49.244485 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 09:15:49.244485 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 09:15:49.245528 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:49.245528 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:49.245528 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 09:15:49.245528 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:15:49.245528 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 09:15:49.245528 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:15:49.245528 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:49.245528 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:49.245528 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:49.245528 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:49.245528 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:49.245528 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:49.245528 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:49.245528 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:49.245528 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:49.245528 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:49.245528 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:49.245528 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:49.246489 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:49.246489 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:49.246489 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 09:15:49.246489 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 09:15:49.246489 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 09:15:49.246489 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 09:15:49.246489 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 09:15:49.246489 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 09:15:49.246489 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 27 09:15:49.246489 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:49.246489 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 409/809] 10.222.0.62 () {56 vars in 1093 bytes} [Mon Jun 27 09:15:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:49.247089 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a214a128-ff2f-4f8a-9ebf-eb02614788d4 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:49.247736 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608e083-e175-4dbd-8e69-268ddcf423e2 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:49.275365 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:49.286937 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b55ef6f-edb6-4f23-9067-dc460bc75338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:49.287750 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55ef6f-edb6-4f23-9067-dc460bc75338 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:49.288034 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55ef6f-edb6-4f23-9067-dc460bc75338 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:49.288349 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55ef6f-edb6-4f23-9067-dc460bc75338 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:49.289005 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b55ef6f-edb6-4f23-9067-dc460bc75338 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:49.290365 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b55ef6f-edb6-4f23-9067-dc460bc75338 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:49.303452 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-2b55ef6f-edb6-4f23-9067-dc460bc75338 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 27 09:15:49.303452 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:49.303452 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 09:15:49.303452 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 09:15:49.303452 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 09:15:49.303452 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 09:15:49.303452 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 09:15:49.303452 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 09:15:49.303452 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 27 09:15:49.303452 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:49.303452 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 09:15:49.303452 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:49.303452 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:49.303452 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:49.303452 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:49.303452 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:49.304562 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:49.304562 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:49.304562 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:49.304562 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:49.304562 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:49.304562 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:49.304562 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:49.304562 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 09:15:49.304562 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 09:15:49.304562 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 09:15:49.304562 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 09:15:49.304562 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:49.304562 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:49.304562 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:49.304562 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:49.304562 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:49.305616 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:49.305616 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:49.305616 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:49.305616 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:49.305616 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:49.305616 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:49.305616 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:49.305616 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:49.305616 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:49.305616 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:49.305616 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:49.305616 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 09:15:49.305616 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 09:15:49.305616 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 27 09:15:49.305616 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:49.305616 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 401/810] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Jun 27 09:15:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:49.306915 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b55ef6f-edb6-4f23-9067-dc460bc75338 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:49.331275 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:49.355859 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a214a128-ff2f-4f8a-9ebf-eb02614788d4 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:49.388402 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade9c69c-056d-432b-8e45-ab3b661eecb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:49.389218 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9c69c-056d-432b-8e45-ab3b661eecb9 None admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:49.389498 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9c69c-056d-432b-8e45-ab3b661eecb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:49.389853 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9c69c-056d-432b-8e45-ab3b661eecb9 None admin] PATH_INFO: `/v3/projects/4ba8e40538db4d89b93469b79322d20e/users/f5477b14dae24fd3a644c9cbd6ff85ec/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:49.391771 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade9c69c-056d-432b-8e45-ab3b661eecb9 None admin] RBAC: Authorizing `identity:create_grant(project_id=4ba8e40538db4d89b93469b79322d20e, user_id=f5477b14dae24fd3a644c9cbd6ff85ec, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:49.393254 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade9c69c-056d-432b-8e45-ab3b661eecb9 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:49.406388 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b55ef6f-edb6-4f23-9067-dc460bc75338 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:49.439276 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaa6251-6e45-4784-8686-df5cf02cd837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:49.440078 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa6251-6e45-4784-8686-df5cf02cd837 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:49.445382 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa6251-6e45-4784-8686-df5cf02cd837 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:49.445382 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa6251-6e45-4784-8686-df5cf02cd837 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:49.448058 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaa6251-6e45-4784-8686-df5cf02cd837 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:49.449530 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaa6251-6e45-4784-8686-df5cf02cd837 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:49.461316 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 410/811] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Jun 27 09:15:49 2022] PUT /identity/v3/projects/4ba8e40538db4d89b93469b79322d20e/users/f5477b14dae24fd3a644c9cbd6ff85ec/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:15:49.462160 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade9c69c-056d-432b-8e45-ab3b661eecb9 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:49.466809 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-deaa6251-6e45-4784-8686-df5cf02cd837 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 09:15:49.466809 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:49.466809 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:49.466809 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:49.466809 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:49.466809 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:49.466809 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:49.466809 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:49.466809 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:49.466809 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:49.466809 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:49.466809 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:49.466809 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 09:15:49.466809 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 09:15:49.466809 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 09:15:49.466809 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 09:15:49.467773 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:49.467773 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:49.467773 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 09:15:49.467773 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:15:49.467773 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 09:15:49.467773 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:15:49.467773 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:49.467773 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:49.467773 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:49.467773 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:49.467773 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:49.467773 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:49.467773 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:49.467773 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:49.467773 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:49.467773 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:49.467773 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:49.467773 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:49.468805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:49.468805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:49.468805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 09:15:49.468805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 09:15:49.468805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 09:15:49.468805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 09:15:49.468805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 09:15:49.468805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 09:15:49.468805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 09:15:49.468805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:49.468805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 402/812] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Jun 27 09:15:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:49.468805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaa6251-6e45-4784-8686-df5cf02cd837 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:49.546079 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:49.597429 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade9c69c-056d-432b-8e45-ab3b661eecb9 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:49.606234 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaa6251-6e45-4784-8686-df5cf02cd837 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:49.642522 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31afd6ee-0fc2-4e70-ae62-e5a3a181123b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:49.643354 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afd6ee-0fc2-4e70-ae62-e5a3a181123b None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:49.643587 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afd6ee-0fc2-4e70-ae62-e5a3a181123b None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:49.643860 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afd6ee-0fc2-4e70-ae62-e5a3a181123b None admin] PATH_INFO: `/v3/services/network` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:49.645073 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31afd6ee-0fc2-4e70-ae62-e5a3a181123b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:49.645941 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4a08d-6d07-4b98-bdf4-c800dbcdd021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:49.646491 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31afd6ee-0fc2-4e70-ae62-e5a3a181123b None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:49.646596 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4a08d-6d07-4b98-bdf4-c800dbcdd021 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:49.646958 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4a08d-6d07-4b98-bdf4-c800dbcdd021 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:49.647238 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4a08d-6d07-4b98-bdf4-c800dbcdd021 None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:49.648082 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b4a08d-6d07-4b98-bdf4-c800dbcdd021 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:49.648621 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b4a08d-6d07-4b98-bdf4-c800dbcdd021 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:49.649474 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:49.650503 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b4a08d-6d07-4b98-bdf4-c800dbcdd021 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:49.659385 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-31afd6ee-0fc2-4e70-ae62-e5a3a181123b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 27 09:15:49.659385 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:49.659385 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 09:15:49.659385 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 09:15:49.659385 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 09:15:49.659385 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 09:15:49.659385 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 09:15:49.659385 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 09:15:49.659385 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 27 09:15:49.659385 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:49.659385 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 09:15:49.659385 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:49.659385 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:49.659385 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:49.659385 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:49.659385 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:49.659385 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:49.664169 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:49.664169 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:49.664169 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:49.664169 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:49.664169 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:49.664169 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:49.664169 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 09:15:49.664169 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 09:15:49.664169 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 09:15:49.664169 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 09:15:49.664169 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:49.664169 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:49.664169 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:49.664169 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:49.664169 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:49.664169 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:49.665118 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:49.665118 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:49.665118 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:49.665118 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:49.665118 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:49.665118 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:49.665118 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:49.665118 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:49.665118 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:49.665118 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:49.665118 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 09:15:49.665118 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 09:15:49.665118 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 27 09:15:49.665118 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:49.665118 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 411/813] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:15:49 2022] GET /identity/v3/services/network => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:49.665969 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31afd6ee-0fc2-4e70-ae62-e5a3a181123b None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:49.675951 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 403/814] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Jun 27 09:15:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:49.676688 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4a08d-6d07-4b98-bdf4-c800dbcdd021 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:49.781487 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31afd6ee-0fc2-4e70-ae62-e5a3a181123b None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:49.783088 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4a08d-6d07-4b98-bdf4-c800dbcdd021 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:49.791440 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:49.820044 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d3e30-2ada-4176-bf88-489246493673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:49.820750 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d3e30-2ada-4176-bf88-489246493673 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:49.821032 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d3e30-2ada-4176-bf88-489246493673 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:49.821303 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d3e30-2ada-4176-bf88-489246493673 None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:49.821909 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d5f39-d41a-4d5d-be5a-b4c7fb8eaa83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:49.822134 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d3e30-2ada-4176-bf88-489246493673 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:49.822437 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d3e30-2ada-4176-bf88-489246493673 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:49.822623 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d5f39-d41a-4d5d-be5a-b4c7fb8eaa83 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:49.822911 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d5f39-d41a-4d5d-be5a-b4c7fb8eaa83 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:49.823185 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d5f39-d41a-4d5d-be5a-b4c7fb8eaa83 None admin] PATH_INFO: `/v3/services` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:49.823878 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d3e30-2ada-4176-bf88-489246493673 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:49.823972 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d5f39-d41a-4d5d-be5a-b4c7fb8eaa83 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:49.824191 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d5f39-d41a-4d5d-be5a-b4c7fb8eaa83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:49.825586 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d5f39-d41a-4d5d-be5a-b4c7fb8eaa83 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:49.835672 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 412/815] 10.222.0.62 () {56 vars in 1124 bytes} [Mon Jun 27 09:15:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:49.836575 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d5f39-d41a-4d5d-be5a-b4c7fb8eaa83 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:49.847801 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 404/816] 10.222.0.62 () {56 vars in 1149 bytes} [Mon Jun 27 09:15:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:49.847801 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d3e30-2ada-4176-bf88-489246493673 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:49.910799 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:49.954416 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d3e30-2ada-4176-bf88-489246493673 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:49.958084 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d5f39-d41a-4d5d-be5a-b4c7fb8eaa83 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:49.992563 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce378dd-e3cc-48f1-aa68-7fbcace6cb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:49.993287 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce378dd-e3cc-48f1-aa68-7fbcace6cb5e None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:49.993569 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce378dd-e3cc-48f1-aa68-7fbcace6cb5e None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:49.993844 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce378dd-e3cc-48f1-aa68-7fbcace6cb5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:49.994367 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6caef-eedb-49d3-893b-66c069096595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:49.995031 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6caef-eedb-49d3-893b-66c069096595 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:49.995314 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6caef-eedb-49d3-893b-66c069096595 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:49.995623 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6caef-eedb-49d3-893b-66c069096595 None admin] PATH_INFO: `/v3/services` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:49.996336 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d6caef-eedb-49d3-893b-66c069096595 None admin] RBAC: Adding query filter params (name=network) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:49.996708 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d6caef-eedb-49d3-893b-66c069096595 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:49.998422 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d6caef-eedb-49d3-893b-66c069096595 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:50.002919 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 413/817] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Jun 27 09:15:49 2022] GET /identity/v3/services?name=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:50.008561 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6caef-eedb-49d3-893b-66c069096595 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:50.029396 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:50.072071 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce378dd-e3cc-48f1-aa68-7fbcace6cb5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:50.074287 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce378dd-e3cc-48f1-aa68-7fbcace6cb5e None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:50.125269 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6caef-eedb-49d3-893b-66c069096595 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:50.156796 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:50.164440 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d132a7-aa17-41c1-9ef2-4fc4cb7cbfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:50.165042 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d132a7-aa17-41c1-9ef2-4fc4cb7cbfaa None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:50.165385 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d132a7-aa17-41c1-9ef2-4fc4cb7cbfaa None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:50.165735 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d132a7-aa17-41c1-9ef2-4fc4cb7cbfaa None admin] PATH_INFO: `/v3/services` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:50.166461 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d132a7-aa17-41c1-9ef2-4fc4cb7cbfaa None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:50.166776 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d132a7-aa17-41c1-9ef2-4fc4cb7cbfaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:50.168479 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d132a7-aa17-41c1-9ef2-4fc4cb7cbfaa None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:50.178259 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 414/818] 10.222.0.62 () {56 vars in 1124 bytes} [Mon Jun 27 09:15:50 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:50.178259 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d132a7-aa17-41c1-9ef2-4fc4cb7cbfaa None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:50.199108 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 405/819] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:15:49 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 09:15:50.200295 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce378dd-e3cc-48f1-aa68-7fbcace6cb5e None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:50.269121 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:50.293333 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d132a7-aa17-41c1-9ef2-4fc4cb7cbfaa None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:50.311173 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce378dd-e3cc-48f1-aa68-7fbcace6cb5e None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:50.332104 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3e79c-2ce3-4056-9935-87ec276ff45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:50.332923 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3e79c-2ce3-4056-9935-87ec276ff45a None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:50.333288 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3e79c-2ce3-4056-9935-87ec276ff45a None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:50.334032 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3e79c-2ce3-4056-9935-87ec276ff45a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:50.344975 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c3e79c-2ce3-4056-9935-87ec276ff45a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:50.346430 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c3e79c-2ce3-4056-9935-87ec276ff45a None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:50.348639 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e1f09-a1a2-4e9b-b4ee-7499c3a432eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:50.349311 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e1f09-a1a2-4e9b-b4ee-7499c3a432eb None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:50.349598 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e1f09-a1a2-4e9b-b4ee-7499c3a432eb None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:50.349878 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e1f09-a1a2-4e9b-b4ee-7499c3a432eb None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:50.350585 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177e1f09-a1a2-4e9b-b4ee-7499c3a432eb None admin] RBAC: Adding query filter params (type=network) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:50.350894 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177e1f09-a1a2-4e9b-b4ee-7499c3a432eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:50.352272 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177e1f09-a1a2-4e9b-b4ee-7499c3a432eb None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:50.358063 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 406/820] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Jun 27 09:15:50 2022] GET /identity/v3/services?type=network => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:50.363965 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e1f09-a1a2-4e9b-b4ee-7499c3a432eb None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:50.365389 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-98c3e79c-2ce3-4056-9935-87ec276ff45a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:50.365389 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:50.365389 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:50.365389 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:50.365389 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:50.365389 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:50.365389 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:50.365389 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:50.365389 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:50.365389 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:50.365389 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:50.365389 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:50.365389 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:50.365389 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:50.365389 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:50.366413 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:50.366413 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:50.366413 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:50.366413 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:50.366413 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:50.366413 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:50.366413 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:50.366413 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:50.366413 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:50.366413 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:50.366413 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:50.366413 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:50.366413 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:50.366413 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:50.366413 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:50.366413 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:50.366413 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:50.367306 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:50.367306 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:50.367306 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:50.367306 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:50.367306 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 415/821] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:50.367579 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3e79c-2ce3-4056-9935-87ec276ff45a None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:50.425272 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:50.478483 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e1f09-a1a2-4e9b-b4ee-7499c3a432eb None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:50.490851 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3e79c-2ce3-4056-9935-87ec276ff45a None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:50.507839 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:50.516488 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd4042e-f8c4-4ab8-aa6c-b23bd11acc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:50.517372 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd4042e-f8c4-4ab8-aa6c-b23bd11acc6e None admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:50.518008 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd4042e-f8c4-4ab8-aa6c-b23bd11acc6e None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:50.518545 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd4042e-f8c4-4ab8-aa6c-b23bd11acc6e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:50.519587 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd4042e-f8c4-4ab8-aa6c-b23bd11acc6e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:50.521278 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd4042e-f8c4-4ab8-aa6c-b23bd11acc6e None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:50.527717 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a58b2e-4fad-43cf-8704-95f4491331df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:50.528628 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a58b2e-4fad-43cf-8704-95f4491331df None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:50.528984 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a58b2e-4fad-43cf-8704-95f4491331df None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:50.529347 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a58b2e-4fad-43cf-8704-95f4491331df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:50.541074 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a58b2e-4fad-43cf-8704-95f4491331df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:50.542604 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a58b2e-4fad-43cf-8704-95f4491331df None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:50.563047 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-63a58b2e-4fad-43cf-8704-95f4491331df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:50.563047 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:50.563047 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:50.563047 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:50.563047 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:50.563047 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:50.563047 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:50.563047 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:50.563047 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:50.563047 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:50.563047 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:50.563047 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:50.563047 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:50.563047 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:50.563047 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:50.564012 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:50.564012 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:50.564012 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:50.564012 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:50.564012 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:50.564012 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:50.564012 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:50.564012 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:50.564012 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:50.564012 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:50.564012 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:50.564012 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:50.564012 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:50.564012 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:50.564012 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:50.564012 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:50.564012 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:50.565253 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:50.565253 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:50.565253 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:50.565253 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:50.565253 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 416/822] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:50.565253 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a58b2e-4fad-43cf-8704-95f4491331df None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:50.634153 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 407/823] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Jun 27 09:15:50 2022] POST /identity/v3/endpoints => generated 346 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:15:50.635483 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd4042e-f8c4-4ab8-aa6c-b23bd11acc6e None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:50.690932 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a58b2e-4fad-43cf-8704-95f4491331df None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:50.694972 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:50.751157 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6efbbb-f57e-4713-9a25-b4401e109b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:50.752865 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6efbbb-f57e-4713-9a25-b4401e109b2e None admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:50.753413 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6efbbb-f57e-4713-9a25-b4401e109b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:50.754145 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6efbbb-f57e-4713-9a25-b4401e109b2e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:50.755388 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6efbbb-f57e-4713-9a25-b4401e109b2e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:50.757800 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6efbbb-f57e-4713-9a25-b4401e109b2e None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:50.759892 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd4042e-f8c4-4ab8-aa6c-b23bd11acc6e None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:50.799508 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5499ddb9-ee4e-4b50-9b04-cac67aae8642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:50.800442 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499ddb9-ee4e-4b50-9b04-cac67aae8642 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:50.801241 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499ddb9-ee4e-4b50-9b04-cac67aae8642 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:50.801588 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499ddb9-ee4e-4b50-9b04-cac67aae8642 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:50.802441 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5499ddb9-ee4e-4b50-9b04-cac67aae8642 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:50.802829 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5499ddb9-ee4e-4b50-9b04-cac67aae8642 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:50.804328 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5499ddb9-ee4e-4b50-9b04-cac67aae8642 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:50.819292 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 408/824] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:50.820030 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5499ddb9-ee4e-4b50-9b04-cac67aae8642 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:50.834628 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 417/825] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Jun 27 09:15:50 2022] POST /identity/v3/endpoints => generated 327 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:15:50.837651 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6efbbb-f57e-4713-9a25-b4401e109b2e None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:50.875699 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:50.956605 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5499ddb9-ee4e-4b50-9b04-cac67aae8642 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:50.982661 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6efbbb-f57e-4713-9a25-b4401e109b2e None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:51.015079 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb4178-9410-40c2-8213-e87b8807696e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:51.017220 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb4178-9410-40c2-8213-e87b8807696e None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:51.017682 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb4178-9410-40c2-8213-e87b8807696e None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:51.018354 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb4178-9410-40c2-8213-e87b8807696e None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:51.019797 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addb4178-9410-40c2-8213-e87b8807696e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:51.020545 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addb4178-9410-40c2-8213-e87b8807696e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:51.023050 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addb4178-9410-40c2-8213-e87b8807696e None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:51.026636 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b842fa-24b2-4dd4-b7c7-2f7129c9aa09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:51.027560 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b842fa-24b2-4dd4-b7c7-2f7129c9aa09 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:51.027957 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b842fa-24b2-4dd4-b7c7-2f7129c9aa09 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:51.028373 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b842fa-24b2-4dd4-b7c7-2f7129c9aa09 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:51.044221 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b842fa-24b2-4dd4-b7c7-2f7129c9aa09 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:51.044221 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b842fa-24b2-4dd4-b7c7-2f7129c9aa09 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:51.044495 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 409/826] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:51.048335 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb4178-9410-40c2-8213-e87b8807696e None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:51.059177 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-e5b842fa-24b2-4dd4-b7c7-2f7129c9aa09 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:15:51.059177 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:51.059177 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:51.059177 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:51.059177 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:51.059177 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:51.059177 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:51.059177 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:51.059177 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:51.059177 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:51.059177 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:51.059177 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:51.059177 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 09:15:51.059177 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 09:15:51.059177 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 09:15:51.060100 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 09:15:51.060100 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:51.060100 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:51.060100 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:51.060100 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:51.060100 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:51.060100 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:51.060100 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:51.060100 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:51.060100 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:51.060100 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:51.060100 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:51.060100 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:51.060100 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:51.060100 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:51.060100 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:51.060100 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:51.061204 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 09:15:51.061204 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 09:15:51.061204 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 09:15:51.061204 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 09:15:51.061204 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 09:15:51.061204 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 09:15:51.061204 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:15:51.061204 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:51.061757 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 418/827] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:15:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:51.067124 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b842fa-24b2-4dd4-b7c7-2f7129c9aa09 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:51.074818 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:51.194411 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb4178-9410-40c2-8213-e87b8807696e None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:51.197788 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:51.209325 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b842fa-24b2-4dd4-b7c7-2f7129c9aa09 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:51.244687 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf04d87-711c-4ed8-8372-462e41bdf8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:51.246217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf04d87-711c-4ed8-8372-462e41bdf8ec None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:51.252822 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf04d87-711c-4ed8-8372-462e41bdf8ec None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:51.254277 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf04d87-711c-4ed8-8372-462e41bdf8ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:51.262890 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf04d87-711c-4ed8-8372-462e41bdf8ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:51.264589 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf04d87-711c-4ed8-8372-462e41bdf8ec None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:51.264981 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0ed57-78f4-474b-88d8-09cf255c0226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:51.265775 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0ed57-78f4-474b-88d8-09cf255c0226 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:51.266162 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0ed57-78f4-474b-88d8-09cf255c0226 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:51.266541 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0ed57-78f4-474b-88d8-09cf255c0226 None admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:51.267630 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0ed57-78f4-474b-88d8-09cf255c0226 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:51.268043 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0ed57-78f4-474b-88d8-09cf255c0226 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:51.270598 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0ed57-78f4-474b-88d8-09cf255c0226 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:51.281681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-acf04d87-711c-4ed8-8372-462e41bdf8ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:15:51.281681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:51.281681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:51.281681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:51.281681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:51.281681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:51.281681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:51.281681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:51.281681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:51.281681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:51.281681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:51.281681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:51.281681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 09:15:51.281681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 09:15:51.281681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 09:15:51.282694 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 09:15:51.282694 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:51.282694 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:51.282694 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:51.282694 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:51.282694 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:51.282694 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:51.282694 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:51.282694 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:51.282694 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:51.282694 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:51.282694 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:51.282694 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:51.282694 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:51.282694 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:51.282694 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:51.282694 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:51.283795 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 09:15:51.283795 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 09:15:51.283795 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 09:15:51.283795 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 09:15:51.283795 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 09:15:51.283795 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 09:15:51.283795 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:15:51.283795 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:51.286014 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 410/828] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:15:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 09:15:51.287699 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 419/829] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Jun 27 09:15:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:51.293087 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf04d87-711c-4ed8-8372-462e41bdf8ec None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:51.294213 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0ed57-78f4-474b-88d8-09cf255c0226 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:51.373914 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:51.415995 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0ed57-78f4-474b-88d8-09cf255c0226 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:51.426947 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf04d87-711c-4ed8-8372-462e41bdf8ec None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:51.454187 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398eaaaf-8bbc-4954-858a-0970eb4f412b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:51.454904 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398eaaaf-8bbc-4954-858a-0970eb4f412b None admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:51.455289 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398eaaaf-8bbc-4954-858a-0970eb4f412b None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:51.455667 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398eaaaf-8bbc-4954-858a-0970eb4f412b None admin] PATH_INFO: `/v3/projects/4ba8e40538db4d89b93469b79322d20e/users/8f5d1f2327914f9fb070c6212582b6dc/roles/197a0da3099d45e4bcb9233039c21d8f` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:51.472320 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398eaaaf-8bbc-4954-858a-0970eb4f412b None admin] RBAC: Authorizing `identity:create_grant(project_id=4ba8e40538db4d89b93469b79322d20e, user_id=8f5d1f2327914f9fb070c6212582b6dc, role_id=197a0da3099d45e4bcb9233039c21d8f)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:51.473204 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c778d49c-302c-4fd8-8e58-669fbc47bde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:51.473984 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398eaaaf-8bbc-4954-858a-0970eb4f412b None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:51.474223 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778d49c-302c-4fd8-8e58-669fbc47bde2 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:51.474649 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778d49c-302c-4fd8-8e58-669fbc47bde2 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:51.475067 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778d49c-302c-4fd8-8e58-669fbc47bde2 None admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:51.476019 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c778d49c-302c-4fd8-8e58-669fbc47bde2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:51.476519 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c778d49c-302c-4fd8-8e58-669fbc47bde2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:51.479117 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c778d49c-302c-4fd8-8e58-669fbc47bde2 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:51.496269 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 411/830] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Jun 27 09:15:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:51.498323 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c778d49c-302c-4fd8-8e58-669fbc47bde2 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:51.526761 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:51.583387 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 420/831] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Jun 27 09:15:51 2022] PUT /identity/v3/projects/4ba8e40538db4d89b93469b79322d20e/users/8f5d1f2327914f9fb070c6212582b6dc/roles/197a0da3099d45e4bcb9233039c21d8f => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:15:51.615013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c778d49c-302c-4fd8-8e58-669fbc47bde2 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:51.619474 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbf595-2c01-4558-a949-1e817ab244ad None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:51.619783 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbf595-2c01-4558-a949-1e817ab244ad None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:51.620023 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbf595-2c01-4558-a949-1e817ab244ad None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:51.621787 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 421/832] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:15:51.627983 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c737d-fa19-4914-852f-18613c2e8c4d None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:51.628328 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c737d-fa19-4914-852f-18613c2e8c4d None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:51.628635 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c737d-fa19-4914-852f-18613c2e8c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:51.654798 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-466c737d-fa19-4914-852f-18613c2e8c4d None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:51.656652 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-466c737d-fa19-4914-852f-18613c2e8c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:51.742858 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 422/833] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:51 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 09:15:51.763987 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c737d-fa19-4914-852f-18613c2e8c4d None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:51.797896 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52af0cd-e053-4c42-9806-baa4bc20b109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:51.798551 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52af0cd-e053-4c42-9806-baa4bc20b109 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:51.798831 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52af0cd-e053-4c42-9806-baa4bc20b109 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:51.799101 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52af0cd-e053-4c42-9806-baa4bc20b109 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:51.799924 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52af0cd-e053-4c42-9806-baa4bc20b109 None admin] RBAC: Adding query filter params (role.id=91c77942515d45f1ad8189c9fddf4424, scope.project.id=4ba8e40538db4d89b93469b79322d20e, user.id=2c1434a85b30411c9c59cc50c3980cd8) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:51.800314 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52af0cd-e053-4c42-9806-baa4bc20b109 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:51.802573 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52af0cd-e053-4c42-9806-baa4bc20b109 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:51.812292 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 412/834] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Jun 27 09:15:51 2022] GET /identity/v3/role_assignments?user.id=2c1434a85b30411c9c59cc50c3980cd8&scope.project.id=4ba8e40538db4d89b93469b79322d20e&role.id=91c77942515d45f1ad8189c9fddf4424 => generated 608 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:15:51.822078 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:51.893671 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c737d-fa19-4914-852f-18613c2e8c4d None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:51.933897 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f799f-e235-462f-b827-426b941adf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:51.934696 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f799f-e235-462f-b827-426b941adf43 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:51.934974 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f799f-e235-462f-b827-426b941adf43 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:51.935245 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f799f-e235-462f-b827-426b941adf43 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:51.947604 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f799f-e235-462f-b827-426b941adf43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:15:51.955511 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-6f4f799f-e235-462f-b827-426b941adf43 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:15:51.955511 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:51.955511 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:51.955511 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:51.955511 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:51.955511 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:51.955511 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:51.955511 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:51.955511 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:51.955511 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:51.955511 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:51.955511 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:51.955511 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:15:51.955511 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:15:51.955511 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:15:51.955511 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:15:51.956571 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:15:51.956571 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:15:51.956571 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:15:51.956571 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:15:51.956571 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:51.956571 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:51.956571 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:51.956571 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:51.956571 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:51.956571 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:51.956571 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:51.956571 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:51.956571 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:51.956571 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:51.956571 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:51.956571 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:51.957459 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:51.957459 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:51.957459 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:51.957459 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:51.957459 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:15:51.957459 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:15:51.957459 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:15:51.957459 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:15:51.957459 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:15:51.957459 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:15:51.957459 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:15:51.957459 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:51.957459 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 423/835] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Jun 27 09:15:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 09:15:51.964851 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52af0cd-e053-4c42-9806-baa4bc20b109 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:52.068265 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:52.081486 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52af0cd-e053-4c42-9806-baa4bc20b109 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:52.122567 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c2d61-8e2c-4fe9-a8ae-93d2e36812b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:52.123245 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c2d61-8e2c-4fe9-a8ae-93d2e36812b0 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:52.123521 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c2d61-8e2c-4fe9-a8ae-93d2e36812b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:52.123792 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c2d61-8e2c-4fe9-a8ae-93d2e36812b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:52.124571 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4c2d61-8e2c-4fe9-a8ae-93d2e36812b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:52.124875 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4c2d61-8e2c-4fe9-a8ae-93d2e36812b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:52.126232 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4c2d61-8e2c-4fe9-a8ae-93d2e36812b0 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:52.135524 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 413/836] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:15:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:52.141280 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f799f-e235-462f-b827-426b941adf43 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:52.250852 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f799f-e235-462f-b827-426b941adf43 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:52.253214 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:52.286033 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1731b22-81cd-4515-91f3-ccedd77b28f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:52.286831 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1731b22-81cd-4515-91f3-ccedd77b28f5 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:52.287174 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1731b22-81cd-4515-91f3-ccedd77b28f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:52.287448 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1731b22-81cd-4515-91f3-ccedd77b28f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:52.298388 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1731b22-81cd-4515-91f3-ccedd77b28f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:52.299842 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1731b22-81cd-4515-91f3-ccedd77b28f5 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:52.322438 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-f1731b22-81cd-4515-91f3-ccedd77b28f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:52.322438 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:52.322438 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:52.322438 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:52.322438 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:52.322438 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:52.322438 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:52.322438 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:52.322438 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:52.322438 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:52.322438 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:52.322438 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:52.322438 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:52.322438 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:52.322438 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:52.323372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:52.323372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:52.323372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:52.323372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:52.323372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:52.323372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:52.323372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:52.323372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:52.323372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:52.323372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:52.323372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:52.323372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:52.323372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:52.323372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:52.323372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:52.323372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:52.323372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:52.324306 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:52.324306 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:52.324306 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:52.324306 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:52.324306 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 424/837] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:52.330610 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c2d61-8e2c-4fe9-a8ae-93d2e36812b0 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:52.442618 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c2d61-8e2c-4fe9-a8ae-93d2e36812b0 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:52.476310 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d124e81-25a7-48c7-a717-9f3c826c3fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:52.476972 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d124e81-25a7-48c7-a717-9f3c826c3fab None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:52.477251 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d124e81-25a7-48c7-a717-9f3c826c3fab None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:52.477524 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d124e81-25a7-48c7-a717-9f3c826c3fab None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:52.478239 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d124e81-25a7-48c7-a717-9f3c826c3fab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:52.478543 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d124e81-25a7-48c7-a717-9f3c826c3fab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:52.479951 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d124e81-25a7-48c7-a717-9f3c826c3fab None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:52.492687 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 414/838] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:52.498052 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1731b22-81cd-4515-91f3-ccedd77b28f5 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:52.605636 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1731b22-81cd-4515-91f3-ccedd77b28f5 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:52.641019 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b38ca-b297-43ae-b87e-9a7b0b26c648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:52.641824 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b38ca-b297-43ae-b87e-9a7b0b26c648 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:52.642104 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b38ca-b297-43ae-b87e-9a7b0b26c648 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:52.642373 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b38ca-b297-43ae-b87e-9a7b0b26c648 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:52.652000 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b38ca-b297-43ae-b87e-9a7b0b26c648 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:52.653467 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b38ca-b297-43ae-b87e-9a7b0b26c648 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:52.668605 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-e92b38ca-b297-43ae-b87e-9a7b0b26c648 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 27 09:15:52.668605 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:52.668605 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:52.668605 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:52.668605 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:52.668605 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:52.668605 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:52.668605 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:52.668605 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:52.668605 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:52.668605 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:52.668605 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:52.668605 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 09:15:52.668605 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 09:15:52.668605 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 09:15:52.668605 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 09:15:52.669609 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:52.669609 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:52.669609 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 09:15:52.669609 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:15:52.669609 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 09:15:52.669609 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:15:52.669609 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:52.669609 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:52.669609 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:52.669609 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:52.669609 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:52.669609 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:52.669609 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:52.669609 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:52.669609 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:52.669609 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:52.669609 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:52.669609 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:52.670582 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:52.670582 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:52.670582 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 09:15:52.670582 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 09:15:52.670582 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 09:15:52.670582 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 09:15:52.670582 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 09:15:52.670582 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 09:15:52.670582 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 27 09:15:52.670582 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:52.670582 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 425/839] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Jun 27 09:15:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:52.678016 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d124e81-25a7-48c7-a717-9f3c826c3fab None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:52.696022 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:52.792743 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d124e81-25a7-48c7-a717-9f3c826c3fab None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:52.828544 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f6990-bba2-42ad-be7a-40a3d92141e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:52.829214 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f6990-bba2-42ad-be7a-40a3d92141e1 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:52.829495 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f6990-bba2-42ad-be7a-40a3d92141e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:52.829770 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f6990-bba2-42ad-be7a-40a3d92141e1 None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:52.830602 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f6990-bba2-42ad-be7a-40a3d92141e1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:52.830911 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f6990-bba2-42ad-be7a-40a3d92141e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:52.832390 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f6990-bba2-42ad-be7a-40a3d92141e1 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:52.851407 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 415/840] 10.222.0.62 () {56 vars in 1135 bytes} [Mon Jun 27 09:15:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:52.857066 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b38ca-b297-43ae-b87e-9a7b0b26c648 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:52.876558 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:52.965074 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b38ca-b297-43ae-b87e-9a7b0b26c648 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:53.001996 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9d084-b6cd-46e6-81fa-d2b5fee5b64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:53.003143 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9d084-b6cd-46e6-81fa-d2b5fee5b64a None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:53.003675 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9d084-b6cd-46e6-81fa-d2b5fee5b64a None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:53.004161 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9d084-b6cd-46e6-81fa-d2b5fee5b64a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:53.025279 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18f70c-a65f-4692-83fd-90200a06d209 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:53.025580 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18f70c-a65f-4692-83fd-90200a06d209 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:53.026091 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18f70c-a65f-4692-83fd-90200a06d209 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:53.027779 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 416/841] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 09:15:53.032970 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd47026-77c3-47cc-96ea-d57cb7e2de1f None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:53.033382 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd47026-77c3-47cc-96ea-d57cb7e2de1f None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:53.034014 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd47026-77c3-47cc-96ea-d57cb7e2de1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:53.055484 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-5bd47026-77c3-47cc-96ea-d57cb7e2de1f None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:53.057118 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-5bd47026-77c3-47cc-96ea-d57cb7e2de1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:53.082794 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c9d084-b6cd-46e6-81fa-d2b5fee5b64a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:53.084273 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c9d084-b6cd-46e6-81fa-d2b5fee5b64a None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:53.116622 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:53.140330 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:53.152012 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 417/842] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:53 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 09:15:53.176365 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd47026-77c3-47cc-96ea-d57cb7e2de1f None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:53.210243 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 426/843] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:15:52 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 09:15:53.215878 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9d084-b6cd-46e6-81fa-d2b5fee5b64a None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:53.310609 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd47026-77c3-47cc-96ea-d57cb7e2de1f None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:53.322207 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9d084-b6cd-46e6-81fa-d2b5fee5b64a None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:53.339511 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:53.349211 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f192abc-6a5c-43b5-aa21-a86ed6e47869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:53.350303 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f192abc-6a5c-43b5-aa21-a86ed6e47869 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:53.350810 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f192abc-6a5c-43b5-aa21-a86ed6e47869 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:53.351342 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f192abc-6a5c-43b5-aa21-a86ed6e47869 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:53.352247 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f192abc-6a5c-43b5-aa21-a86ed6e47869 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:53.353819 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f192abc-6a5c-43b5-aa21-a86ed6e47869 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:53.358757 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c0e114-b04d-49a0-9060-32dc055caf6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:53.359472 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0e114-b04d-49a0-9060-32dc055caf6d None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:53.359751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0e114-b04d-49a0-9060-32dc055caf6d None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:53.360023 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0e114-b04d-49a0-9060-32dc055caf6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:53.368230 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-9f192abc-6a5c-43b5-aa21-a86ed6e47869 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 27 09:15:53.368230 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:53.368230 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 09:15:53.368230 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 09:15:53.368230 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 09:15:53.368230 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 09:15:53.368230 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 09:15:53.368230 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 09:15:53.368230 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 27 09:15:53.368230 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:53.368230 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 09:15:53.368230 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:53.368230 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:53.368230 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:53.368230 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:53.368230 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:53.368230 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:53.369222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:53.369222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:53.369222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:53.369222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:53.369222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:53.369222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:53.369222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 09:15:53.369222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 09:15:53.369222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 09:15:53.369222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 09:15:53.369222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:53.369222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:53.369222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:53.369222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:53.369222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:53.369222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:53.370048 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:53.370048 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:53.370048 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:53.370048 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:53.370048 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:53.370048 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:53.370048 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:53.370048 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:53.370048 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:53.370048 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:53.370048 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 09:15:53.370048 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 09:15:53.370048 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 27 09:15:53.370048 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:53.371779 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c0e114-b04d-49a0-9060-32dc055caf6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:53.378019 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c0e114-b04d-49a0-9060-32dc055caf6d None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:53.378145 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 418/844] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Jun 27 09:15:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 09:15:53.378753 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f192abc-6a5c-43b5-aa21-a86ed6e47869 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:53.401498 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-93c0e114-b04d-49a0-9060-32dc055caf6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:53.401498 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:53.401498 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:53.401498 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:53.401498 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:53.401498 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:53.401498 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:53.401498 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:53.401498 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:53.401498 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:53.401498 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:53.401498 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:53.401498 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:53.401498 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:53.401498 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:53.402445 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:53.402445 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:53.402445 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:53.402445 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:53.402445 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:53.402445 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:53.402445 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:53.402445 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:53.402445 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:53.402445 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:53.402445 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:53.402445 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:53.402445 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:53.402445 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:53.402445 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:53.402445 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:53.402445 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:53.403327 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:53.403327 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:53.403327 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:53.403327 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:53.410671 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 427/845] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 09:15:53.412284 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c0e114-b04d-49a0-9060-32dc055caf6d None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:53.458613 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:53.501461 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f192abc-6a5c-43b5-aa21-a86ed6e47869 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:53.524752 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c0e114-b04d-49a0-9060-32dc055caf6d None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:53.539930 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719aedeb-b429-421b-9a32-d1091ab286fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:53.540961 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719aedeb-b429-421b-9a32-d1091ab286fa None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:53.541475 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719aedeb-b429-421b-9a32-d1091ab286fa None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:53.541965 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719aedeb-b429-421b-9a32-d1091ab286fa None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:53.542875 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719aedeb-b429-421b-9a32-d1091ab286fa None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:53.543402 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719aedeb-b429-421b-9a32-d1091ab286fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:53.545061 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719aedeb-b429-421b-9a32-d1091ab286fa None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:53.555124 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 419/846] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Jun 27 09:15:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:15:53.556370 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719aedeb-b429-421b-9a32-d1091ab286fa None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:53.562840 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695bb02-8793-4c7c-bdb2-919edddcb5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:53.563566 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695bb02-8793-4c7c-bdb2-919edddcb5c1 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:53.563846 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695bb02-8793-4c7c-bdb2-919edddcb5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:53.564166 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695bb02-8793-4c7c-bdb2-919edddcb5c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:53.564929 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0695bb02-8793-4c7c-bdb2-919edddcb5c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:53.565238 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0695bb02-8793-4c7c-bdb2-919edddcb5c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:53.567320 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0695bb02-8793-4c7c-bdb2-919edddcb5c1 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:53.585484 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 428/847] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:53.587930 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695bb02-8793-4c7c-bdb2-919edddcb5c1 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:53.616878 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:53.673580 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719aedeb-b429-421b-9a32-d1091ab286fa None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:53.695923 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695bb02-8793-4c7c-bdb2-919edddcb5c1 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:53.701807 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:53.711465 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d28e60-6af4-40cd-9c15-4f526bae5864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:53.728360 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d28e60-6af4-40cd-9c15-4f526bae5864 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:53.728360 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d28e60-6af4-40cd-9c15-4f526bae5864 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:53.728360 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d28e60-6af4-40cd-9c15-4f526bae5864 None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:53.728360 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d28e60-6af4-40cd-9c15-4f526bae5864 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:53.728360 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d28e60-6af4-40cd-9c15-4f526bae5864 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:53.728360 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d28e60-6af4-40cd-9c15-4f526bae5864 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:53.729398 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 420/848] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Jun 27 09:15:53 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:53.731459 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a811e66-8d19-4a01-8da2-16f721364cc6 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:53.732110 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a811e66-8d19-4a01-8da2-16f721364cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:53.732634 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a811e66-8d19-4a01-8da2-16f721364cc6 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:53.733955 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43f461-04ee-4877-86e2-d2d78cbc282f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:53.734825 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43f461-04ee-4877-86e2-d2d78cbc282f None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:53.735193 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43f461-04ee-4877-86e2-d2d78cbc282f None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:53.735390 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 421/849] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:15:53.735617 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43f461-04ee-4877-86e2-d2d78cbc282f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:53.741088 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345f513-a793-4447-b9ee-6f7a8c7ea519 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:53.741410 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345f513-a793-4447-b9ee-6f7a8c7ea519 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:53.741651 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345f513-a793-4447-b9ee-6f7a8c7ea519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:53.747422 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f43f461-04ee-4877-86e2-d2d78cbc282f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:53.748940 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f43f461-04ee-4877-86e2-d2d78cbc282f None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:53.759846 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-1345f513-a793-4447-b9ee-6f7a8c7ea519 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:53.761184 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-1345f513-a793-4447-b9ee-6f7a8c7ea519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:53.764162 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-7f43f461-04ee-4877-86e2-d2d78cbc282f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:15:53.764162 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:53.764162 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:53.764162 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:53.764162 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:53.764162 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:53.764162 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:53.764162 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:53.764162 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:53.764162 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:53.764162 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:53.764162 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:53.764162 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 09:15:53.764162 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 09:15:53.764162 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 09:15:53.765087 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 09:15:53.765087 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:53.765087 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:53.765087 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:53.765087 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:53.765087 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:53.765087 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:53.765087 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:53.765087 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:53.765087 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:53.765087 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:53.765087 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:53.765087 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:53.765087 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:53.765087 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:53.765087 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:53.765087 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:53.765976 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 09:15:53.765976 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 09:15:53.765976 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 09:15:53.765976 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 09:15:53.765976 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 09:15:53.765976 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 09:15:53.765976 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:15:53.765976 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:53.765976 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 429/850] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:15:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:53.771849 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43f461-04ee-4877-86e2-d2d78cbc282f None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:53.849107 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 422/851] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:53 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 09:15:53.865788 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345f513-a793-4447-b9ee-6f7a8c7ea519 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:53.873513 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:53.887219 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43f461-04ee-4877-86e2-d2d78cbc282f None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:53.925675 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af08ac3-0adc-4d77-bd50-de148df9983c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:53.926261 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af08ac3-0adc-4d77-bd50-de148df9983c None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:53.926540 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af08ac3-0adc-4d77-bd50-de148df9983c None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:53.926817 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af08ac3-0adc-4d77-bd50-de148df9983c None admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:53.927604 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af08ac3-0adc-4d77-bd50-de148df9983c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:53.927912 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af08ac3-0adc-4d77-bd50-de148df9983c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:53.929623 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af08ac3-0adc-4d77-bd50-de148df9983c None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:53.946981 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 430/852] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Jun 27 09:15:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:15:53.948673 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af08ac3-0adc-4d77-bd50-de148df9983c None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:53.982060 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345f513-a793-4447-b9ee-6f7a8c7ea519 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:54.004236 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:54.019992 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc835a6-f780-4cf1-bb6f-3df5eb4dee6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:54.021260 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc835a6-f780-4cf1-bb6f-3df5eb4dee6d None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:54.021770 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc835a6-f780-4cf1-bb6f-3df5eb4dee6d None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:54.022291 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc835a6-f780-4cf1-bb6f-3df5eb4dee6d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:54.035018 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc835a6-f780-4cf1-bb6f-3df5eb4dee6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:15:54.043683 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-2fc835a6-f780-4cf1-bb6f-3df5eb4dee6d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 09:15:54.043683 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:54.043683 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:54.043683 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:54.043683 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:54.043683 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:54.043683 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:54.043683 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:54.043683 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:54.043683 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:54.043683 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:54.043683 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:54.043683 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:15:54.043683 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:15:54.043683 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:15:54.043683 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:15:54.044674 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:15:54.044674 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:15:54.044674 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:15:54.044674 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:15:54.044674 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:54.044674 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:54.044674 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:54.044674 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:54.044674 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:54.044674 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:54.044674 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:54.044674 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:54.044674 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:54.044674 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:54.044674 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:54.044674 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:54.045522 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:54.045522 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:54.045522 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:54.045522 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:54.045522 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:15:54.045522 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:15:54.045522 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:15:54.045522 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:15:54.045522 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:15:54.045522 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:15:54.045522 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 09:15:54.045522 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:54.053560 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 423/853] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Jun 27 09:15:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 09:15:54.053873 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af08ac3-0adc-4d77-bd50-de148df9983c None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:54.055437 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc835a6-f780-4cf1-bb6f-3df5eb4dee6d None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:54.090922 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c960411-4077-40c1-ae96-be7d43fce875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:54.091573 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c960411-4077-40c1-ae96-be7d43fce875 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:54.091853 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c960411-4077-40c1-ae96-be7d43fce875 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:54.092154 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c960411-4077-40c1-ae96-be7d43fce875 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:54.093024 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c960411-4077-40c1-ae96-be7d43fce875 None admin] RBAC: Adding query filter params (role.id=91c77942515d45f1ad8189c9fddf4424, scope.project.id=4ba8e40538db4d89b93469b79322d20e, user.id=f5477b14dae24fd3a644c9cbd6ff85ec) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:54.093333 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c960411-4077-40c1-ae96-be7d43fce875 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:54.094753 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c960411-4077-40c1-ae96-be7d43fce875 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:54.100797 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 431/854] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Jun 27 09:15:53 2022] GET /identity/v3/role_assignments?user.id=f5477b14dae24fd3a644c9cbd6ff85ec&scope.project.id=4ba8e40538db4d89b93469b79322d20e&role.id=91c77942515d45f1ad8189c9fddf4424 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:15:54.105689 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a8e9e-516b-461d-90b9-95b349040418 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:54.105966 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a8e9e-516b-461d-90b9-95b349040418 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:54.106239 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a8e9e-516b-461d-90b9-95b349040418 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:54.107697 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 432/855] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:15:54.114707 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070c5e6-265e-4f5f-985c-2329f0a719db None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:54.114707 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070c5e6-265e-4f5f-985c-2329f0a719db None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:54.114857 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070c5e6-265e-4f5f-985c-2329f0a719db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:54.141270 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-c070c5e6-265e-4f5f-985c-2329f0a719db None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:54.142490 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-c070c5e6-265e-4f5f-985c-2329f0a719db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:54.152695 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:54.202292 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc835a6-f780-4cf1-bb6f-3df5eb4dee6d None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:54.236382 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 433/856] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:54 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 09:15:54.245245 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc0a9c9-07ca-486c-8bed-4951d3fc3746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:54.246187 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0a9c9-07ca-486c-8bed-4951d3fc3746 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:54.246646 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0a9c9-07ca-486c-8bed-4951d3fc3746 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:54.247066 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0a9c9-07ca-486c-8bed-4951d3fc3746 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:54.248011 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc0a9c9-07ca-486c-8bed-4951d3fc3746 None admin] RBAC: Adding query filter params (name=service) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:54.248542 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc0a9c9-07ca-486c-8bed-4951d3fc3746 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:54.250151 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc0a9c9-07ca-486c-8bed-4951d3fc3746 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:54.258208 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070c5e6-265e-4f5f-985c-2329f0a719db None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:54.261635 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 424/857] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Jun 27 09:15:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:54.268626 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc0a9c9-07ca-486c-8bed-4951d3fc3746 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:54.326754 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:54.388069 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070c5e6-265e-4f5f-985c-2329f0a719db None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:54.391098 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc0a9c9-07ca-486c-8bed-4951d3fc3746 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:54.428591 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad051d-d41a-48fe-88d6-2e4b0a85d4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:54.429732 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad051d-d41a-48fe-88d6-2e4b0a85d4c4 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:54.430212 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad051d-d41a-48fe-88d6-2e4b0a85d4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:54.430790 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad051d-d41a-48fe-88d6-2e4b0a85d4c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:54.434527 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b3393-6045-47c5-bf4a-3902cfa5893e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:54.435345 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b3393-6045-47c5-bf4a-3902cfa5893e None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:54.435630 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b3393-6045-47c5-bf4a-3902cfa5893e None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:54.435908 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b3393-6045-47c5-bf4a-3902cfa5893e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:54.436608 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b3393-6045-47c5-bf4a-3902cfa5893e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:54.437991 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b3393-6045-47c5-bf4a-3902cfa5893e None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:54.444655 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acad051d-d41a-48fe-88d6-2e4b0a85d4c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:54.446372 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acad051d-d41a-48fe-88d6-2e4b0a85d4c4 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:54.453955 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-081b3393-6045-47c5-bf4a-3902cfa5893e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 27 09:15:54.453955 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:54.453955 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 09:15:54.453955 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 09:15:54.453955 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 09:15:54.453955 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 09:15:54.453955 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 09:15:54.453955 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 09:15:54.453955 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 27 09:15:54.453955 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:54.453955 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 09:15:54.453955 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:54.453955 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:54.453955 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:54.453955 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:54.453955 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:54.454894 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:54.454894 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:54.454894 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:54.454894 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:54.454894 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:54.454894 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:54.454894 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:54.454894 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 09:15:54.454894 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 09:15:54.454894 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 09:15:54.454894 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 09:15:54.454894 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:54.454894 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:54.454894 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:54.454894 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:54.454894 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:54.460985 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:54.460985 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:54.460985 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:54.460985 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:54.460985 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:54.460985 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:54.460985 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:54.460985 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:54.460985 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:54.460985 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:54.460985 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:54.460985 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 09:15:54.460985 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 09:15:54.460985 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 27 09:15:54.460985 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:54.460985 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 434/858] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Jun 27 09:15:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 09:15:54.463751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b3393-6045-47c5-bf4a-3902cfa5893e None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:54.468893 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-acad051d-d41a-48fe-88d6-2e4b0a85d4c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:54.468893 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:54.468893 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:54.468893 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:54.468893 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:54.468893 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:54.468893 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:54.468893 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:54.468893 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:54.468893 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:54.468893 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:54.468893 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:54.468893 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:54.468893 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:54.468893 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:54.469805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:54.469805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:54.469805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:54.469805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:54.469805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:54.469805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:54.469805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:54.469805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:54.469805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:54.469805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:54.469805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:54.469805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:54.469805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:54.469805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:54.469805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:54.469805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:54.469805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:54.470705 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:54.470705 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:54.470705 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:54.470705 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:54.470705 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 425/859] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:54.476703 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad051d-d41a-48fe-88d6-2e4b0a85d4c4 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:54.477221 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:54.588240 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b3393-6045-47c5-bf4a-3902cfa5893e None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:54.601172 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:54.611173 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad051d-d41a-48fe-88d6-2e4b0a85d4c4 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:54.629675 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa78d89-e376-4dfe-a874-86762d46f3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:54.631068 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa78d89-e376-4dfe-a874-86762d46f3e9 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:54.632106 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa78d89-e376-4dfe-a874-86762d46f3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:54.633541 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa78d89-e376-4dfe-a874-86762d46f3e9 None admin] PATH_INFO: `/v3/services` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:54.634489 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa78d89-e376-4dfe-a874-86762d46f3e9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:54.635007 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa78d89-e376-4dfe-a874-86762d46f3e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:54.637445 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa78d89-e376-4dfe-a874-86762d46f3e9 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:54.645578 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 435/860] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Jun 27 09:15:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:15:54.650772 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa78d89-e376-4dfe-a874-86762d46f3e9 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:54.657173 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf2297-fbca-430e-9f05-b0f23813565d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:54.658032 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf2297-fbca-430e-9f05-b0f23813565d None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:54.658482 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf2297-fbca-430e-9f05-b0f23813565d None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:54.658904 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf2297-fbca-430e-9f05-b0f23813565d None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:54.659835 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf2297-fbca-430e-9f05-b0f23813565d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:54.660331 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf2297-fbca-430e-9f05-b0f23813565d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:54.662446 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf2297-fbca-430e-9f05-b0f23813565d None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:54.684153 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 426/861] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:15:54.684961 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf2297-fbca-430e-9f05-b0f23813565d None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:54.744469 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:54.789852 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa78d89-e376-4dfe-a874-86762d46f3e9 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:54.805105 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf2297-fbca-430e-9f05-b0f23813565d None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:54.838364 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de2338-b71f-4472-84a0-b9b201b9147b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:54.839480 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de2338-b71f-4472-84a0-b9b201b9147b None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:54.840120 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de2338-b71f-4472-84a0-b9b201b9147b None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:54.840689 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de2338-b71f-4472-84a0-b9b201b9147b None admin] PATH_INFO: `/v3/services` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:54.841757 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00de2338-b71f-4472-84a0-b9b201b9147b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:54.842318 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00de2338-b71f-4472-84a0-b9b201b9147b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:54.842718 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad256f-edf2-46ba-88eb-b8796d773600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:54.843629 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad256f-edf2-46ba-88eb-b8796d773600 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:54.844022 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad256f-edf2-46ba-88eb-b8796d773600 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:54.844442 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad256f-edf2-46ba-88eb-b8796d773600 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:54.844571 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00de2338-b71f-4472-84a0-b9b201b9147b None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:54.851239 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 436/862] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Jun 27 09:15:54 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:15:54.854390 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bad256f-edf2-46ba-88eb-b8796d773600 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:54.856161 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bad256f-edf2-46ba-88eb-b8796d773600 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:54.873911 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-7bad256f-edf2-46ba-88eb-b8796d773600 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 09:15:54.873911 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:54.873911 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:54.873911 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:54.873911 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:54.873911 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:54.873911 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:54.873911 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:54.873911 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:54.873911 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:54.873911 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:54.873911 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:54.873911 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 09:15:54.873911 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 09:15:54.873911 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 09:15:54.873911 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 09:15:54.875164 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:54.875164 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:54.875164 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 09:15:54.875164 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:15:54.875164 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 09:15:54.875164 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:15:54.875164 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:54.875164 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:54.875164 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:54.875164 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:54.875164 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:54.875164 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:54.875164 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:54.875164 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:54.875164 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:54.875164 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:54.875164 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:54.875164 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:54.876190 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:54.876190 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:54.876190 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 09:15:54.876190 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 09:15:54.876190 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 09:15:54.876190 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 09:15:54.876190 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 09:15:54.876190 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 09:15:54.876190 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 09:15:54.876190 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:54.879062 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 427/863] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Jun 27 09:15:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 09:15:54.885218 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de2338-b71f-4472-84a0-b9b201b9147b None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:55.005925 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de2338-b71f-4472-84a0-b9b201b9147b None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:55.043276 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db28100d-29cd-435d-a637-b2ebbae06acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:55.044341 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28100d-29cd-435d-a637-b2ebbae06acf None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:55.044825 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28100d-29cd-435d-a637-b2ebbae06acf None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:55.045292 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28100d-29cd-435d-a637-b2ebbae06acf None admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:55.046337 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db28100d-29cd-435d-a637-b2ebbae06acf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:55.046836 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db28100d-29cd-435d-a637-b2ebbae06acf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:55.048473 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db28100d-29cd-435d-a637-b2ebbae06acf None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:55.064617 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:55.067566 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 437/864] 10.222.0.62 () {56 vars in 1149 bytes} [Mon Jun 27 09:15:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:55.073217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad256f-edf2-46ba-88eb-b8796d773600 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:55.090461 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:55.178266 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad256f-edf2-46ba-88eb-b8796d773600 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:55.213645 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e1135-9f40-4c2f-898b-c250d55873bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:55.214290 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e1135-9f40-4c2f-898b-c250d55873bc None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:55.214571 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e1135-9f40-4c2f-898b-c250d55873bc None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:55.214851 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e1135-9f40-4c2f-898b-c250d55873bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:55.295429 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720e1135-9f40-4c2f-898b-c250d55873bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:55.296920 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720e1135-9f40-4c2f-898b-c250d55873bc None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:55.313005 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:55.408074 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 428/865] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:15:55 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 09:15:55.413822 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db28100d-29cd-435d-a637-b2ebbae06acf None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:55.518273 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db28100d-29cd-435d-a637-b2ebbae06acf None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:55.555314 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b45a8e-990e-461e-bd8f-c1ff54b87f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:55.556030 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b45a8e-990e-461e-bd8f-c1ff54b87f97 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:55.556342 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b45a8e-990e-461e-bd8f-c1ff54b87f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:55.556622 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b45a8e-990e-461e-bd8f-c1ff54b87f97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:55.568036 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b45a8e-990e-461e-bd8f-c1ff54b87f97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:55.569549 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b45a8e-990e-461e-bd8f-c1ff54b87f97 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:55.588231 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-77b45a8e-990e-461e-bd8f-c1ff54b87f97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:55.588231 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:55.588231 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:55.588231 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:55.588231 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:55.588231 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:55.588231 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:55.588231 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:55.588231 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:55.588231 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:55.588231 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:55.588231 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:55.588231 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:55.588231 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:55.588231 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:55.589206 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:55.589206 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:55.589206 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:55.589206 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:55.589206 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:55.589206 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:55.589206 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:55.589206 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:55.589206 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:55.589206 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:55.589206 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:55.589206 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:55.589206 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:55.589206 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:55.589206 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:55.589206 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:55.589206 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:55.590601 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:55.590601 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:55.590601 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:55.590601 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:55.590601 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 438/866] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:55.595391 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e1135-9f40-4c2f-898b-c250d55873bc None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:55.702288 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e1135-9f40-4c2f-898b-c250d55873bc None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:55.724868 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:55.737977 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d63bfe-043f-40a7-b0a0-73e41c6c14b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:55.738642 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d63bfe-043f-40a7-b0a0-73e41c6c14b3 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:55.738927 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d63bfe-043f-40a7-b0a0-73e41c6c14b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:55.739203 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d63bfe-043f-40a7-b0a0-73e41c6c14b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:55.740005 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d63bfe-043f-40a7-b0a0-73e41c6c14b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:55.740344 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d63bfe-043f-40a7-b0a0-73e41c6c14b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:55.741717 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d63bfe-043f-40a7-b0a0-73e41c6c14b3 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:55.754495 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 429/867] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:55.759991 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b45a8e-990e-461e-bd8f-c1ff54b87f97 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:55.808633 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:55.855946 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622f889-3ceb-4f7e-81d6-475c3e8c20c7 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:55.856267 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622f889-3ceb-4f7e-81d6-475c3e8c20c7 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:55.856549 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622f889-3ceb-4f7e-81d6-475c3e8c20c7 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:55.857912 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 430/868] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 09:15:55.863337 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff320d4-a096-4dea-90bb-9d39156e545d None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:55.863749 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff320d4-a096-4dea-90bb-9d39156e545d None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:55.864114 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff320d4-a096-4dea-90bb-9d39156e545d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:55.868275 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b45a8e-990e-461e-bd8f-c1ff54b87f97 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:55.882047 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-bff320d4-a096-4dea-90bb-9d39156e545d None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:55.883333 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-bff320d4-a096-4dea-90bb-9d39156e545d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:55.911125 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b83468-7e79-4063-a192-5665e2636ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:55.912225 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b83468-7e79-4063-a192-5665e2636ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:55.912505 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b83468-7e79-4063-a192-5665e2636ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:55.912783 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b83468-7e79-4063-a192-5665e2636ed4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:55.921900 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b83468-7e79-4063-a192-5665e2636ed4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:55.923357 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b83468-7e79-4063-a192-5665e2636ed4 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:55.942506 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-c8b83468-7e79-4063-a192-5665e2636ed4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:15:55.942506 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:55.942506 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:55.942506 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:55.942506 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:55.942506 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:55.942506 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:55.942506 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:55.942506 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:55.942506 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:55.942506 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:55.942506 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:55.942506 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 09:15:55.942506 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 09:15:55.942506 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 09:15:55.943417 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 09:15:55.943417 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:55.943417 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:55.943417 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:55.943417 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:55.943417 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:55.943417 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:55.943417 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:55.943417 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:55.943417 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:55.943417 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:55.943417 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:55.943417 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:55.943417 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:55.943417 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:55.943417 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:55.943417 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:55.944327 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 09:15:55.944327 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 09:15:55.944327 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 09:15:55.944327 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 09:15:55.944327 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 09:15:55.944327 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 09:15:55.944327 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:15:55.944327 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:55.948326 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 439/869] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:15:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:55.950357 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b83468-7e79-4063-a192-5665e2636ed4 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:55.964469 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 431/870] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:55 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 09:15:55.982373 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff320d4-a096-4dea-90bb-9d39156e545d None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:56.091931 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b83468-7e79-4063-a192-5665e2636ed4 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:56.095474 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:56.099635 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff320d4-a096-4dea-90bb-9d39156e545d None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:56.102851 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:56.137837 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa233665-bffd-4ffe-bbf4-15ff02176398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:56.144703 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa233665-bffd-4ffe-bbf4-15ff02176398 None admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:56.144703 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa233665-bffd-4ffe-bbf4-15ff02176398 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:56.144703 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa233665-bffd-4ffe-bbf4-15ff02176398 None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:56.144703 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa233665-bffd-4ffe-bbf4-15ff02176398 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:56.144703 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa233665-bffd-4ffe-bbf4-15ff02176398 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:56.145119 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400beef-aaf1-4391-99bf-2f027bbb3975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:56.145119 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400beef-aaf1-4391-99bf-2f027bbb3975 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:56.145119 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400beef-aaf1-4391-99bf-2f027bbb3975 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:56.145119 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400beef-aaf1-4391-99bf-2f027bbb3975 None admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:56.145405 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400beef-aaf1-4391-99bf-2f027bbb3975 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:56.146523 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400beef-aaf1-4391-99bf-2f027bbb3975 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:56.148077 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400beef-aaf1-4391-99bf-2f027bbb3975 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:56.161287 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 440/871] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Jun 27 09:15:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:56.166835 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400beef-aaf1-4391-99bf-2f027bbb3975 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:56.268672 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 432/872] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Jun 27 09:15:55 2022] POST /identity/v3/services => generated 251 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:15:56.279109 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400beef-aaf1-4391-99bf-2f027bbb3975 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:56.326531 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a74799-da1b-4aa5-bf96-1ff60fdfd7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:56.327253 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a74799-da1b-4aa5-bf96-1ff60fdfd7c0 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:56.327543 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a74799-da1b-4aa5-bf96-1ff60fdfd7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:56.327821 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a74799-da1b-4aa5-bf96-1ff60fdfd7c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:56.328701 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a74799-da1b-4aa5-bf96-1ff60fdfd7c0 None admin] RBAC: Adding query filter params (role.id=197a0da3099d45e4bcb9233039c21d8f, scope.project.id=4ba8e40538db4d89b93469b79322d20e, user.id=8f5d1f2327914f9fb070c6212582b6dc) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:56.329018 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a74799-da1b-4aa5-bf96-1ff60fdfd7c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:56.330509 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a74799-da1b-4aa5-bf96-1ff60fdfd7c0 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:56.335420 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a21d0-3169-4a16-b159-3b04fa0790fd None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:56.335706 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a21d0-3169-4a16-b159-3b04fa0790fd None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:56.335982 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a21d0-3169-4a16-b159-3b04fa0790fd None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:56.337711 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 433/873] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 09:15:56.338432 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 441/874] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Jun 27 09:15:56 2022] GET /identity/v3/role_assignments?user.id=8f5d1f2327914f9fb070c6212582b6dc&scope.project.id=4ba8e40538db4d89b93469b79322d20e&role.id=197a0da3099d45e4bcb9233039c21d8f => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:15:56.343468 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e443afe-676b-4d60-9048-ee4f41511449 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:56.343779 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e443afe-676b-4d60-9048-ee4f41511449 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:56.343942 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e443afe-676b-4d60-9048-ee4f41511449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:56.363445 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-6e443afe-676b-4d60-9048-ee4f41511449 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:56.364855 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-6e443afe-676b-4d60-9048-ee4f41511449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:56.452297 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 434/875] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:56 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 09:15:56.475411 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a74799-da1b-4aa5-bf96-1ff60fdfd7c0 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:56.509077 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:56.589392 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a74799-da1b-4aa5-bf96-1ff60fdfd7c0 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:56.627706 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855dbf50-be5f-425d-97c8-0d4200211fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:56.629010 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855dbf50-be5f-425d-97c8-0d4200211fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:56.629297 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855dbf50-be5f-425d-97c8-0d4200211fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:56.629573 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855dbf50-be5f-425d-97c8-0d4200211fc0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:56.630238 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855dbf50-be5f-425d-97c8-0d4200211fc0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:56.631628 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855dbf50-be5f-425d-97c8-0d4200211fc0 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:56.644701 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-855dbf50-be5f-425d-97c8-0d4200211fc0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 09:15:56.644701 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:56.644701 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 09:15:56.644701 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 09:15:56.644701 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 09:15:56.644701 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 09:15:56.644701 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 09:15:56.644701 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 09:15:56.644701 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 09:15:56.644701 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:56.644701 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 09:15:56.644701 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:56.644701 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:56.644701 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:56.644701 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:56.644701 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:56.644701 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:56.645803 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:56.645803 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:56.645803 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:56.645803 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:56.645803 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:56.645803 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:56.645803 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 09:15:56.645803 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 09:15:56.645803 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 09:15:56.645803 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 09:15:56.645803 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:56.645803 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:56.645803 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:56.645803 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:56.645803 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:56.645803 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:56.646646 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:56.646646 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:56.646646 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:56.646646 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:56.646646 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:56.646646 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:56.646646 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:56.646646 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:56.646646 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:56.646646 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:56.646646 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 09:15:56.646646 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 09:15:56.646646 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 09:15:56.646646 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:56.646646 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 442/876] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Jun 27 09:15:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:56.652567 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e443afe-676b-4d60-9048-ee4f41511449 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:56.751889 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:56.759153 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e443afe-676b-4d60-9048-ee4f41511449 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:56.794283 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac68cd-6e95-420d-ae95-432c06737f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:56.794952 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac68cd-6e95-420d-ae95-432c06737f76 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:56.795236 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac68cd-6e95-420d-ae95-432c06737f76 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:56.795512 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac68cd-6e95-420d-ae95-432c06737f76 None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:56.796262 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aac68cd-6e95-420d-ae95-432c06737f76 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:56.796578 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aac68cd-6e95-420d-ae95-432c06737f76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:56.800904 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aac68cd-6e95-420d-ae95-432c06737f76 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:56.803969 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 435/877] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Jun 27 09:15:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:56.809684 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855dbf50-be5f-425d-97c8-0d4200211fc0 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:56.903724 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:56.916892 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855dbf50-be5f-425d-97c8-0d4200211fc0 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:56.954620 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c4c9d-bdb7-4626-bb41-5edca0fa9ab5 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:56.954959 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c4c9d-bdb7-4626-bb41-5edca0fa9ab5 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:56.955175 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c4c9d-bdb7-4626-bb41-5edca0fa9ab5 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:56.955468 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c03c82-bcf5-4c1b-9750-12eb609aa4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:56.956412 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c03c82-bcf5-4c1b-9750-12eb609aa4eb None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:56.956919 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c03c82-bcf5-4c1b-9750-12eb609aa4eb None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:56.957415 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c03c82-bcf5-4c1b-9750-12eb609aa4eb None admin] PATH_INFO: `/v3/services` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:56.958347 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c03c82-bcf5-4c1b-9750-12eb609aa4eb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:56.958868 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c03c82-bcf5-4c1b-9750-12eb609aa4eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:56.960319 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 436/878] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:15:56.960782 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c03c82-bcf5-4c1b-9750-12eb609aa4eb None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:56.962089 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e30e4-eac1-4f85-b86d-2801faa2f494 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:56.962375 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e30e4-eac1-4f85-b86d-2801faa2f494 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:56.962659 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e30e4-eac1-4f85-b86d-2801faa2f494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:56.967115 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 443/879] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Jun 27 09:15:56 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:56.980952 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-d64e30e4-eac1-4f85-b86d-2801faa2f494 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:56.982165 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-d64e30e4-eac1-4f85-b86d-2801faa2f494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:57.068365 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 437/880] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:56 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 09:15:57.085300 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c03c82-bcf5-4c1b-9750-12eb609aa4eb None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:57.195884 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c03c82-bcf5-4c1b-9750-12eb609aa4eb None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:57.232534 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e6cd9-09b1-4648-aba6-1d769bcd39b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:57.233196 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e6cd9-09b1-4648-aba6-1d769bcd39b2 None admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:57.233472 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e6cd9-09b1-4648-aba6-1d769bcd39b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:57.233783 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e6cd9-09b1-4648-aba6-1d769bcd39b2 None admin] PATH_INFO: `/v3/services` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:57.234501 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e6cd9-09b1-4648-aba6-1d769bcd39b2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:57.235863 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e6cd9-09b1-4648-aba6-1d769bcd39b2 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:57.345846 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 444/881] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Jun 27 09:15:57 2022] POST /identity/v3/services => generated 269 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:15:58.490455 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c835e4-1681-4d0f-b54a-3c5f57c0d5f1 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:58.490455 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c835e4-1681-4d0f-b54a-3c5f57c0d5f1 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:58.490455 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c835e4-1681-4d0f-b54a-3c5f57c0d5f1 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:58.490455 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 438/882] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:15:58.492332 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04159e3-25b0-4698-9733-1d694c3b07a3 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:58.492717 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04159e3-25b0-4698-9733-1d694c3b07a3 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:58.492892 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04159e3-25b0-4698-9733-1d694c3b07a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:58.511633 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-f04159e3-25b0-4698-9733-1d694c3b07a3 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:58.512916 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-f04159e3-25b0-4698-9733-1d694c3b07a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:58.521993 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:58.575496 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b843b-fb4a-44ce-a4d9-ebe3703c0cda None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:58.575808 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b843b-fb4a-44ce-a4d9-ebe3703c0cda None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:58.576045 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b843b-fb4a-44ce-a4d9-ebe3703c0cda None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:58.577676 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 439/883] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:15:58.583001 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86108d28-ea78-4d3d-853b-2327350ed66e None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:58.583286 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86108d28-ea78-4d3d-853b-2327350ed66e None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:58.583568 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86108d28-ea78-4d3d-853b-2327350ed66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:58.592466 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 445/884] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:58 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 09:15:58.600954 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-86108d28-ea78-4d3d-853b-2327350ed66e None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:58.602141 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-86108d28-ea78-4d3d-853b-2327350ed66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:58.615293 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04159e3-25b0-4698-9733-1d694c3b07a3 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:58.679995 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 440/885] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:58 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 09:15:58.703645 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86108d28-ea78-4d3d-853b-2327350ed66e None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:58.723068 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:58.741034 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04159e3-25b0-4698-9733-1d694c3b07a3 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:58.788911 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe198fe9-3f82-485c-8101-02fe02b45812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:58.790932 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe198fe9-3f82-485c-8101-02fe02b45812 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:58.791455 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe198fe9-3f82-485c-8101-02fe02b45812 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:58.792184 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe198fe9-3f82-485c-8101-02fe02b45812 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:58.793491 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe198fe9-3f82-485c-8101-02fe02b45812 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:58.795068 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe198fe9-3f82-485c-8101-02fe02b45812 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:58.808350 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86108d28-ea78-4d3d-853b-2327350ed66e None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:58.812374 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-fe198fe9-3f82-485c-8101-02fe02b45812 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 27 09:15:58.812374 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:58.812374 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 09:15:58.812374 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 09:15:58.812374 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 09:15:58.812374 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 09:15:58.812374 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 09:15:58.812374 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 09:15:58.812374 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 27 09:15:58.812374 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:58.812374 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 09:15:58.812374 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:58.812374 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:58.812374 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:58.812374 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:58.812374 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:58.812374 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:58.813385 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:58.813385 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:58.813385 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:58.813385 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:58.813385 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:58.813385 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:58.813385 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 09:15:58.813385 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 09:15:58.813385 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 09:15:58.813385 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 09:15:58.813385 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:58.813385 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:58.813385 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:58.813385 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:58.813385 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:58.813385 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:58.814225 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:58.814225 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:58.814225 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:58.814225 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:58.814225 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:58.814225 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:58.814225 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:58.814225 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:58.814225 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:58.814225 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:58.814225 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 09:15:58.814225 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 09:15:58.814225 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 27 09:15:58.814225 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:15:58.822489 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 446/886] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Jun 27 09:15:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 09:15:58.823128 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe198fe9-3f82-485c-8101-02fe02b45812 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:58.827364 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:58.851072 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc2b63-cc40-4461-b2a3-2567a135b4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:58.851989 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc2b63-cc40-4461-b2a3-2567a135b4e8 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:58.852374 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc2b63-cc40-4461-b2a3-2567a135b4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:58.852714 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc2b63-cc40-4461-b2a3-2567a135b4e8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:58.865114 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dc2b63-cc40-4461-b2a3-2567a135b4e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:15:58.873822 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-76dc2b63-cc40-4461-b2a3-2567a135b4e8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 09:15:58.873822 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:58.873822 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:58.873822 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:58.873822 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:58.873822 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:58.873822 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:58.873822 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:58.873822 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:58.873822 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:58.873822 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:58.873822 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:58.873822 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:15:58.873822 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:15:58.873822 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:15:58.873822 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:15:58.874796 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:15:58.874796 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:15:58.874796 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:15:58.874796 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:15:58.874796 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:58.874796 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:58.874796 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:58.874796 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:58.874796 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:58.874796 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:58.874796 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:58.874796 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:58.874796 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:58.874796 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:58.874796 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:58.874796 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:58.875654 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:58.875654 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:58.875654 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:58.875654 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:58.875654 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:15:58.875654 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:15:58.875654 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:15:58.875654 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:15:58.875654 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:15:58.875654 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:15:58.875654 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 09:15:58.875654 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:58.880448 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 441/887] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Jun 27 09:15:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 09:15:58.881441 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc2b63-cc40-4461-b2a3-2567a135b4e8 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:58.952223 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe198fe9-3f82-485c-8101-02fe02b45812 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:58.988533 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b744eee-3439-4848-bfc8-8f30a536fb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:58.989195 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b744eee-3439-4848-bfc8-8f30a536fb01 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:58.989477 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b744eee-3439-4848-bfc8-8f30a536fb01 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:58.989752 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b744eee-3439-4848-bfc8-8f30a536fb01 None admin] PATH_INFO: `/v3/services` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:58.990446 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:58.990557 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b744eee-3439-4848-bfc8-8f30a536fb01 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:58.990805 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b744eee-3439-4848-bfc8-8f30a536fb01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:58.992285 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b744eee-3439-4848-bfc8-8f30a536fb01 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:59.002093 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 447/888] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Jun 27 09:15:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:15:59.003082 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b744eee-3439-4848-bfc8-8f30a536fb01 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:59.028038 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc2b63-cc40-4461-b2a3-2567a135b4e8 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:59.073681 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:59.078072 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2aa9f6-7a3d-4941-a42c-93b24901f7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:59.079923 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2aa9f6-7a3d-4941-a42c-93b24901f7bf None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:59.080544 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2aa9f6-7a3d-4941-a42c-93b24901f7bf None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:59.085473 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2aa9f6-7a3d-4941-a42c-93b24901f7bf None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:59.085473 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2aa9f6-7a3d-4941-a42c-93b24901f7bf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:59.085473 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2aa9f6-7a3d-4941-a42c-93b24901f7bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:59.085473 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2aa9f6-7a3d-4941-a42c-93b24901f7bf None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:59.096164 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 442/889] 10.222.0.62 () {56 vars in 1115 bytes} [Mon Jun 27 09:15:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:15:59.102093 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2aa9f6-7a3d-4941-a42c-93b24901f7bf None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:59.119861 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b744eee-3439-4848-bfc8-8f30a536fb01 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:59.155774 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb4ffa-8948-48ee-8a02-c10ab68e55e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:59.156470 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb4ffa-8948-48ee-8a02-c10ab68e55e2 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:59.156750 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb4ffa-8948-48ee-8a02-c10ab68e55e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:59.157023 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb4ffa-8948-48ee-8a02-c10ab68e55e2 None admin] PATH_INFO: `/v3/services` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:59.157729 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb4ffa-8948-48ee-8a02-c10ab68e55e2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:59.158033 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb4ffa-8948-48ee-8a02-c10ab68e55e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:59.159453 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb4ffa-8948-48ee-8a02-c10ab68e55e2 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:59.169151 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 448/890] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Jun 27 09:15:59 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:59.169151 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945435e9-d35d-43fd-b471-dd380426f04b None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:59.169151 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945435e9-d35d-43fd-b471-dd380426f04b None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:59.169151 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945435e9-d35d-43fd-b471-dd380426f04b None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:59.169151 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 449/891] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:15:59.172367 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945435e9-d35d-43fd-b471-dd380426f04b None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:59.235742 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2aa9f6-7a3d-4941-a42c-93b24901f7bf None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:59.273751 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667258cf-4d9f-476b-98de-c8270dfad86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:59.274462 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667258cf-4d9f-476b-98de-c8270dfad86c None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:59.274740 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667258cf-4d9f-476b-98de-c8270dfad86c None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:59.275016 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667258cf-4d9f-476b-98de-c8270dfad86c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:59.286354 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:59.289853 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667258cf-4d9f-476b-98de-c8270dfad86c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:59.291576 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945435e9-d35d-43fd-b471-dd380426f04b None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:59.292318 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667258cf-4d9f-476b-98de-c8270dfad86c None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:59.311160 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-667258cf-4d9f-476b-98de-c8270dfad86c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:59.311160 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:59.311160 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:59.311160 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:59.311160 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:59.311160 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:59.311160 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:59.311160 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:59.311160 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:59.311160 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:59.311160 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:59.311160 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:59.311160 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:15:59.311160 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:15:59.311160 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:15:59.312132 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:15:59.312132 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:59.312132 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:59.312132 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:59.312132 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:59.312132 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:59.312132 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:59.312132 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:59.312132 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:59.312132 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:59.312132 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:59.312132 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:59.312132 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:59.312132 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:59.312132 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:59.312132 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:59.312132 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:59.313055 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:15:59.313055 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:15:59.313055 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:15:59.313055 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:59.313055 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 443/892] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:15:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:59.313795 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455fa71-354a-4136-a1e9-ca9ad9d1a712 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:59.313895 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455fa71-354a-4136-a1e9-ca9ad9d1a712 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:59.314111 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455fa71-354a-4136-a1e9-ca9ad9d1a712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:59.330353 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:59.331857 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-4455fa71-354a-4136-a1e9-ca9ad9d1a712 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:59.333063 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-4455fa71-354a-4136-a1e9-ca9ad9d1a712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:59.337141 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efbe648-ad27-4fff-acb6-98f79cc47858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:59.337850 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efbe648-ad27-4fff-acb6-98f79cc47858 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:59.344906 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efbe648-ad27-4fff-acb6-98f79cc47858 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:59.344906 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efbe648-ad27-4fff-acb6-98f79cc47858 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:59.344906 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efbe648-ad27-4fff-acb6-98f79cc47858 None admin] RBAC: Adding query filter params (interface=public, service_id=1b87a57a26de463bb55dc0e1a6b6a20d, region_id=RegionOne) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:59.344906 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efbe648-ad27-4fff-acb6-98f79cc47858 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:59.344906 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efbe648-ad27-4fff-acb6-98f79cc47858 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:59.350726 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 450/893] 10.222.0.62 () {56 vars in 1251 bytes} [Mon Jun 27 09:15:59 2022] GET /identity/v3/endpoints?service_id=1b87a57a26de463bb55dc0e1a6b6a20d&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:59.350726 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efbe648-ad27-4fff-acb6-98f79cc47858 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:59.414699 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 444/894] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:59 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 09:15:59.415793 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455fa71-354a-4136-a1e9-ca9ad9d1a712 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:59.471886 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efbe648-ad27-4fff-acb6-98f79cc47858 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:59.507834 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a4030-17b7-4819-b413-7aa860927cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:59.508540 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a4030-17b7-4819-b413-7aa860927cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:59.508798 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a4030-17b7-4819-b413-7aa860927cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:59.509071 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a4030-17b7-4819-b413-7aa860927cd9 None admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:59.509793 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2a4030-17b7-4819-b413-7aa860927cd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:59.510100 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2a4030-17b7-4819-b413-7aa860927cd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:59.511529 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2a4030-17b7-4819-b413-7aa860927cd9 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:59.523293 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 451/895] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:15:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:15:59.524142 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a4030-17b7-4819-b413-7aa860927cd9 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:59.533389 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455fa71-354a-4136-a1e9-ca9ad9d1a712 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:59.557052 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:59.568822 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da79082-7bed-4729-8d64-0f0a375c5187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:59.569522 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da79082-7bed-4729-8d64-0f0a375c5187 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:59.569805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da79082-7bed-4729-8d64-0f0a375c5187 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:59.570079 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da79082-7bed-4729-8d64-0f0a375c5187 None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:59.570758 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da79082-7bed-4729-8d64-0f0a375c5187 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:59.572137 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da79082-7bed-4729-8d64-0f0a375c5187 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:59.577791 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 445/896] 10.222.0.62 () {56 vars in 1087 bytes} [Mon Jun 27 09:15:59 2022] GET /identity/v3/services => generated 1268 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:15:59.579017 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22cde2b-1bdd-45ab-90ac-22a04c61bedb None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:59.579286 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22cde2b-1bdd-45ab-90ac-22a04c61bedb None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:59.579625 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22cde2b-1bdd-45ab-90ac-22a04c61bedb None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:59.580999 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 446/897] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:15:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:15:59.581700 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22cde2b-1bdd-45ab-90ac-22a04c61bedb None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:59.591173 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:59.633135 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a4030-17b7-4819-b413-7aa860927cd9 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:59.677834 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2ad69-a9a4-4844-9e4d-3b24c6aa5c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:59.678451 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2ad69-a9a4-4844-9e4d-3b24c6aa5c67 None admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:59.678672 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2ad69-a9a4-4844-9e4d-3b24c6aa5c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:59.678947 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2ad69-a9a4-4844-9e4d-3b24c6aa5c67 None admin] PATH_INFO: `/v3/services` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:59.679681 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e2ad69-a9a4-4844-9e4d-3b24c6aa5c67 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:59.681509 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e2ad69-a9a4-4844-9e4d-3b24c6aa5c67 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:59.702127 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22cde2b-1bdd-45ab-90ac-22a04c61bedb None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:59.739871 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fcd4a8-b9ac-4849-95e8-0a84e86ff7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:59.740725 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fcd4a8-b9ac-4849-95e8-0a84e86ff7ce None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:59.741007 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fcd4a8-b9ac-4849-95e8-0a84e86ff7ce None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:59.741278 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fcd4a8-b9ac-4849-95e8-0a84e86ff7ce None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:59.748833 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fcd4a8-b9ac-4849-95e8-0a84e86ff7ce None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:59.750272 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fcd4a8-b9ac-4849-95e8-0a84e86ff7ce None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:15:59.765949 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-e2fcd4a8-b9ac-4849-95e8-0a84e86ff7ce None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 09:15:59.765949 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:15:59.765949 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:15:59.765949 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:15:59.765949 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:15:59.765949 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:15:59.765949 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:15:59.765949 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:15:59.765949 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:15:59.765949 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:15:59.765949 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:15:59.765949 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:15:59.765949 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 09:15:59.765949 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 09:15:59.765949 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 09:15:59.765949 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 09:15:59.767079 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:15:59.767079 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:15:59.767079 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 09:15:59.767079 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:15:59.767079 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 09:15:59.767079 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:15:59.767079 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:15:59.767079 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:15:59.767079 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:15:59.767079 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:15:59.767079 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:15:59.767079 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:15:59.767079 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:15:59.767079 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:15:59.767079 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:15:59.767079 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:15:59.767079 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:15:59.767079 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:15:59.768759 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:15:59.768759 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:15:59.768759 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 09:15:59.768759 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 09:15:59.768759 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 09:15:59.768759 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 09:15:59.768759 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 09:15:59.768759 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 09:15:59.768759 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 09:15:59.768759 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:15:59.768759 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 447/898] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Jun 27 09:15:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:15:59.768759 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45dac48-a214-4172-aa8e-47de55bc539b None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:59.768759 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45dac48-a214-4172-aa8e-47de55bc539b None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:59.770175 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45dac48-a214-4172-aa8e-47de55bc539b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:59.787778 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-d45dac48-a214-4172-aa8e-47de55bc539b None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:15:59.789011 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-d45dac48-a214-4172-aa8e-47de55bc539b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:15:59.816360 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 452/899] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Jun 27 09:15:59 2022] POST /identity/v3/services => generated 241 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:15:59.816360 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2ad69-a9a4-4844-9e4d-3b24c6aa5c67 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:59.863325 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:59.906630 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 448/900] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:15:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 09:15:59.930462 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45dac48-a214-4172-aa8e-47de55bc539b None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:15:59.936799 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2ad69-a9a4-4844-9e4d-3b24c6aa5c67 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:15:59.956099 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:15:59.979454 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99462491-4a84-417a-9fc5-cac021c961ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:15:59.980417 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99462491-4a84-417a-9fc5-cac021c961ae None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:15:59.980931 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99462491-4a84-417a-9fc5-cac021c961ae None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:15:59.981351 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99462491-4a84-417a-9fc5-cac021c961ae None admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:15:59.982429 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99462491-4a84-417a-9fc5-cac021c961ae None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:15:59.982879 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99462491-4a84-417a-9fc5-cac021c961ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:15:59.984736 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99462491-4a84-417a-9fc5-cac021c961ae None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:00.005091 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 453/901] 10.222.0.62 () {56 vars in 1149 bytes} [Mon Jun 27 09:15:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:00.012956 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99462491-4a84-417a-9fc5-cac021c961ae None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:00.049892 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45dac48-a214-4172-aa8e-47de55bc539b None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:00.095289 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee27f1a-e012-48ba-bfcd-54458aa6342a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:00.096221 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee27f1a-e012-48ba-bfcd-54458aa6342a None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:00.096682 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee27f1a-e012-48ba-bfcd-54458aa6342a None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:00.097078 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee27f1a-e012-48ba-bfcd-54458aa6342a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:00.097802 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee27f1a-e012-48ba-bfcd-54458aa6342a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:00.099375 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee27f1a-e012-48ba-bfcd-54458aa6342a None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:00.121172 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-5ee27f1a-e012-48ba-bfcd-54458aa6342a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 27 09:16:00.121172 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:00.121172 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 09:16:00.121172 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 09:16:00.121172 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 09:16:00.121172 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 09:16:00.121172 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 09:16:00.121172 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 09:16:00.121172 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 27 09:16:00.121172 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:16:00.121172 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 09:16:00.121172 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:16:00.121172 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:00.121172 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:16:00.121172 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:16:00.121172 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:16:00.122185 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:16:00.122185 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:16:00.122185 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:16:00.122185 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:16:00.122185 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:16:00.122185 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:16:00.122185 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:16:00.122185 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 09:16:00.122185 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 09:16:00.122185 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 09:16:00.122185 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 09:16:00.122185 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:16:00.122185 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:16:00.122185 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:16:00.122185 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:16:00.122185 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:16:00.123038 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:16:00.123038 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:16:00.123038 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:16:00.123038 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:16:00.123038 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:16:00.123038 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:16:00.123038 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:16:00.123038 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:16:00.123038 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:16:00.123038 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:16:00.123038 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:16:00.123038 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 09:16:00.123038 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 09:16:00.123038 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 27 09:16:00.123038 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:16:00.123038 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 449/902] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Jun 27 09:15:59 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 09:16:00.129061 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee27f1a-e012-48ba-bfcd-54458aa6342a None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:00.153027 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99462491-4a84-417a-9fc5-cac021c961ae None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:00.173732 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:00.205771 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d161fb4e-90f8-4769-bf39-1bb02b13cde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:00.206945 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161fb4e-90f8-4769-bf39-1bb02b13cde0 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:00.207375 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161fb4e-90f8-4769-bf39-1bb02b13cde0 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:00.208363 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161fb4e-90f8-4769-bf39-1bb02b13cde0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:00.245373 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee27f1a-e012-48ba-bfcd-54458aa6342a None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:00.270871 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:00.283059 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66adb29-e044-42a6-b0bb-566477414caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:00.283853 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66adb29-e044-42a6-b0bb-566477414caa None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:00.290044 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66adb29-e044-42a6-b0bb-566477414caa None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:00.290044 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66adb29-e044-42a6-b0bb-566477414caa None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:00.290044 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66adb29-e044-42a6-b0bb-566477414caa None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:00.290044 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66adb29-e044-42a6-b0bb-566477414caa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:00.290044 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66adb29-e044-42a6-b0bb-566477414caa None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:00.298099 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 450/903] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Jun 27 09:16:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:16:00.299232 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66adb29-e044-42a6-b0bb-566477414caa None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:00.310365 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d161fb4e-90f8-4769-bf39-1bb02b13cde0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:00.311852 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d161fb4e-90f8-4769-bf39-1bb02b13cde0 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:00.425707 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:00.428926 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66adb29-e044-42a6-b0bb-566477414caa None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:00.436752 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 454/904] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:16:00 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 09:16:00.453267 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d161fb4e-90f8-4769-bf39-1bb02b13cde0 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:00.469250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92359f83-2ac7-48eb-aaf6-bc9159e9d571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:00.470089 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92359f83-2ac7-48eb-aaf6-bc9159e9d571 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:00.470509 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92359f83-2ac7-48eb-aaf6-bc9159e9d571 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:00.471124 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92359f83-2ac7-48eb-aaf6-bc9159e9d571 None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:00.472835 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92359f83-2ac7-48eb-aaf6-bc9159e9d571 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:00.473630 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92359f83-2ac7-48eb-aaf6-bc9159e9d571 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:00.475221 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92359f83-2ac7-48eb-aaf6-bc9159e9d571 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:00.485753 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 451/905] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Jun 27 09:16:00 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:00.486950 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92359f83-2ac7-48eb-aaf6-bc9159e9d571 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:00.537819 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:00.582322 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d161fb4e-90f8-4769-bf39-1bb02b13cde0 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:00.600669 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92359f83-2ac7-48eb-aaf6-bc9159e9d571 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:00.636011 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9e94e-0a38-4b8b-bc6e-3cc54d8a245f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:00.636828 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9e94e-0a38-4b8b-bc6e-3cc54d8a245f None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:00.637111 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9e94e-0a38-4b8b-bc6e-3cc54d8a245f None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:00.637383 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9e94e-0a38-4b8b-bc6e-3cc54d8a245f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:00.650242 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e9e94e-0a38-4b8b-bc6e-3cc54d8a245f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:00.651998 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e9e94e-0a38-4b8b-bc6e-3cc54d8a245f None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:00.654307 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0d8de-60d4-4538-a1b9-cc25c93859b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:00.655807 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0d8de-60d4-4538-a1b9-cc25c93859b2 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:00.656369 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0d8de-60d4-4538-a1b9-cc25c93859b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:00.656849 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0d8de-60d4-4538-a1b9-cc25c93859b2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:00.657858 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a0d8de-60d4-4538-a1b9-cc25c93859b2 None admin] RBAC: Adding query filter params (interface=public, service_id=71f10ad6c6424f1bb6bdeec0ede2d0a2, region_id=RegionOne) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:00.658376 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a0d8de-60d4-4538-a1b9-cc25c93859b2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:00.660617 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a0d8de-60d4-4538-a1b9-cc25c93859b2 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:00.667751 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 452/906] 10.222.0.62 () {56 vars in 1251 bytes} [Mon Jun 27 09:16:00 2022] GET /identity/v3/endpoints?service_id=71f10ad6c6424f1bb6bdeec0ede2d0a2&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:16:00.676244 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-85e9e94e-0a38-4b8b-bc6e-3cc54d8a245f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:16:00.676244 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:00.676244 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:16:00.676244 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:16:00.676244 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:16:00.676244 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:16:00.676244 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:16:00.676244 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:16:00.676244 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:16:00.676244 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:16:00.676244 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:16:00.676244 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:16:00.676244 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:16:00.676244 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:16:00.676244 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:16:00.677219 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:16:00.677219 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:16:00.677219 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:16:00.677219 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:16:00.677219 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:16:00.677219 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:16:00.677219 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:16:00.677219 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:16:00.677219 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:16:00.677219 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:16:00.677219 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:16:00.677219 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:16:00.677219 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:16:00.677219 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:16:00.677219 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:16:00.677219 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:16:00.677219 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:16:00.678106 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:16:00.678106 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:16:00.678106 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:16:00.678106 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:16:00.678106 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 455/907] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:16:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 09:16:00.678374 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0d8de-60d4-4538-a1b9-cc25c93859b2 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:00.682108 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9e94e-0a38-4b8b-bc6e-3cc54d8a245f None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:00.708460 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:00.801039 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0d8de-60d4-4538-a1b9-cc25c93859b2 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:00.808887 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9e94e-0a38-4b8b-bc6e-3cc54d8a245f None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:00.835594 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:00.847132 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762d44b-f533-4d95-a5cd-6ef22ef200b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:00.853085 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762d44b-f533-4d95-a5cd-6ef22ef200b3 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:00.853201 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca78d8-bdfc-4746-9d47-eb17cb6edcf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:00.853345 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762d44b-f533-4d95-a5cd-6ef22ef200b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:00.853345 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762d44b-f533-4d95-a5cd-6ef22ef200b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:00.853530 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca78d8-bdfc-4746-9d47-eb17cb6edcf8 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:00.853530 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca78d8-bdfc-4746-9d47-eb17cb6edcf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:00.853673 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2762d44b-f533-4d95-a5cd-6ef22ef200b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:00.853743 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca78d8-bdfc-4746-9d47-eb17cb6edcf8 None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:00.853811 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2762d44b-f533-4d95-a5cd-6ef22ef200b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:00.853887 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca78d8-bdfc-4746-9d47-eb17cb6edcf8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:00.853957 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2762d44b-f533-4d95-a5cd-6ef22ef200b3 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:00.854023 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca78d8-bdfc-4746-9d47-eb17cb6edcf8 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:00.860239 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 453/908] 10.222.0.62 () {56 vars in 1087 bytes} [Mon Jun 27 09:16:00 2022] GET /identity/v3/services => generated 1497 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:16:00.870377 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 456/909] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:16:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:16:00.875797 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca78d8-bdfc-4746-9d47-eb17cb6edcf8 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:00.988603 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:00.991996 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca78d8-bdfc-4746-9d47-eb17cb6edcf8 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:01.032868 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d171e7-d3c9-4af5-94e1-c49665cfe8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:01.033670 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d171e7-d3c9-4af5-94e1-c49665cfe8da None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:01.033956 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d171e7-d3c9-4af5-94e1-c49665cfe8da None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:01.034229 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d171e7-d3c9-4af5-94e1-c49665cfe8da None admin] PATH_INFO: `/v3/projects/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:01.042956 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d171e7-d3c9-4af5-94e1-c49665cfe8da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:01.044525 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d171e7-d3c9-4af5-94e1-c49665cfe8da None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:01.058965 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-e1d171e7-d3c9-4af5-94e1-c49665cfe8da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:16:01.058965 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:01.058965 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:16:01.058965 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:16:01.058965 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:16:01.058965 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:16:01.058965 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:16:01.058965 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:16:01.058965 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:16:01.058965 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:16:01.058965 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:16:01.058965 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:16:01.058965 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 09:16:01.058965 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 09:16:01.058965 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 09:16:01.059910 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 09:16:01.059910 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:16:01.059910 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:16:01.059910 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:16:01.059910 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:16:01.059910 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:16:01.059910 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:16:01.059910 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:16:01.059910 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:16:01.059910 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:16:01.059910 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:16:01.059910 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:16:01.059910 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:16:01.059910 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:16:01.059910 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:16:01.059910 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:16:01.059910 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:16:01.060846 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 09:16:01.060846 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 09:16:01.060846 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 09:16:01.060846 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 09:16:01.060846 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 09:16:01.060846 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 09:16:01.060846 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:16:01.060846 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:16:01.064323 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 454/910] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:16:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 09:16:01.067009 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762d44b-f533-4d95-a5cd-6ef22ef200b3 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:01.178276 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762d44b-f533-4d95-a5cd-6ef22ef200b3 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:01.213517 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a53fe-31d6-4212-aef8-16ee230762a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:01.214186 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a53fe-31d6-4212-aef8-16ee230762a0 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:01.214467 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a53fe-31d6-4212-aef8-16ee230762a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:01.214729 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a53fe-31d6-4212-aef8-16ee230762a0 None admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:01.215520 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a53fe-31d6-4212-aef8-16ee230762a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:01.215824 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a53fe-31d6-4212-aef8-16ee230762a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:01.217271 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a53fe-31d6-4212-aef8-16ee230762a0 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:01.231081 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 457/911] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Jun 27 09:16:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:01.236922 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d171e7-d3c9-4af5-94e1-c49665cfe8da None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:01.353298 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d171e7-d3c9-4af5-94e1-c49665cfe8da None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:01.389818 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd7e61a-98bd-4583-8d56-25d26953fcbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:01.390455 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7e61a-98bd-4583-8d56-25d26953fcbf None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:01.390739 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7e61a-98bd-4583-8d56-25d26953fcbf None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:01.391066 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7e61a-98bd-4583-8d56-25d26953fcbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:01.391922 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd7e61a-98bd-4583-8d56-25d26953fcbf None admin] RBAC: Adding query filter params (role.id=6278d7f8619447b4b75ea2e9f2d03cb4, scope.project.id=4ba8e40538db4d89b93469b79322d20e, user.id=8f5d1f2327914f9fb070c6212582b6dc) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:01.392251 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd7e61a-98bd-4583-8d56-25d26953fcbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:01.393698 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd7e61a-98bd-4583-8d56-25d26953fcbf None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:01.408368 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 455/912] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Jun 27 09:16:01 2022] GET /identity/v3/role_assignments?user.id=8f5d1f2327914f9fb070c6212582b6dc&scope.project.id=4ba8e40538db4d89b93469b79322d20e&role.id=6278d7f8619447b4b75ea2e9f2d03cb4 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:01.678635 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb6baf-ee37-4215-8b09-4487c151620a None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:01.679135 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb6baf-ee37-4215-8b09-4487c151620a None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:01.679135 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb6baf-ee37-4215-8b09-4487c151620a None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:01.680799 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 458/913] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:16:01.686014 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f1790-8829-4f09-8199-a57d736ce2ac None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:01.686547 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f1790-8829-4f09-8199-a57d736ce2ac None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:01.686547 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f1790-8829-4f09-8199-a57d736ce2ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:01.704249 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-267f1790-8829-4f09-8199-a57d736ce2ac None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:16:01.705436 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-267f1790-8829-4f09-8199-a57d736ce2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:16:01.717298 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:01.779730 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 456/914] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:16:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 09:16:01.801610 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb6baf-ee37-4215-8b09-4487c151620a None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:01.854211 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:01.911144 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb6baf-ee37-4215-8b09-4487c151620a None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:01.947237 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cdbd95-2dc6-41e9-a50a-b48d57c3cafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:01.947948 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdbd95-2dc6-41e9-a50a-b48d57c3cafd None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:01.948247 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdbd95-2dc6-41e9-a50a-b48d57c3cafd None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:01.948522 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdbd95-2dc6-41e9-a50a-b48d57c3cafd None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:01.949176 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cdbd95-2dc6-41e9-a50a-b48d57c3cafd None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:01.950547 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cdbd95-2dc6-41e9-a50a-b48d57c3cafd None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:01.963446 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-47cdbd95-2dc6-41e9-a50a-b48d57c3cafd None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 27 09:16:01.963446 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:01.963446 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 09:16:01.963446 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 09:16:01.963446 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 09:16:01.963446 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 09:16:01.963446 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 09:16:01.963446 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 09:16:01.963446 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 27 09:16:01.963446 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:16:01.963446 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 09:16:01.963446 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:16:01.963446 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:01.963446 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:16:01.963446 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:16:01.963446 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:16:01.963446 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:16:01.965856 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:16:01.965856 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:16:01.965856 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:16:01.965856 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:16:01.965856 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:16:01.965856 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:16:01.965856 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 09:16:01.965856 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 09:16:01.965856 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 09:16:01.965856 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 09:16:01.965856 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:16:01.965856 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:16:01.965856 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:16:01.965856 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:16:01.965856 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:16:01.965856 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:16:01.967870 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:16:01.967870 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:16:01.967870 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:16:01.967870 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:16:01.967870 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:16:01.967870 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:16:01.967870 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:16:01.967870 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:16:01.967870 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:16:01.967870 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:16:01.967870 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 09:16:01.967870 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 09:16:01.967870 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 27 09:16:01.967870 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:16:01.967870 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 459/915] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Jun 27 09:16:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:16:01.974465 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f1790-8829-4f09-8199-a57d736ce2ac None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:02.008184 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b7afe-4c74-48cd-a1ad-71817d4c3ea5 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:02.008184 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b7afe-4c74-48cd-a1ad-71817d4c3ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:02.008184 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b7afe-4c74-48cd-a1ad-71817d4c3ea5 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:02.009237 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 460/916] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:16:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 09:16:02.013205 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1155ac2-3218-40f8-b2e8-15b9b48936e9 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:02.013738 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1155ac2-3218-40f8-b2e8-15b9b48936e9 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:02.014228 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1155ac2-3218-40f8-b2e8-15b9b48936e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:02.031920 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-c1155ac2-3218-40f8-b2e8-15b9b48936e9 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:16:02.033526 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-c1155ac2-3218-40f8-b2e8-15b9b48936e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:16:02.098999 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f1790-8829-4f09-8199-a57d736ce2ac None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:02.131081 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 461/917] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:16:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 09:16:02.145770 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c129c3ee-ef7f-4424-b741-699f2f7d1dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:02.146799 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129c3ee-ef7f-4424-b741-699f2f7d1dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:02.147343 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129c3ee-ef7f-4424-b741-699f2f7d1dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:02.147830 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129c3ee-ef7f-4424-b741-699f2f7d1dc4 None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:02.148795 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c129c3ee-ef7f-4424-b741-699f2f7d1dc4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:02.149304 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c129c3ee-ef7f-4424-b741-699f2f7d1dc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:02.151645 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c129c3ee-ef7f-4424-b741-699f2f7d1dc4 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:02.154975 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1155ac2-3218-40f8-b2e8-15b9b48936e9 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:02.161269 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 457/918] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Jun 27 09:16:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:02.167129 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c129c3ee-ef7f-4424-b741-699f2f7d1dc4 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:02.180233 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:02.210020 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:02.277704 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1155ac2-3218-40f8-b2e8-15b9b48936e9 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:02.278242 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c129c3ee-ef7f-4424-b741-699f2f7d1dc4 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:02.314747 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66f0b4-af49-4ca3-9239-19a27a22ad9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:02.315193 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbeee74-da04-4fed-ba8e-d4728a77c8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:02.315435 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66f0b4-af49-4ca3-9239-19a27a22ad9a None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:02.315751 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66f0b4-af49-4ca3-9239-19a27a22ad9a None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:02.316024 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66f0b4-af49-4ca3-9239-19a27a22ad9a None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:02.316775 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba66f0b4-af49-4ca3-9239-19a27a22ad9a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:02.317080 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba66f0b4-af49-4ca3-9239-19a27a22ad9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:02.317303 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbeee74-da04-4fed-ba8e-d4728a77c8db None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:02.317834 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbeee74-da04-4fed-ba8e-d4728a77c8db None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:02.318310 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbeee74-da04-4fed-ba8e-d4728a77c8db None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:02.318541 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba66f0b4-af49-4ca3-9239-19a27a22ad9a None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:02.319372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbeee74-da04-4fed-ba8e-d4728a77c8db None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:02.320952 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbeee74-da04-4fed-ba8e-d4728a77c8db None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:02.324242 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 458/919] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Jun 27 09:16:02 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:02.329485 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66f0b4-af49-4ca3-9239-19a27a22ad9a None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:02.338993 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-afbeee74-da04-4fed-ba8e-d4728a77c8db None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 09:16:02.338993 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:02.338993 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 09:16:02.338993 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 09:16:02.338993 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 09:16:02.338993 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 09:16:02.338993 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 09:16:02.338993 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 09:16:02.338993 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 09:16:02.338993 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:16:02.338993 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 09:16:02.338993 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:16:02.338993 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:02.338993 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:16:02.338993 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:16:02.338993 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:16:02.338993 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:16:02.340249 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:16:02.340249 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:16:02.340249 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:16:02.340249 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:16:02.340249 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:16:02.340249 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:16:02.340249 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 09:16:02.340249 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 09:16:02.340249 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 09:16:02.340249 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 09:16:02.340249 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:16:02.340249 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:16:02.340249 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:16:02.340249 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:16:02.340249 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:16:02.340249 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:16:02.341339 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:16:02.341339 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:16:02.341339 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:16:02.341339 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:16:02.341339 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:16:02.341339 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:16:02.341339 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:16:02.341339 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:16:02.341339 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:16:02.341339 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:16:02.341339 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 09:16:02.341339 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 09:16:02.341339 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 09:16:02.341339 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:16:02.348241 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 462/920] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Jun 27 09:16:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:16:02.350875 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbeee74-da04-4fed-ba8e-d4728a77c8db None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:02.419906 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:02.449012 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66f0b4-af49-4ca3-9239-19a27a22ad9a None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:02.470617 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbeee74-da04-4fed-ba8e-d4728a77c8db None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:02.472696 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:02.487231 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dfd23c-8468-4a13-a066-db7e1b8d2556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:02.488990 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfd23c-8468-4a13-a066-db7e1b8d2556 None admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:02.488990 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfd23c-8468-4a13-a066-db7e1b8d2556 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:02.488990 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfd23c-8468-4a13-a066-db7e1b8d2556 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:02.489459 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dfd23c-8468-4a13-a066-db7e1b8d2556 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:02.490633 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dfd23c-8468-4a13-a066-db7e1b8d2556 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:02.511407 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a07f50-e0ec-4929-9a9a-a04a7ce861f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:02.512224 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a07f50-e0ec-4929-9a9a-a04a7ce861f9 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:02.512579 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a07f50-e0ec-4929-9a9a-a04a7ce861f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:02.512927 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a07f50-e0ec-4929-9a9a-a04a7ce861f9 None admin] PATH_INFO: `/v3/services` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:02.513741 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a07f50-e0ec-4929-9a9a-a04a7ce861f9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:02.514112 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a07f50-e0ec-4929-9a9a-a04a7ce861f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:02.515556 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a07f50-e0ec-4929-9a9a-a04a7ce861f9 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:02.521500 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 463/921] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Jun 27 09:16:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:02.527098 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a07f50-e0ec-4929-9a9a-a04a7ce861f9 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:02.569415 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 459/922] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Jun 27 09:16:02 2022] POST /identity/v3/endpoints => generated 346 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:16:02.656030 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a07f50-e0ec-4929-9a9a-a04a7ce861f9 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:02.703511 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960b99a-748b-4297-8e4e-3ee7ab99b50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:02.704172 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960b99a-748b-4297-8e4e-3ee7ab99b50d None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:02.704556 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960b99a-748b-4297-8e4e-3ee7ab99b50d None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:02.704835 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960b99a-748b-4297-8e4e-3ee7ab99b50d None admin] PATH_INFO: `/v3/services` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:02.705619 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3960b99a-748b-4297-8e4e-3ee7ab99b50d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:02.705986 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3960b99a-748b-4297-8e4e-3ee7ab99b50d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:02.707622 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3960b99a-748b-4297-8e4e-3ee7ab99b50d None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:02.714232 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 464/923] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Jun 27 09:16:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:16:02.719665 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dfd23c-8468-4a13-a066-db7e1b8d2556 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:02.829351 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dfd23c-8468-4a13-a066-db7e1b8d2556 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:02.858432 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:02.865360 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e208ea-0bf6-4096-8e68-40afd08a6938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:02.866018 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e208ea-0bf6-4096-8e68-40afd08a6938 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:02.866304 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e208ea-0bf6-4096-8e68-40afd08a6938 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:02.866582 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e208ea-0bf6-4096-8e68-40afd08a6938 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:02.870492 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e208ea-0bf6-4096-8e68-40afd08a6938 None admin] RBAC: Adding query filter params (interface=public, service_id=1d85a4deec784676952fba22a7883c27, region_id=RegionOne) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:02.870492 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e208ea-0bf6-4096-8e68-40afd08a6938 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:02.870492 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e208ea-0bf6-4096-8e68-40afd08a6938 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:02.875526 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 460/924] 10.222.0.62 () {56 vars in 1251 bytes} [Mon Jun 27 09:16:02 2022] GET /identity/v3/endpoints?service_id=1d85a4deec784676952fba22a7883c27&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:16:02.881182 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960b99a-748b-4297-8e4e-3ee7ab99b50d None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:02.911184 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:02.991789 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960b99a-748b-4297-8e4e-3ee7ab99b50d None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:03.026725 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba555773-5862-4fca-a37a-36568e57a850 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:03.027056 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba555773-5862-4fca-a37a-36568e57a850 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:03.027279 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba555773-5862-4fca-a37a-36568e57a850 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:03.028955 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 461/925] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 09:16:03.029319 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d04be4d-3af9-45f6-9b20-c4fec442230a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:03.030087 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04be4d-3af9-45f6-9b20-c4fec442230a None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:03.030374 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04be4d-3af9-45f6-9b20-c4fec442230a None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:03.030653 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04be4d-3af9-45f6-9b20-c4fec442230a None admin] PATH_INFO: `/v3/services` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:03.031345 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d04be4d-3af9-45f6-9b20-c4fec442230a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:03.032896 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d04be4d-3af9-45f6-9b20-c4fec442230a None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:03.034067 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28d6ae-3b48-48c3-8782-a4da81ab26b2 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:03.034391 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28d6ae-3b48-48c3-8782-a4da81ab26b2 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:03.034667 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28d6ae-3b48-48c3-8782-a4da81ab26b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:03.039621 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 465/926] 10.222.0.62 () {56 vars in 1087 bytes} [Mon Jun 27 09:16:02 2022] GET /identity/v3/services => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:16:03.058345 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-ee28d6ae-3b48-48c3-8782-a4da81ab26b2 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:16:03.059934 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-ee28d6ae-3b48-48c3-8782-a4da81ab26b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:16:03.148522 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 462/927] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:16:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 09:16:03.171671 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d04be4d-3af9-45f6-9b20-c4fec442230a None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:03.274885 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:03.285589 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d04be4d-3af9-45f6-9b20-c4fec442230a None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:03.321246 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e24a89-ef84-4494-90cd-08e62215f06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:03.322400 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e24a89-ef84-4494-90cd-08e62215f06d None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:03.322859 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e24a89-ef84-4494-90cd-08e62215f06d None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:03.323334 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e24a89-ef84-4494-90cd-08e62215f06d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:03.324165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e24a89-ef84-4494-90cd-08e62215f06d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:03.325749 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e24a89-ef84-4494-90cd-08e62215f06d None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:03.341850 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-b8e24a89-ef84-4494-90cd-08e62215f06d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 27 09:16:03.341850 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:03.341850 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 09:16:03.341850 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 09:16:03.341850 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 09:16:03.341850 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 09:16:03.341850 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 09:16:03.341850 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 09:16:03.341850 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 27 09:16:03.341850 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:16:03.341850 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 09:16:03.341850 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:16:03.341850 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:03.341850 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:16:03.341850 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:16:03.341850 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:16:03.342861 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:16:03.342861 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:16:03.342861 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:16:03.342861 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:16:03.342861 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:16:03.342861 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:16:03.342861 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:16:03.342861 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 09:16:03.342861 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 09:16:03.342861 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 09:16:03.342861 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 09:16:03.342861 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:16:03.342861 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:16:03.342861 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:16:03.342861 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:16:03.342861 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:16:03.343689 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:16:03.343689 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:16:03.343689 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:16:03.343689 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:16:03.343689 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:16:03.343689 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:16:03.343689 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:16:03.343689 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:16:03.343689 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:16:03.343689 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:16:03.343689 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:16:03.343689 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 09:16:03.343689 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 09:16:03.343689 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 27 09:16:03.343689 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:16:03.346541 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 466/928] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Jun 27 09:16:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:16:03.353170 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28d6ae-3b48-48c3-8782-a4da81ab26b2 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:03.465838 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28d6ae-3b48-48c3-8782-a4da81ab26b2 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:03.491892 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:03.502751 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef7fef-afc0-420f-a74c-e047047be6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:03.503682 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef7fef-afc0-420f-a74c-e047047be6e2 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:03.504185 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef7fef-afc0-420f-a74c-e047047be6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:03.504659 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef7fef-afc0-420f-a74c-e047047be6e2 None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:03.505532 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef7fef-afc0-420f-a74c-e047047be6e2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:03.506007 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef7fef-afc0-420f-a74c-e047047be6e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:03.507540 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef7fef-afc0-420f-a74c-e047047be6e2 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:03.512814 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 463/929] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Jun 27 09:16:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:03.521214 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e24a89-ef84-4494-90cd-08e62215f06d None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:03.587838 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c024b-02db-4417-aa7d-9bb66bd8d7b5 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:03.588124 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c024b-02db-4417-aa7d-9bb66bd8d7b5 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:03.588435 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c024b-02db-4417-aa7d-9bb66bd8d7b5 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:03.590033 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 464/930] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 09:16:03.595251 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4bb0cd-77a3-4189-8b19-45d23840b717 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:03.595538 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4bb0cd-77a3-4189-8b19-45d23840b717 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:03.595820 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4bb0cd-77a3-4189-8b19-45d23840b717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:03.614099 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-3e4bb0cd-77a3-4189-8b19-45d23840b717 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:16:03.615771 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-3e4bb0cd-77a3-4189-8b19-45d23840b717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:16:03.630624 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e24a89-ef84-4494-90cd-08e62215f06d None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:03.669584 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2814d-935a-4b8e-80e8-af73b4221ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:03.670912 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2814d-935a-4b8e-80e8-af73b4221ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:03.671372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2814d-935a-4b8e-80e8-af73b4221ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:03.672121 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2814d-935a-4b8e-80e8-af73b4221ab7 None admin] PATH_INFO: `/v3/services` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:03.673342 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2814d-935a-4b8e-80e8-af73b4221ab7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:03.673824 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2814d-935a-4b8e-80e8-af73b4221ab7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:03.676771 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2814d-935a-4b8e-80e8-af73b4221ab7 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:03.684245 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 467/931] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Jun 27 09:16:03 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:03.688837 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2814d-935a-4b8e-80e8-af73b4221ab7 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:03.704301 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 465/932] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:16:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 09:16:03.713238 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:03.728164 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4bb0cd-77a3-4189-8b19-45d23840b717 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:03.803941 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2814d-935a-4b8e-80e8-af73b4221ab7 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:03.842572 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c169a-6351-4478-8c44-50d477a325e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:03.843254 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c169a-6351-4478-8c44-50d477a325e7 None admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:03.843535 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c169a-6351-4478-8c44-50d477a325e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:03.843810 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c169a-6351-4478-8c44-50d477a325e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:03.844716 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645c169a-6351-4478-8c44-50d477a325e7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:03.846263 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645c169a-6351-4478-8c44-50d477a325e7 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:03.849331 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4bb0cd-77a3-4189-8b19-45d23840b717 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:03.872002 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:03.890051 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f53bde1-0ded-46b3-84b7-9eea7069916d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:03.890863 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f53bde1-0ded-46b3-84b7-9eea7069916d None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:03.891142 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f53bde1-0ded-46b3-84b7-9eea7069916d None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:03.891411 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f53bde1-0ded-46b3-84b7-9eea7069916d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:03.902956 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f53bde1-0ded-46b3-84b7-9eea7069916d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:16:03.911886 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-4f53bde1-0ded-46b3-84b7-9eea7069916d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 09:16:03.911886 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:03.911886 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:16:03.911886 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:16:03.911886 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:16:03.911886 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:16:03.911886 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:16:03.911886 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:16:03.911886 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:16:03.911886 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:16:03.911886 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:16:03.911886 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:16:03.911886 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:16:03.911886 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:16:03.911886 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:16:03.911886 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:16:03.913179 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:16:03.913179 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:16:03.913179 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:16:03.913179 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:16:03.913179 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:16:03.913179 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:16:03.913179 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:16:03.913179 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:16:03.913179 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:16:03.913179 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:16:03.913179 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:16:03.913179 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:16:03.913179 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:16:03.913179 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:16:03.913179 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:16:03.913179 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:16:03.914072 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:16:03.914072 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:16:03.914072 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:16:03.914072 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:16:03.914072 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:16:03.914072 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:16:03.914072 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:16:03.914072 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:16:03.914072 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:16:03.914072 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:16:03.914072 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 09:16:03.914072 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:16:03.914072 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 466/933] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Jun 27 09:16:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 09:16:03.920250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f53bde1-0ded-46b3-84b7-9eea7069916d None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:03.931039 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 468/934] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Jun 27 09:16:03 2022] POST /identity/v3/endpoints => generated 347 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 09:16:04.047099 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f53bde1-0ded-46b3-84b7-9eea7069916d None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:04.090631 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd4c6b-ff68-4d9a-b0b3-bfb8f32a922e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:04.091358 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd4c6b-ff68-4d9a-b0b3-bfb8f32a922e None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:04.091643 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd4c6b-ff68-4d9a-b0b3-bfb8f32a922e None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:04.091914 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd4c6b-ff68-4d9a-b0b3-bfb8f32a922e None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:04.092896 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd4c6b-ff68-4d9a-b0b3-bfb8f32a922e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:04.093257 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd4c6b-ff68-4d9a-b0b3-bfb8f32a922e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:04.094659 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd4c6b-ff68-4d9a-b0b3-bfb8f32a922e None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:04.104932 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 467/935] 10.222.0.62 () {56 vars in 1115 bytes} [Mon Jun 27 09:16:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:16:04.111485 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c169a-6351-4478-8c44-50d477a325e7 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:04.190457 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:04.216861 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c169a-6351-4478-8c44-50d477a325e7 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:04.254282 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803f40e-9a3d-445b-a084-893b0a959481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:04.255093 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803f40e-9a3d-445b-a084-893b0a959481 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:04.255374 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803f40e-9a3d-445b-a084-893b0a959481 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:04.255648 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803f40e-9a3d-445b-a084-893b0a959481 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:04.267047 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6803f40e-9a3d-445b-a084-893b0a959481 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:04.268522 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6803f40e-9a3d-445b-a084-893b0a959481 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:04.287428 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-6803f40e-9a3d-445b-a084-893b0a959481 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:16:04.287428 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:04.287428 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:16:04.287428 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:16:04.287428 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:16:04.287428 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:16:04.287428 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:16:04.287428 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:16:04.287428 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:16:04.287428 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:16:04.287428 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:16:04.287428 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:16:04.287428 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:16:04.287428 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:16:04.287428 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:16:04.289674 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:16:04.289674 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:16:04.289674 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:16:04.289674 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:16:04.289674 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:16:04.289674 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:16:04.289674 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:16:04.289674 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:16:04.289674 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:16:04.289674 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:16:04.289674 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:16:04.289674 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:16:04.289674 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:16:04.289674 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:16:04.289674 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:16:04.289674 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:16:04.289674 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:16:04.291934 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:16:04.291934 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:16:04.291934 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:16:04.291934 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:16:04.291934 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 469/936] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:16:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:16:04.294823 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd4c6b-ff68-4d9a-b0b3-bfb8f32a922e None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:04.341176 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:04.403683 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd4c6b-ff68-4d9a-b0b3-bfb8f32a922e None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:04.438777 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f694538-ab6f-46d8-838f-5612fdd8e025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:04.439438 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f694538-ab6f-46d8-838f-5612fdd8e025 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:04.439814 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f694538-ab6f-46d8-838f-5612fdd8e025 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:04.440090 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f694538-ab6f-46d8-838f-5612fdd8e025 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:04.441479 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f694538-ab6f-46d8-838f-5612fdd8e025 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:04.441839 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f694538-ab6f-46d8-838f-5612fdd8e025 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:04.443255 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f694538-ab6f-46d8-838f-5612fdd8e025 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:04.455686 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 468/937] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:16:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:04.461337 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803f40e-9a3d-445b-a084-893b0a959481 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:04.575628 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803f40e-9a3d-445b-a084-893b0a959481 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:04.602789 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:04.611543 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46268bff-6e86-4624-a700-1d5a2b0e35ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:04.612956 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46268bff-6e86-4624-a700-1d5a2b0e35ac None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:04.616535 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46268bff-6e86-4624-a700-1d5a2b0e35ac None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:04.616535 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46268bff-6e86-4624-a700-1d5a2b0e35ac None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:04.625336 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46268bff-6e86-4624-a700-1d5a2b0e35ac None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:04.626791 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46268bff-6e86-4624-a700-1d5a2b0e35ac None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:04.642715 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-46268bff-6e86-4624-a700-1d5a2b0e35ac None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 09:16:04.642715 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:04.642715 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:16:04.642715 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:16:04.642715 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:16:04.642715 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:16:04.642715 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:16:04.642715 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:16:04.642715 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:16:04.642715 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:16:04.642715 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:16:04.642715 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:16:04.642715 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 09:16:04.642715 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 09:16:04.642715 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 09:16:04.642715 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 09:16:04.643726 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:16:04.643726 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:16:04.643726 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 09:16:04.643726 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:16:04.643726 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 09:16:04.643726 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:16:04.643726 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:16:04.643726 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:16:04.643726 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:16:04.643726 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:16:04.643726 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:16:04.643726 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:16:04.643726 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:16:04.643726 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:16:04.643726 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:16:04.643726 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:16:04.643726 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:16:04.643726 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:16:04.644736 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:16:04.644736 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:16:04.644736 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 09:16:04.644736 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 09:16:04.644736 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 09:16:04.644736 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 09:16:04.644736 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 09:16:04.644736 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 09:16:04.644736 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 09:16:04.644736 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:16:04.644736 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 470/938] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Jun 27 09:16:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:16:04.649985 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f694538-ab6f-46d8-838f-5612fdd8e025 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:04.748857 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:04.754683 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f694538-ab6f-46d8-838f-5612fdd8e025 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:04.792051 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3088b7d-d319-4b43-8192-0f77548eeb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:04.793173 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3088b7d-d319-4b43-8192-0f77548eeb51 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:04.793659 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3088b7d-d319-4b43-8192-0f77548eeb51 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:04.794128 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3088b7d-d319-4b43-8192-0f77548eeb51 None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:04.795165 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3088b7d-d319-4b43-8192-0f77548eeb51 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:04.795675 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3088b7d-d319-4b43-8192-0f77548eeb51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:04.797481 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3088b7d-d319-4b43-8192-0f77548eeb51 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:04.823703 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 469/939] 10.222.0.62 () {56 vars in 1149 bytes} [Mon Jun 27 09:16:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:04.832255 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46268bff-6e86-4624-a700-1d5a2b0e35ac None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:04.839808 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386c268-21b8-46bc-8ccb-82da8391d1c8 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:04.840089 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386c268-21b8-46bc-8ccb-82da8391d1c8 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:04.840380 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386c268-21b8-46bc-8ccb-82da8391d1c8 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:04.842108 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 470/940] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:16:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 09:16:04.847226 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233df864-d13a-4694-a348-8a2bdfed6405 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:04.847475 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233df864-d13a-4694-a348-8a2bdfed6405 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:04.847747 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233df864-d13a-4694-a348-8a2bdfed6405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:04.865926 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-233df864-d13a-4694-a348-8a2bdfed6405 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:16:04.867333 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-233df864-d13a-4694-a348-8a2bdfed6405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:16:04.941875 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46268bff-6e86-4624-a700-1d5a2b0e35ac None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:04.944469 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 471/941] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:16:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 09:16:04.963664 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233df864-d13a-4694-a348-8a2bdfed6405 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:04.977725 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a57cea-0e30-44be-b650-00a6115975af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:04.978845 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a57cea-0e30-44be-b650-00a6115975af None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:04.979328 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a57cea-0e30-44be-b650-00a6115975af None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:04.979800 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a57cea-0e30-44be-b650-00a6115975af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:04.991048 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a57cea-0e30-44be-b650-00a6115975af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:04.992810 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a57cea-0e30-44be-b650-00a6115975af None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:05.011105 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-80a57cea-0e30-44be-b650-00a6115975af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:16:05.011105 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:05.011105 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:16:05.011105 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:16:05.011105 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:16:05.011105 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:16:05.011105 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:16:05.011105 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:16:05.011105 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:16:05.011105 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:16:05.011105 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:16:05.011105 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:16:05.011105 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:16:05.011105 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:16:05.011105 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:16:05.012049 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:16:05.012049 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:16:05.012049 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:16:05.012049 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:16:05.012049 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:16:05.012049 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:16:05.012049 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:16:05.012049 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:16:05.012049 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:16:05.012049 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:16:05.012049 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:16:05.012049 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:16:05.012049 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:16:05.012049 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:16:05.012049 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:16:05.012049 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:16:05.012049 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:16:05.013007 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:16:05.013007 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:16:05.013007 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:16:05.013007 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:16:05.015227 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 471/942] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:16:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:16:05.021396 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a57cea-0e30-44be-b650-00a6115975af None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:05.070745 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233df864-d13a-4694-a348-8a2bdfed6405 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:05.092629 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:05.092822 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:05.130621 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc0539-7d1f-4bf9-a269-ddb9832066bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:05.130621 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc0539-7d1f-4bf9-a269-ddb9832066bf None admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:05.130621 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc0539-7d1f-4bf9-a269-ddb9832066bf None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:05.130621 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc0539-7d1f-4bf9-a269-ddb9832066bf None admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:05.131099 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fc0539-7d1f-4bf9-a269-ddb9832066bf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:05.131099 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fc0539-7d1f-4bf9-a269-ddb9832066bf None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:05.131099 dv-cinder-847730-1-smb devstack@keystone.service[80307]: WARNING keystone.server.flask.common [None req-a6fc0539-7d1f-4bf9-a269-ddb9832066bf None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 27 09:16:05.131292 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a57cea-0e30-44be-b650-00a6115975af None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:05.167018 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a87ef-feb9-4d7c-bd3c-eeaeddf57f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:05.168024 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a87ef-feb9-4d7c-bd3c-eeaeddf57f34 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:05.168417 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a87ef-feb9-4d7c-bd3c-eeaeddf57f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:05.168755 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a87ef-feb9-4d7c-bd3c-eeaeddf57f34 None admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:05.169557 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a87ef-feb9-4d7c-bd3c-eeaeddf57f34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:05.169948 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a87ef-feb9-4d7c-bd3c-eeaeddf57f34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:05.171409 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a87ef-feb9-4d7c-bd3c-eeaeddf57f34 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:05.180030 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.sql.core [None req-a6fc0539-7d1f-4bf9-a269-ddb9832066bf None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 27 09:16:05.180030 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 27 09:16:05.180030 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [parameters: {'id': 'c8f8ccb7bd894c02aa48b9c582449813', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 27 09:16:05.180030 dv-cinder-847730-1-smb devstack@keystone.service[80307]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80307) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 27 09:16:05.187995 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-a6fc0539-7d1f-4bf9-a269-ddb9832066bf None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c8f8ccb7bd894c02aa48b9c582449813.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c8f8ccb7bd894c02aa48b9c582449813. Jun 27 09:16:05.187995 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:05.187995 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 27 09:16:05.187995 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 27 09:16:05.187995 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 27 09:16:05.187995 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 27 09:16:05.187995 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 27 09:16:05.187995 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application result = self._query(query) Jun 27 09:16:05.187995 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 27 09:16:05.187995 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application conn.query(q) Jun 27 09:16:05.187995 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 27 09:16:05.187995 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 27 09:16:05.187995 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 27 09:16:05.188875 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application result.read() Jun 27 09:16:05.188875 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 27 09:16:05.188875 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 27 09:16:05.188875 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 27 09:16:05.188875 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 27 09:16:05.188875 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 27 09:16:05.188875 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 27 09:16:05.188875 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 27 09:16:05.188875 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 27 09:16:05.188875 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 27 09:16:05.188875 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:16:05.188875 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 27 09:16:05.188875 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:16:05.188875 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:05.188875 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 27 09:16:05.188875 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 27 09:16:05.188875 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 27 09:16:05.188875 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 27 09:16:05.189883 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 27 09:16:05.189883 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application next(self.gen) Jun 27 09:16:05.189883 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 27 09:16:05.189883 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application yield resource Jun 27 09:16:05.189883 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 27 09:16:05.189883 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application next(self.gen) Jun 27 09:16:05.189883 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 27 09:16:05.189883 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self.session.rollback() Jun 27 09:16:05.189883 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 27 09:16:05.189883 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self.force_reraise() Jun 27 09:16:05.189883 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 27 09:16:05.189883 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise self.value Jun 27 09:16:05.189883 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 27 09:16:05.189883 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 27 09:16:05.189883 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 27 09:16:05.189883 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application session.commit() Jun 27 09:16:05.189883 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 27 09:16:05.190856 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 27 09:16:05.190856 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 27 09:16:05.190856 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._prepare_impl() Jun 27 09:16:05.190856 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 27 09:16:05.190856 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self.session.flush() Jun 27 09:16:05.190856 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 27 09:16:05.190856 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._flush(objects) Jun 27 09:16:05.190856 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 27 09:16:05.190856 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 27 09:16:05.190856 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 27 09:16:05.190856 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application compat.raise_( Jun 27 09:16:05.190856 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 27 09:16:05.190856 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception Jun 27 09:16:05.190856 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 27 09:16:05.190856 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application flush_context.execute() Jun 27 09:16:05.190856 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 27 09:16:05.190856 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rec.execute(self) Jun 27 09:16:05.191776 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 27 09:16:05.191776 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 27 09:16:05.191776 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 27 09:16:05.191776 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 27 09:16:05.191776 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 27 09:16:05.191776 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 27 09:16:05.191776 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 27 09:16:05.191776 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 27 09:16:05.191776 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 27 09:16:05.191776 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 27 09:16:05.191776 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 27 09:16:05.191776 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 27 09:16:05.191776 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 27 09:16:05.191776 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 27 09:16:05.191776 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 27 09:16:05.194188 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 27 09:16:05.194188 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 27 09:16:05.194188 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception Jun 27 09:16:05.194188 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 27 09:16:05.194188 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 27 09:16:05.194188 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 27 09:16:05.194188 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 27 09:16:05.194188 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 27 09:16:05.194188 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application result = self._query(query) Jun 27 09:16:05.194188 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 27 09:16:05.194188 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application conn.query(q) Jun 27 09:16:05.194188 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 27 09:16:05.194188 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 27 09:16:05.194188 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 27 09:16:05.194188 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application result.read() Jun 27 09:16:05.194188 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 27 09:16:05.194188 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 27 09:16:05.196397 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 27 09:16:05.196397 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 27 09:16:05.196397 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 27 09:16:05.196397 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 27 09:16:05.196397 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 27 09:16:05.196397 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 27 09:16:05.196397 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 27 09:16:05.196397 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 27 09:16:05.196397 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [parameters: {'id': 'c8f8ccb7bd894c02aa48b9c582449813', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 27 09:16:05.196397 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 27 09:16:05.196397 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:16:05.196397 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 09:16:05.196397 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:16:05.196397 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:05.196397 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 27 09:16:05.198453 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 27 09:16:05.198453 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 27 09:16:05.198453 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 27 09:16:05.198453 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 27 09:16:05.198453 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:16:05.198453 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 09:16:05.198453 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:16:05.198453 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:05.198453 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:16:05.198453 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:16:05.198453 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:16:05.198453 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:16:05.198453 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:16:05.198453 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:16:05.198453 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:16:05.198453 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:16:05.198453 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:16:05.200176 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:16:05.200176 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 27 09:16:05.200176 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 27 09:16:05.200176 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:16:05.200176 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:16:05.200176 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 27 09:16:05.200176 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 27 09:16:05.200176 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c8f8ccb7bd894c02aa48b9c582449813. Jun 27 09:16:05.200176 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:16:05.200176 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 472/943] 10.222.0.62 () {60 vars in 1140 bytes} [Mon Jun 27 09:16:04 2022] POST /identity/v3/projects => generated 262 bytes in 226 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:16:05.200176 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc0539-7d1f-4bf9-a269-ddb9832066bf None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:05.207320 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 472/944] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:16:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:16:05.207320 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a87ef-feb9-4d7c-bd3c-eeaeddf57f34 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:05.324050 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:05.327870 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a87ef-feb9-4d7c-bd3c-eeaeddf57f34 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:05.343218 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc0539-7d1f-4bf9-a269-ddb9832066bf None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:05.365408 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71c8af-ed82-408d-9932-7e42c658dacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:05.366910 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71c8af-ed82-408d-9932-7e42c658dacf None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:05.366910 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71c8af-ed82-408d-9932-7e42c658dacf None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:05.367648 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71c8af-ed82-408d-9932-7e42c658dacf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:05.375706 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b71c8af-ed82-408d-9932-7e42c658dacf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:05.377615 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b71c8af-ed82-408d-9932-7e42c658dacf None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:05.388791 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59323733-ef11-46e8-b9bc-77f4a7a3a6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:05.389595 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59323733-ef11-46e8-b9bc-77f4a7a3a6da None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:05.389947 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59323733-ef11-46e8-b9bc-77f4a7a3a6da None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:05.390296 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59323733-ef11-46e8-b9bc-77f4a7a3a6da None admin] PATH_INFO: `/v3/projects/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:05.392802 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-1b71c8af-ed82-408d-9932-7e42c658dacf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:16:05.392802 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:05.392802 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:16:05.392802 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:16:05.392802 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:16:05.392802 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:16:05.392802 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:16:05.392802 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:16:05.392802 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:16:05.392802 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:16:05.392802 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:16:05.392802 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:16:05.392802 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 09:16:05.392802 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 09:16:05.392802 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 09:16:05.395172 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 09:16:05.395172 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:16:05.395172 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:16:05.395172 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:16:05.395172 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:16:05.395172 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:16:05.395172 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:16:05.395172 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:16:05.395172 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:16:05.395172 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:16:05.395172 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:16:05.395172 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:16:05.395172 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:16:05.395172 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:16:05.395172 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:16:05.395172 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:16:05.395172 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:16:05.397373 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 09:16:05.397373 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 09:16:05.397373 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 09:16:05.397373 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 09:16:05.397373 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 09:16:05.397373 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 09:16:05.397373 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:16:05.397373 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:16:05.397373 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 473/945] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:16:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:16:05.397373 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb30fd-c95a-4f99-87a8-2a9e31db0dcd None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:05.398856 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb30fd-c95a-4f99-87a8-2a9e31db0dcd None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:05.398856 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb30fd-c95a-4f99-87a8-2a9e31db0dcd None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:05.403805 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 474/946] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:16:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:16:05.404632 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb30fd-c95a-4f99-87a8-2a9e31db0dcd None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:05.404850 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59323733-ef11-46e8-b9bc-77f4a7a3a6da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:05.406545 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59323733-ef11-46e8-b9bc-77f4a7a3a6da None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:05.411151 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:05.423627 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-59323733-ef11-46e8-b9bc-77f4a7a3a6da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:16:05.423627 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:05.423627 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:16:05.423627 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:16:05.423627 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:16:05.423627 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:16:05.423627 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:16:05.423627 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:16:05.423627 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:16:05.423627 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:16:05.423627 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:16:05.423627 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:16:05.423627 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 09:16:05.423627 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 09:16:05.423627 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 09:16:05.424972 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 09:16:05.424972 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:16:05.424972 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:16:05.424972 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:16:05.424972 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:16:05.424972 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:16:05.424972 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:16:05.424972 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:16:05.424972 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:16:05.424972 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:16:05.424972 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:16:05.424972 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:16:05.424972 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:16:05.424972 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:16:05.424972 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:16:05.424972 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:16:05.424972 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:16:05.425859 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 09:16:05.425859 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 09:16:05.425859 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 09:16:05.425859 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 09:16:05.425859 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 09:16:05.425859 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 09:16:05.425859 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:16:05.425859 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:16:05.429751 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 473/947] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:16:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:16:05.430950 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b04bb-34f6-4d20-811d-4128e464d673 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:05.431503 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b04bb-34f6-4d20-811d-4128e464d673 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:05.432001 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b04bb-34f6-4d20-811d-4128e464d673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:05.449901 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-200b04bb-34f6-4d20-811d-4128e464d673 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:16:05.451417 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-200b04bb-34f6-4d20-811d-4128e464d673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:16:05.523504 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb30fd-c95a-4f99-87a8-2a9e31db0dcd None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:05.544226 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 474/948] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:16:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 09:16:05.544226 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b04bb-34f6-4d20-811d-4128e464d673 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:05.563921 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57efec-dae3-44e2-a0d1-b9c0318c5338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:05.564621 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57efec-dae3-44e2-a0d1-b9c0318c5338 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:05.564906 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57efec-dae3-44e2-a0d1-b9c0318c5338 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:05.565182 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57efec-dae3-44e2-a0d1-b9c0318c5338 None admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:05.566510 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d57efec-dae3-44e2-a0d1-b9c0318c5338 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:05.566823 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d57efec-dae3-44e2-a0d1-b9c0318c5338 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:05.568281 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d57efec-dae3-44e2-a0d1-b9c0318c5338 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:05.580855 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 475/949] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Jun 27 09:16:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:05.582082 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57efec-dae3-44e2-a0d1-b9c0318c5338 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:05.602071 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:05.658287 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b04bb-34f6-4d20-811d-4128e464d673 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:05.684437 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57efec-dae3-44e2-a0d1-b9c0318c5338 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:05.689787 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:05.697536 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881be42-42f6-4f34-aee7-a58b711be112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:05.698195 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881be42-42f6-4f34-aee7-a58b711be112 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:05.701255 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881be42-42f6-4f34-aee7-a58b711be112 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:05.701255 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881be42-42f6-4f34-aee7-a58b711be112 None admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:05.701255 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c881be42-42f6-4f34-aee7-a58b711be112 None admin] RBAC: Adding query filter params (name=service) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:05.701255 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c881be42-42f6-4f34-aee7-a58b711be112 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:05.701255 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c881be42-42f6-4f34-aee7-a58b711be112 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:05.728238 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 475/950] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Jun 27 09:16:05 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:05.728238 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881be42-42f6-4f34-aee7-a58b711be112 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:05.732234 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdae792-302a-4419-b9de-d7f907b4846d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:05.732234 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdae792-302a-4419-b9de-d7f907b4846d None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:05.732234 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdae792-302a-4419-b9de-d7f907b4846d None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:05.732234 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdae792-302a-4419-b9de-d7f907b4846d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:05.732661 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdae792-302a-4419-b9de-d7f907b4846d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:05.732661 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdae792-302a-4419-b9de-d7f907b4846d None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:05.746612 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-afdae792-302a-4419-b9de-d7f907b4846d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 09:16:05.746612 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:05.746612 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 09:16:05.746612 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 09:16:05.746612 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 09:16:05.746612 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 09:16:05.746612 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 09:16:05.746612 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 09:16:05.746612 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 09:16:05.746612 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:16:05.746612 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 09:16:05.746612 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:16:05.746612 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:05.746612 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:16:05.746612 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:16:05.746612 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:16:05.746612 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:16:05.747911 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:16:05.747911 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:16:05.747911 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:16:05.747911 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:16:05.747911 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:16:05.747911 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:16:05.747911 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 09:16:05.747911 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 09:16:05.747911 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 09:16:05.747911 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 09:16:05.747911 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:16:05.747911 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:16:05.747911 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:16:05.747911 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:16:05.747911 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:16:05.747911 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:16:05.748828 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:16:05.748828 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:16:05.748828 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:16:05.748828 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:16:05.748828 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:16:05.748828 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:16:05.748828 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:16:05.748828 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:16:05.748828 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:16:05.748828 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:16:05.748828 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 09:16:05.748828 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 09:16:05.748828 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 09:16:05.748828 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:16:05.748828 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 476/951] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Jun 27 09:16:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:16:05.756069 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdae792-302a-4419-b9de-d7f907b4846d None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:05.857321 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:05.865700 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881be42-42f6-4f34-aee7-a58b711be112 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:05.877368 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdae792-302a-4419-b9de-d7f907b4846d None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:05.913505 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220d0de-9df5-4321-a4aa-152d9c76b40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:05.914326 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220d0de-9df5-4321-a4aa-152d9c76b40f None admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:05.914609 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220d0de-9df5-4321-a4aa-152d9c76b40f None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:05.915077 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220d0de-9df5-4321-a4aa-152d9c76b40f None admin] PATH_INFO: `/v3/projects/4ba8e40538db4d89b93469b79322d20e/users/8f5d1f2327914f9fb070c6212582b6dc/roles/6278d7f8619447b4b75ea2e9f2d03cb4` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:05.917908 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d220d0de-9df5-4321-a4aa-152d9c76b40f None admin] RBAC: Authorizing `identity:create_grant(project_id=4ba8e40538db4d89b93469b79322d20e, user_id=8f5d1f2327914f9fb070c6212582b6dc, role_id=6278d7f8619447b4b75ea2e9f2d03cb4)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:05.919376 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d220d0de-9df5-4321-a4aa-152d9c76b40f None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:05.919682 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96292f8f-9771-4a3d-8d61-436377ef4172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:05.920495 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96292f8f-9771-4a3d-8d61-436377ef4172 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:05.920781 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96292f8f-9771-4a3d-8d61-436377ef4172 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:05.921055 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96292f8f-9771-4a3d-8d61-436377ef4172 None admin] PATH_INFO: `/v3/services` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:05.921959 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96292f8f-9771-4a3d-8d61-436377ef4172 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:05.922267 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96292f8f-9771-4a3d-8d61-436377ef4172 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:05.924241 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96292f8f-9771-4a3d-8d61-436377ef4172 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:05.929948 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 477/952] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Jun 27 09:16:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:05.935819 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96292f8f-9771-4a3d-8d61-436377ef4172 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:05.977385 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 476/953] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Jun 27 09:16:05 2022] PUT /identity/v3/projects/4ba8e40538db4d89b93469b79322d20e/users/8f5d1f2327914f9fb070c6212582b6dc/roles/6278d7f8619447b4b75ea2e9f2d03cb4 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:16:06.057364 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96292f8f-9771-4a3d-8d61-436377ef4172 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:06.098755 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d908a-9b0c-454a-a628-1f980fa4600c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:06.099441 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d908a-9b0c-454a-a628-1f980fa4600c None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:06.099722 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d908a-9b0c-454a-a628-1f980fa4600c None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:06.099998 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d908a-9b0c-454a-a628-1f980fa4600c None admin] PATH_INFO: `/v3/services` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:06.100825 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d908a-9b0c-454a-a628-1f980fa4600c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:06.101138 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d908a-9b0c-454a-a628-1f980fa4600c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:06.114438 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d908a-9b0c-454a-a628-1f980fa4600c None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:06.120908 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 478/954] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Jun 27 09:16:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:16:06.129524 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220d0de-9df5-4321-a4aa-152d9c76b40f None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:06.190289 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:06.202040 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24094a-ef40-45b0-9c56-66629a670158 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:06.205040 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24094a-ef40-45b0-9c56-66629a670158 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:06.205040 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24094a-ef40-45b0-9c56-66629a670158 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:06.205040 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 479/955] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 09:16:06.209743 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce7791-609d-442e-bb5c-40c91c1628c6 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:06.210287 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce7791-609d-442e-bb5c-40c91c1628c6 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:06.210569 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce7791-609d-442e-bb5c-40c91c1628c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:06.235184 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-41ce7791-609d-442e-bb5c-40c91c1628c6 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:16:06.237047 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-41ce7791-609d-442e-bb5c-40c91c1628c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:16:06.242500 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:06.247321 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220d0de-9df5-4321-a4aa-152d9c76b40f None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:06.283302 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8942c0d4-8b40-47a0-9319-64fac2b96be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:06.284713 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942c0d4-8b40-47a0-9319-64fac2b96be7 None admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:06.284900 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942c0d4-8b40-47a0-9319-64fac2b96be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:06.285261 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942c0d4-8b40-47a0-9319-64fac2b96be7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:06.286789 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8942c0d4-8b40-47a0-9319-64fac2b96be7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:06.287526 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8942c0d4-8b40-47a0-9319-64fac2b96be7 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:06.323397 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 480/956] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:16:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 09:16:06.342301 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 477/957] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Jun 27 09:16:06 2022] POST /identity/v3/endpoints => generated 349 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:16:06.347156 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce7791-609d-442e-bb5c-40c91c1628c6 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:06.464963 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce7791-609d-442e-bb5c-40c91c1628c6 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:06.515486 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493096e1-95bc-4708-a836-6c90474bc419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:06.516327 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493096e1-95bc-4708-a836-6c90474bc419 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:06.516602 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493096e1-95bc-4708-a836-6c90474bc419 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:06.516874 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493096e1-95bc-4708-a836-6c90474bc419 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:06.517537 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493096e1-95bc-4708-a836-6c90474bc419 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:06.519501 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493096e1-95bc-4708-a836-6c90474bc419 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:06.522830 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:06.534030 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-493096e1-95bc-4708-a836-6c90474bc419 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 27 09:16:06.534030 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:06.534030 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 09:16:06.534030 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 09:16:06.534030 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 09:16:06.534030 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 09:16:06.534030 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 09:16:06.534030 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 09:16:06.534030 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 27 09:16:06.534030 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:16:06.534030 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 09:16:06.534030 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:16:06.534030 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:06.534030 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:16:06.534030 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:16:06.534030 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:16:06.534030 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:16:06.535180 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:16:06.535180 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:16:06.535180 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:16:06.535180 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:16:06.535180 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:16:06.535180 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:16:06.535180 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 09:16:06.535180 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 09:16:06.535180 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 09:16:06.535180 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 09:16:06.535180 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:16:06.535180 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:16:06.535180 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:16:06.535180 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:16:06.535180 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:16:06.535180 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:16:06.536472 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:16:06.536472 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:16:06.536472 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:16:06.536472 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:16:06.536472 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:16:06.536472 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:16:06.536472 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:16:06.536472 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:16:06.536472 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:16:06.536472 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:16:06.536472 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 09:16:06.536472 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 09:16:06.536472 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 27 09:16:06.536472 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:16:06.536472 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 481/958] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:16:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:16:06.543731 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8942c0d4-8b40-47a0-9319-64fac2b96be7 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:06.652463 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8942c0d4-8b40-47a0-9319-64fac2b96be7 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:06.660227 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:06.689414 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11fc832-6b44-4c7a-a635-3770719ac0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:06.690088 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fc832-6b44-4c7a-a635-3770719ac0f4 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:06.690395 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fc832-6b44-4c7a-a635-3770719ac0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:06.691396 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fc832-6b44-4c7a-a635-3770719ac0f4 None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:06.692114 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11fc832-6b44-4c7a-a635-3770719ac0f4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:06.692449 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11fc832-6b44-4c7a-a635-3770719ac0f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:06.693922 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11fc832-6b44-4c7a-a635-3770719ac0f4 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:06.699419 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 478/959] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Jun 27 09:16:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:06.705232 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493096e1-95bc-4708-a836-6c90474bc419 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:06.814207 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493096e1-95bc-4708-a836-6c90474bc419 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:06.852022 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a1a4f-10ee-4333-b408-2f69578c1834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:06.852719 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a1a4f-10ee-4333-b408-2f69578c1834 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:06.853003 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a1a4f-10ee-4333-b408-2f69578c1834 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:06.853281 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a1a4f-10ee-4333-b408-2f69578c1834 None admin] PATH_INFO: `/v3/services` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:06.853995 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28a1a4f-10ee-4333-b408-2f69578c1834 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:06.854303 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28a1a4f-10ee-4333-b408-2f69578c1834 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:06.855684 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28a1a4f-10ee-4333-b408-2f69578c1834 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:06.860998 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 482/960] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Jun 27 09:16:06 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:07.948571 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e897888-ccf1-4ef8-afd0-96e130d166ef None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:07.949598 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e897888-ccf1-4ef8-afd0-96e130d166ef None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:07.950114 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e897888-ccf1-4ef8-afd0-96e130d166ef None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:07.952033 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 479/961] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:16:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:16:07.957702 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da9773-6a78-4109-876f-ead869421b04 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:07.958583 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da9773-6a78-4109-876f-ead869421b04 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:07.959062 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da9773-6a78-4109-876f-ead869421b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:07.979212 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-96da9773-6a78-4109-876f-ead869421b04 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:16:07.980905 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-96da9773-6a78-4109-876f-ead869421b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:16:08.049104 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:08.059164 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 483/962] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:16:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 09:16:08.085135 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e897888-ccf1-4ef8-afd0-96e130d166ef None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:08.105114 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3236157-8d2e-461c-a23a-4a364e399ad0 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:08.105332 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3236157-8d2e-461c-a23a-4a364e399ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:08.105553 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3236157-8d2e-461c-a23a-4a364e399ad0 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:08.107158 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 484/963] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:16:08.112848 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4e38b-e664-497e-b736-a9b668d0d27b None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:08.113253 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4e38b-e664-497e-b736-a9b668d0d27b None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:08.113621 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4e38b-e664-497e-b736-a9b668d0d27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:08.136007 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-40f4e38b-e664-497e-b736-a9b668d0d27b None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:16:08.137529 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-40f4e38b-e664-497e-b736-a9b668d0d27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:16:08.216284 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e897888-ccf1-4ef8-afd0-96e130d166ef None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:08.217822 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 485/964] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:16:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 09:16:08.241435 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4e38b-e664-497e-b736-a9b668d0d27b None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:08.253566 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb2cde-5858-4acc-a414-920c20ce4f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:08.254236 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb2cde-5858-4acc-a414-920c20ce4f87 None admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:08.254517 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb2cde-5858-4acc-a414-920c20ce4f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:08.254790 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb2cde-5858-4acc-a414-920c20ce4f87 None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:08.255821 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb2cde-5858-4acc-a414-920c20ce4f87 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:08.257548 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb2cde-5858-4acc-a414-920c20ce4f87 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:08.301153 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.sql.core [None req-52fb2cde-5858-4acc-a414-920c20ce4f87 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 27 09:16:08.301153 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 27 09:16:08.301153 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [parameters: {'user_id': '5214020680264daeb11a7708614ef1b5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 27 09:16:08.301153 dv-cinder-847730-1-smb devstack@keystone.service[80307]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80307) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 27 09:16:08.311645 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-52fb2cde-5858-4acc-a414-920c20ce4f87 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 27 09:16:08.311645 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:08.311645 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 27 09:16:08.311645 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 27 09:16:08.311645 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 27 09:16:08.311645 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 27 09:16:08.311645 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 27 09:16:08.311645 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application result = self._query(query) Jun 27 09:16:08.311645 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 27 09:16:08.311645 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application conn.query(q) Jun 27 09:16:08.311645 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 27 09:16:08.311645 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 27 09:16:08.311645 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 27 09:16:08.311645 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application result.read() Jun 27 09:16:08.311645 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 27 09:16:08.312601 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 27 09:16:08.312601 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 27 09:16:08.312601 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 27 09:16:08.312601 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 27 09:16:08.312601 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 27 09:16:08.312601 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 27 09:16:08.312601 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 27 09:16:08.312601 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 27 09:16:08.312601 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:16:08.312601 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 27 09:16:08.312601 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:16:08.312601 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:08.312601 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 27 09:16:08.312601 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 27 09:16:08.312601 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 27 09:16:08.312601 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 27 09:16:08.312601 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 27 09:16:08.312601 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application next(self.gen) Jun 27 09:16:08.314250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 27 09:16:08.314250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application yield resource Jun 27 09:16:08.314250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 27 09:16:08.314250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application next(self.gen) Jun 27 09:16:08.314250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 27 09:16:08.314250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self.session.rollback() Jun 27 09:16:08.314250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 27 09:16:08.314250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self.force_reraise() Jun 27 09:16:08.314250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 27 09:16:08.314250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise self.value Jun 27 09:16:08.314250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 27 09:16:08.314250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 27 09:16:08.314250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 27 09:16:08.314250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application session.commit() Jun 27 09:16:08.314250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 27 09:16:08.314250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 27 09:16:08.314250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 27 09:16:08.315136 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._prepare_impl() Jun 27 09:16:08.315136 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 27 09:16:08.315136 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self.session.flush() Jun 27 09:16:08.315136 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 27 09:16:08.315136 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._flush(objects) Jun 27 09:16:08.315136 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 27 09:16:08.315136 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 27 09:16:08.315136 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 27 09:16:08.315136 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application compat.raise_( Jun 27 09:16:08.315136 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 27 09:16:08.315136 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception Jun 27 09:16:08.315136 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 27 09:16:08.315136 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application flush_context.execute() Jun 27 09:16:08.315136 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 27 09:16:08.315136 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rec.execute(self) Jun 27 09:16:08.315136 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 27 09:16:08.315136 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 27 09:16:08.316750 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 27 09:16:08.316750 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 27 09:16:08.316750 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 27 09:16:08.316750 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 27 09:16:08.316750 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 27 09:16:08.316750 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 27 09:16:08.316750 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 27 09:16:08.316750 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 27 09:16:08.316750 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 27 09:16:08.316750 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 27 09:16:08.316750 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 27 09:16:08.316750 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 27 09:16:08.316750 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 27 09:16:08.316750 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 27 09:16:08.316750 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 27 09:16:08.316750 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception Jun 27 09:16:08.317578 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 27 09:16:08.317578 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 27 09:16:08.317578 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 27 09:16:08.317578 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 27 09:16:08.317578 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 27 09:16:08.317578 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application result = self._query(query) Jun 27 09:16:08.317578 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 27 09:16:08.317578 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application conn.query(q) Jun 27 09:16:08.317578 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 27 09:16:08.317578 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 27 09:16:08.317578 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 27 09:16:08.317578 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application result.read() Jun 27 09:16:08.317578 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 27 09:16:08.317578 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 27 09:16:08.317578 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 27 09:16:08.317578 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 27 09:16:08.319560 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 27 09:16:08.319560 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 27 09:16:08.319560 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 27 09:16:08.319560 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 27 09:16:08.319560 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 27 09:16:08.319560 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 27 09:16:08.319560 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [parameters: {'user_id': '5214020680264daeb11a7708614ef1b5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 27 09:16:08.319560 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 27 09:16:08.319560 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:16:08.319560 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 09:16:08.319560 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:16:08.319560 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:08.319560 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:16:08.319560 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:16:08.319560 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:16:08.321514 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:16:08.321514 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:16:08.321514 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:16:08.321514 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:16:08.321514 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:16:08.321514 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:16:08.321514 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:16:08.321514 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 27 09:16:08.321514 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 27 09:16:08.321514 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:16:08.321514 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:16:08.321514 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 09:16:08.321514 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:16:08.321514 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 09:16:08.321514 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:16:08.321514 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 27 09:16:08.321514 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 27 09:16:08.323852 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 27 09:16:08.323852 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 27 09:16:08.323852 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 27 09:16:08.323852 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 27 09:16:08.323852 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 27 09:16:08.323852 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:16:08.323852 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 480/965] 10.222.0.62 () {60 vars in 1131 bytes} [Mon Jun 27 09:16:08 2022] POST /identity/v3/users => generated 160 bytes in 229 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:16:08.323852 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb2cde-5858-4acc-a414-920c20ce4f87 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:08.362995 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:08.370862 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4e38b-e664-497e-b736-a9b668d0d27b None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:08.408505 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:08.424587 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c67f1-5bba-42be-9706-5263c7f30bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:08.425897 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c67f1-5bba-42be-9706-5263c7f30bc0 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:08.426616 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c67f1-5bba-42be-9706-5263c7f30bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:08.427543 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c67f1-5bba-42be-9706-5263c7f30bc0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:08.443277 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c67f1-5bba-42be-9706-5263c7f30bc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:16:08.447962 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb2cde-5858-4acc-a414-920c20ce4f87 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:08.454103 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-6f1c67f1-5bba-42be-9706-5263c7f30bc0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 09:16:08.454103 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:08.454103 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:16:08.454103 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:16:08.454103 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:16:08.454103 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:16:08.454103 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:16:08.454103 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:16:08.454103 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:16:08.454103 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:16:08.454103 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:16:08.454103 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:16:08.454103 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:16:08.454103 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:16:08.454103 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:16:08.454103 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:16:08.455047 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:16:08.455047 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:16:08.455047 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:16:08.455047 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:16:08.455047 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:16:08.455047 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:16:08.455047 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:16:08.455047 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:16:08.455047 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:16:08.455047 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:16:08.455047 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:16:08.455047 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:16:08.455047 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:16:08.455047 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:16:08.455047 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:16:08.455047 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:16:08.455877 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:16:08.455877 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:16:08.455877 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:16:08.455877 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:16:08.455877 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:16:08.455877 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:16:08.455877 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:16:08.455877 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:16:08.455877 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:16:08.455877 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:16:08.455877 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 09:16:08.455877 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:16:08.462979 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 486/966] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Jun 27 09:16:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 09:16:08.464988 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c67f1-5bba-42be-9706-5263c7f30bc0 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:08.490937 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb4da03-5bfb-4ee6-950e-28739748b58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:08.491396 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4da03-5bfb-4ee6-950e-28739748b58e None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:08.491676 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4da03-5bfb-4ee6-950e-28739748b58e None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:08.491945 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4da03-5bfb-4ee6-950e-28739748b58e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:08.500363 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb4da03-5bfb-4ee6-950e-28739748b58e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:08.502018 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb4da03-5bfb-4ee6-950e-28739748b58e None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:08.518746 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-bcb4da03-5bfb-4ee6-950e-28739748b58e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 27 09:16:08.518746 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:08.518746 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:16:08.518746 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:16:08.518746 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:16:08.518746 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:16:08.518746 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:16:08.518746 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:16:08.518746 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:16:08.518746 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:16:08.518746 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:16:08.518746 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:16:08.518746 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 09:16:08.518746 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 09:16:08.518746 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 09:16:08.518746 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 09:16:08.519744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:16:08.519744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:16:08.519744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 09:16:08.519744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:16:08.519744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 09:16:08.519744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:16:08.519744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:16:08.519744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:16:08.519744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:16:08.519744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:16:08.519744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:16:08.519744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:16:08.519744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:16:08.519744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:16:08.519744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:16:08.519744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:16:08.519744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:16:08.519744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:16:08.521297 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:16:08.521297 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:16:08.521297 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 09:16:08.521297 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 09:16:08.521297 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 09:16:08.521297 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 09:16:08.521297 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 09:16:08.521297 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 09:16:08.521297 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 27 09:16:08.521297 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:16:08.521297 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 481/967] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:16:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:16:08.525773 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb4da03-5bfb-4ee6-950e-28739748b58e None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:08.593449 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c67f1-5bba-42be-9706-5263c7f30bc0 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:08.624335 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:08.633258 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a67c0be-0fd0-4aa7-ab71-76ae9e485c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:08.633923 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67c0be-0fd0-4aa7-ab71-76ae9e485c99 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:08.635444 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67c0be-0fd0-4aa7-ab71-76ae9e485c99 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:08.635444 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67c0be-0fd0-4aa7-ab71-76ae9e485c99 None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:08.635705 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb4da03-5bfb-4ee6-950e-28739748b58e None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:08.635797 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a67c0be-0fd0-4aa7-ab71-76ae9e485c99 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:08.635797 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a67c0be-0fd0-4aa7-ab71-76ae9e485c99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:08.636843 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a67c0be-0fd0-4aa7-ab71-76ae9e485c99 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:08.645264 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 487/968] 10.222.0.62 () {56 vars in 1115 bytes} [Mon Jun 27 09:16:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:08.646539 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee65ba-3b81-419f-a401-32d122a65c8d None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:08.646818 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee65ba-3b81-419f-a401-32d122a65c8d None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:08.647094 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee65ba-3b81-419f-a401-32d122a65c8d None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:08.648505 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 488/969] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:16:08.653163 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee65ba-3b81-419f-a401-32d122a65c8d None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:08.678619 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae733e9-63bf-430d-859c-592af7beb106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:08.679288 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae733e9-63bf-430d-859c-592af7beb106 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:08.679570 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae733e9-63bf-430d-859c-592af7beb106 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:08.679844 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae733e9-63bf-430d-859c-592af7beb106 None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:08.680679 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae733e9-63bf-430d-859c-592af7beb106 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:08.680989 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae733e9-63bf-430d-859c-592af7beb106 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:08.682413 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae733e9-63bf-430d-859c-592af7beb106 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:08.710302 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:08.722971 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 482/970] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Jun 27 09:16:08 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:08.730274 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf56fb-f188-4b29-a111-c90cb0dc24a4 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:08.731468 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf56fb-f188-4b29-a111-c90cb0dc24a4 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:08.731937 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf56fb-f188-4b29-a111-c90cb0dc24a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:08.758460 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-02cf56fb-f188-4b29-a111-c90cb0dc24a4 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:16:08.761043 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-02cf56fb-f188-4b29-a111-c90cb0dc24a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:16:08.772700 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee65ba-3b81-419f-a401-32d122a65c8d None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:08.814177 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e51ee-4be3-4c67-a6d5-3ad327f6fa9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:08.815075 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e51ee-4be3-4c67-a6d5-3ad327f6fa9c None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:08.815496 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e51ee-4be3-4c67-a6d5-3ad327f6fa9c None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:08.815833 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e51ee-4be3-4c67-a6d5-3ad327f6fa9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:08.828649 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e51ee-4be3-4c67-a6d5-3ad327f6fa9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:08.830274 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e51ee-4be3-4c67-a6d5-3ad327f6fa9c None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:08.851668 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-2f9e51ee-4be3-4c67-a6d5-3ad327f6fa9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:16:08.851668 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:08.851668 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:16:08.851668 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:16:08.851668 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:16:08.851668 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:16:08.851668 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:16:08.851668 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:16:08.851668 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:16:08.851668 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:16:08.851668 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:16:08.851668 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:16:08.851668 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:16:08.851668 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:16:08.851668 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:16:08.852690 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:16:08.852690 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:16:08.852690 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:16:08.852690 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:16:08.852690 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:16:08.852690 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:16:08.852690 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:16:08.852690 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:16:08.852690 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:16:08.852690 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:16:08.852690 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:16:08.852690 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:16:08.852690 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:16:08.852690 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:16:08.852690 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:16:08.852690 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:16:08.852690 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:16:08.853566 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:16:08.853566 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:16:08.853566 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:16:08.853566 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:16:08.856677 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 489/971] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:16:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:16:08.858837 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e51ee-4be3-4c67-a6d5-3ad327f6fa9c None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:08.866498 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 483/972] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:16:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 09:16:08.889864 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cf56fb-f188-4b29-a111-c90cb0dc24a4 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:08.976674 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:08.988160 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:08.992327 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e51ee-4be3-4c67-a6d5-3ad327f6fa9c None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:08.997507 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cf56fb-f188-4b29-a111-c90cb0dc24a4 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:09.026211 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd7256-ba09-4db0-a5b1-8e6c7ff5cdf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:09.026799 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd7256-ba09-4db0-a5b1-8e6c7ff5cdf0 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:09.027082 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd7256-ba09-4db0-a5b1-8e6c7ff5cdf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:09.027355 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd7256-ba09-4db0-a5b1-8e6c7ff5cdf0 None admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:09.028070 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd7256-ba09-4db0-a5b1-8e6c7ff5cdf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:09.028411 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd7256-ba09-4db0-a5b1-8e6c7ff5cdf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:09.029807 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd7256-ba09-4db0-a5b1-8e6c7ff5cdf0 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:09.031477 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f069c70-c760-41bd-899a-10da84a5ee9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:09.032294 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f069c70-c760-41bd-899a-10da84a5ee9f None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:09.032571 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f069c70-c760-41bd-899a-10da84a5ee9f None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:09.034779 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f069c70-c760-41bd-899a-10da84a5ee9f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:09.034779 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f069c70-c760-41bd-899a-10da84a5ee9f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:09.035028 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f069c70-c760-41bd-899a-10da84a5ee9f None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:09.041093 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 490/973] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:16:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:16:09.042376 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b6014-2554-4337-9f06-4fb57774961c None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:09.042664 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b6014-2554-4337-9f06-4fb57774961c None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:09.042940 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b6014-2554-4337-9f06-4fb57774961c None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:09.044347 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 491/974] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:16:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:16:09.046693 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-5f069c70-c760-41bd-899a-10da84a5ee9f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 09:16:09.046693 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:09.046693 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 09:16:09.046693 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 09:16:09.046693 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 09:16:09.046693 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 09:16:09.046693 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 09:16:09.046693 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 09:16:09.046693 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 09:16:09.046693 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:16:09.046693 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 09:16:09.046693 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:16:09.046693 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:09.046693 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:16:09.046693 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:16:09.046693 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:16:09.046693 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:16:09.047928 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:16:09.047928 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:16:09.047928 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:16:09.047928 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:16:09.047928 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:16:09.047928 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:16:09.047928 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 09:16:09.047928 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 09:16:09.047928 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 09:16:09.047928 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 09:16:09.047928 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:16:09.047928 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:16:09.047928 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:16:09.047928 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:16:09.047928 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:16:09.047928 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:16:09.049123 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:16:09.049123 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:16:09.049123 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:16:09.049123 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:16:09.049123 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:16:09.049123 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:16:09.049123 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:16:09.049123 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:16:09.049123 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:16:09.049123 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:16:09.049123 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 09:16:09.049123 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 09:16:09.049123 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 09:16:09.049123 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:16:09.050724 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b6014-2554-4337-9f06-4fb57774961c None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:09.052484 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 484/975] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Jun 27 09:16:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 09:16:09.053860 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013f4e5-4d86-4bca-87b5-216d2a853054 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:09.054150 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013f4e5-4d86-4bca-87b5-216d2a853054 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:09.054427 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013f4e5-4d86-4bca-87b5-216d2a853054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:09.071415 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-4013f4e5-4d86-4bca-87b5-216d2a853054 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:16:09.072628 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-4013f4e5-4d86-4bca-87b5-216d2a853054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:16:09.140619 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 485/976] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:16:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 09:16:09.141474 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013f4e5-4d86-4bca-87b5-216d2a853054 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:09.157515 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b6014-2554-4337-9f06-4fb57774961c None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:09.193209 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8b083-0ddf-4931-9b93-6c587d071fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:09.194017 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8b083-0ddf-4931-9b93-6c587d071fae None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:09.194302 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8b083-0ddf-4931-9b93-6c587d071fae None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:09.194577 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8b083-0ddf-4931-9b93-6c587d071fae None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:09.201662 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f8b083-0ddf-4931-9b93-6c587d071fae None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:09.203103 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f8b083-0ddf-4931-9b93-6c587d071fae None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:09.214813 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:09.217816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-66f8b083-0ddf-4931-9b93-6c587d071fae None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 09:16:09.217816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:09.217816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:16:09.217816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:16:09.217816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:16:09.217816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:16:09.217816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:16:09.217816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:16:09.217816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:16:09.217816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:16:09.217816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:16:09.217816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:16:09.217816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 09:16:09.217816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 09:16:09.217816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 09:16:09.217816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 09:16:09.218751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:16:09.218751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:16:09.218751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 09:16:09.218751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:16:09.218751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 09:16:09.218751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:16:09.218751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:16:09.218751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:16:09.218751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:16:09.218751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:16:09.218751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:16:09.218751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:16:09.218751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:16:09.218751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:16:09.218751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:16:09.218751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:16:09.218751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:16:09.218751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:16:09.219685 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:16:09.219685 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:16:09.219685 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 09:16:09.219685 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 09:16:09.219685 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 09:16:09.219685 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 09:16:09.219685 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 09:16:09.219685 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 09:16:09.219685 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 09:16:09.219685 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:16:09.219685 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 492/977] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Jun 27 09:16:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:16:09.220325 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8b083-0ddf-4931-9b93-6c587d071fae None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:09.239617 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:09.246582 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013f4e5-4d86-4bca-87b5-216d2a853054 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:09.280882 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb072ec-8929-44f0-a122-029b1c58da4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:09.281549 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb072ec-8929-44f0-a122-029b1c58da4f None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:09.281834 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb072ec-8929-44f0-a122-029b1c58da4f None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:09.282133 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb072ec-8929-44f0-a122-029b1c58da4f None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:09.282812 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb072ec-8929-44f0-a122-029b1c58da4f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:09.283119 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb072ec-8929-44f0-a122-029b1c58da4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:09.285040 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb072ec-8929-44f0-a122-029b1c58da4f None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:09.289759 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 486/978] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Jun 27 09:16:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:09.290588 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb072ec-8929-44f0-a122-029b1c58da4f None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:09.320154 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8b083-0ddf-4931-9b93-6c587d071fae None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:09.353858 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d5d8c6-8adb-45e5-aaff-c77acfda57e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:09.354515 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5d8c6-8adb-45e5-aaff-c77acfda57e4 None admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:09.354796 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5d8c6-8adb-45e5-aaff-c77acfda57e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:09.355071 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5d8c6-8adb-45e5-aaff-c77acfda57e4 None admin] PATH_INFO: `/v3/services` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:09.355779 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d5d8c6-8adb-45e5-aaff-c77acfda57e4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:09.357180 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d5d8c6-8adb-45e5-aaff-c77acfda57e4 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:09.392066 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb072ec-8929-44f0-a122-029b1c58da4f None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:09.427078 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 493/979] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Jun 27 09:16:09 2022] POST /identity/v3/services => generated 242 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:16:09.427809 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d5d8c6-8adb-45e5-aaff-c77acfda57e4 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:09.454582 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45915193-5e3f-46b3-8c5c-de4a43762656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:09.455910 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45915193-5e3f-46b3-8c5c-de4a43762656 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:09.456228 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45915193-5e3f-46b3-8c5c-de4a43762656 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:09.456504 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45915193-5e3f-46b3-8c5c-de4a43762656 None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:09.457372 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45915193-5e3f-46b3-8c5c-de4a43762656 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:09.457698 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45915193-5e3f-46b3-8c5c-de4a43762656 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:09.459861 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45915193-5e3f-46b3-8c5c-de4a43762656 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:09.462020 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:09.484400 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 487/980] 10.222.0.62 () {56 vars in 1149 bytes} [Mon Jun 27 09:16:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:09.491339 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45915193-5e3f-46b3-8c5c-de4a43762656 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:09.528175 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:09.555773 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d5d8c6-8adb-45e5-aaff-c77acfda57e4 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:09.596035 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ae1c2-9cae-4933-a622-ca573c3278e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:09.597530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ae1c2-9cae-4933-a622-ca573c3278e8 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:09.597804 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ae1c2-9cae-4933-a622-ca573c3278e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:09.598317 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ae1c2-9cae-4933-a622-ca573c3278e8 None admin] PATH_INFO: `/v3/services` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:09.599589 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30ae1c2-9cae-4933-a622-ca573c3278e8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:09.599897 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30ae1c2-9cae-4933-a622-ca573c3278e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:09.601313 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30ae1c2-9cae-4933-a622-ca573c3278e8 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:09.607091 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 494/981] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Jun 27 09:16:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:09.609315 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45915193-5e3f-46b3-8c5c-de4a43762656 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:09.613041 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ae1c2-9cae-4933-a622-ca573c3278e8 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:09.647611 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144eca99-656a-4cf9-b4c1-3ec5431ca7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:09.648293 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144eca99-656a-4cf9-b4c1-3ec5431ca7f9 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:09.648628 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144eca99-656a-4cf9-b4c1-3ec5431ca7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:09.648908 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144eca99-656a-4cf9-b4c1-3ec5431ca7f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:09.714894 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:09.720230 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ae1c2-9cae-4933-a622-ca573c3278e8 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:09.726103 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144eca99-656a-4cf9-b4c1-3ec5431ca7f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:09.727589 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144eca99-656a-4cf9-b4c1-3ec5431ca7f9 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:09.757851 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3faa1-dec3-4638-a646-ff43ca363a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:09.758512 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3faa1-dec3-4638-a646-ff43ca363a17 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:09.758801 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3faa1-dec3-4638-a646-ff43ca363a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:09.759077 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3faa1-dec3-4638-a646-ff43ca363a17 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:09.759881 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d3faa1-dec3-4638-a646-ff43ca363a17 None admin] RBAC: Adding query filter params (interface=admin, service_id=1d85a4deec784676952fba22a7883c27, region_id=RegionOne) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:09.760218 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d3faa1-dec3-4638-a646-ff43ca363a17 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:09.761597 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d3faa1-dec3-4638-a646-ff43ca363a17 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:09.767361 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 495/982] 10.222.0.62 () {56 vars in 1249 bytes} [Mon Jun 27 09:16:09 2022] GET /identity/v3/endpoints?service_id=1d85a4deec784676952fba22a7883c27&interface=admin®ion_id=RegionOne => generated 193 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:16:09.773410 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3faa1-dec3-4638-a646-ff43ca363a17 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:09.782829 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:09.839884 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 488/983] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:16:09 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 09:16:09.845089 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144eca99-656a-4cf9-b4c1-3ec5431ca7f9 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:09.884790 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3faa1-dec3-4638-a646-ff43ca363a17 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:09.924492 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a0f8a-2cc9-4c9d-b5b0-6afc65e97cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:09.925196 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a0f8a-2cc9-4c9d-b5b0-6afc65e97cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:09.925479 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a0f8a-2cc9-4c9d-b5b0-6afc65e97cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:09.925796 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a0f8a-2cc9-4c9d-b5b0-6afc65e97cc0 None admin] PATH_INFO: `/v3/services` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:09.926485 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a0f8a-2cc9-4c9d-b5b0-6afc65e97cc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:09.927850 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a0f8a-2cc9-4c9d-b5b0-6afc65e97cc0 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:09.934274 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 496/984] 10.222.0.62 () {56 vars in 1087 bytes} [Mon Jun 27 09:16:09 2022] GET /identity/v3/services => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 09:16:09.953060 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:09.964429 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144eca99-656a-4cf9-b4c1-3ec5431ca7f9 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:10.005518 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c48cb4-2385-4c21-84c0-7846f5cb182a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:10.006334 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c48cb4-2385-4c21-84c0-7846f5cb182a None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:10.006614 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c48cb4-2385-4c21-84c0-7846f5cb182a None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:10.006883 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c48cb4-2385-4c21-84c0-7846f5cb182a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:10.019576 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c48cb4-2385-4c21-84c0-7846f5cb182a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:10.021105 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c48cb4-2385-4c21-84c0-7846f5cb182a None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:10.040447 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-a2c48cb4-2385-4c21-84c0-7846f5cb182a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:16:10.040447 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:10.040447 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:16:10.040447 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:16:10.040447 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:16:10.040447 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:16:10.040447 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:16:10.040447 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:16:10.040447 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:16:10.040447 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:16:10.040447 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:16:10.040447 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:16:10.040447 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:16:10.040447 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:16:10.040447 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:16:10.041447 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:16:10.041447 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:16:10.041447 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:16:10.041447 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:16:10.041447 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:16:10.041447 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:16:10.041447 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:16:10.041447 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:16:10.041447 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:16:10.041447 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:16:10.041447 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:16:10.041447 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:16:10.041447 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:16:10.041447 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:16:10.041447 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:16:10.041447 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:16:10.041447 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:16:10.042366 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:16:10.042366 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:16:10.042366 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:16:10.042366 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:16:10.044545 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 489/985] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:16:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:16:10.047450 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a0f8a-2cc9-4c9d-b5b0-6afc65e97cc0 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:10.126395 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:10.158855 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a0f8a-2cc9-4c9d-b5b0-6afc65e97cc0 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:10.193642 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ac933-2a26-4de2-870c-e88d487bfd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:10.194304 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ac933-2a26-4de2-870c-e88d487bfd2e None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:10.194635 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ac933-2a26-4de2-870c-e88d487bfd2e None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:10.194911 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ac933-2a26-4de2-870c-e88d487bfd2e None admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:10.195633 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ac933-2a26-4de2-870c-e88d487bfd2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:10.195941 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ac933-2a26-4de2-870c-e88d487bfd2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:10.197341 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ac933-2a26-4de2-870c-e88d487bfd2e None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:10.217700 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 497/986] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:16:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:10.219312 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c48cb4-2385-4c21-84c0-7846f5cb182a None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:10.321514 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c48cb4-2385-4c21-84c0-7846f5cb182a None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:10.356375 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c18786-f9c6-43b6-84f7-2a9ee714763d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:10.357170 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c18786-f9c6-43b6-84f7-2a9ee714763d None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:10.357445 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c18786-f9c6-43b6-84f7-2a9ee714763d None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:10.357711 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c18786-f9c6-43b6-84f7-2a9ee714763d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:10.365876 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c18786-f9c6-43b6-84f7-2a9ee714763d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:10.367251 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c18786-f9c6-43b6-84f7-2a9ee714763d None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:10.382213 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-13c18786-f9c6-43b6-84f7-2a9ee714763d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:16:10.382213 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:10.382213 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:16:10.382213 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:16:10.382213 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:16:10.382213 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:16:10.382213 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:16:10.382213 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:16:10.382213 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:16:10.382213 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:16:10.382213 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:16:10.382213 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:16:10.382213 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 09:16:10.382213 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 09:16:10.382213 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 09:16:10.383148 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 09:16:10.383148 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:16:10.383148 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:16:10.383148 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:16:10.383148 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:16:10.383148 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:16:10.383148 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:16:10.383148 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:16:10.383148 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:16:10.383148 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:16:10.383148 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:16:10.383148 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:16:10.383148 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:16:10.383148 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:16:10.383148 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:16:10.383148 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:16:10.383148 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:16:10.384074 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 09:16:10.384074 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 09:16:10.384074 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 09:16:10.384074 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 09:16:10.384074 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 09:16:10.384074 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 09:16:10.384074 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:16:10.384074 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:16:10.384074 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 490/987] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:16:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:16:10.389326 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ac933-2a26-4de2-870c-e88d487bfd2e None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:10.495764 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ac933-2a26-4de2-870c-e88d487bfd2e None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:10.525823 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:10.532503 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f1cc3-02af-4b77-9ad2-8dc11504af68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:10.533176 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f1cc3-02af-4b77-9ad2-8dc11504af68 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:10.533456 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f1cc3-02af-4b77-9ad2-8dc11504af68 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:10.533879 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f1cc3-02af-4b77-9ad2-8dc11504af68 None admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:10.534596 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f1cc3-02af-4b77-9ad2-8dc11504af68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:10.534905 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f1cc3-02af-4b77-9ad2-8dc11504af68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:10.536434 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f1cc3-02af-4b77-9ad2-8dc11504af68 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:10.549330 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 498/988] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Jun 27 09:16:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:16:10.555807 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c18786-f9c6-43b6-84f7-2a9ee714763d None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:10.562119 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:10.666163 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c18786-f9c6-43b6-84f7-2a9ee714763d None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:10.701423 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e7c04-cb29-41bc-9adc-8593b520cba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:10.702184 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e7c04-cb29-41bc-9adc-8593b520cba6 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:10.702572 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e7c04-cb29-41bc-9adc-8593b520cba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:10.702928 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e7c04-cb29-41bc-9adc-8593b520cba6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:10.703979 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547e7c04-cb29-41bc-9adc-8593b520cba6 None admin] RBAC: Adding query filter params (role.id=6278d7f8619447b4b75ea2e9f2d03cb4, scope.project.id=4ba8e40538db4d89b93469b79322d20e, user.id=8f5d1f2327914f9fb070c6212582b6dc) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:10.704340 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547e7c04-cb29-41bc-9adc-8593b520cba6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:10.706158 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547e7c04-cb29-41bc-9adc-8593b520cba6 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:10.713607 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 491/989] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Jun 27 09:16:10 2022] GET /identity/v3/role_assignments?user.id=8f5d1f2327914f9fb070c6212582b6dc&scope.project.id=4ba8e40538db4d89b93469b79322d20e&role.id=6278d7f8619447b4b75ea2e9f2d03cb4 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:11.513577 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe6edf-7d41-4615-8df8-27bf3c1fefb2 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:11.514088 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe6edf-7d41-4615-8df8-27bf3c1fefb2 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:11.514088 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe6edf-7d41-4615-8df8-27bf3c1fefb2 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:11.515474 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 499/990] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:16:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:16:11.521349 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd38553-a9a3-46af-bc8e-4f487c6cf2ac None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:11.521802 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd38553-a9a3-46af-bc8e-4f487c6cf2ac None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:11.521892 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd38553-a9a3-46af-bc8e-4f487c6cf2ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:11.539152 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-0dd38553-a9a3-46af-bc8e-4f487c6cf2ac None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:16:11.540379 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-0dd38553-a9a3-46af-bc8e-4f487c6cf2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:16:11.603005 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:11.609280 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 492/991] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:16:11 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 09:16:11.632454 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe6edf-7d41-4615-8df8-27bf3c1fefb2 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:11.737889 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe6edf-7d41-4615-8df8-27bf3c1fefb2 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:11.774042 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391be61a-90d3-45a0-8d63-26346244861e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:11.774754 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391be61a-90d3-45a0-8d63-26346244861e None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:11.775036 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391be61a-90d3-45a0-8d63-26346244861e None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:11.775571 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391be61a-90d3-45a0-8d63-26346244861e None admin] PATH_INFO: `/v3/services/compute` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:11.776246 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391be61a-90d3-45a0-8d63-26346244861e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:11.777616 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391be61a-90d3-45a0-8d63-26346244861e None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:11.789506 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-391be61a-90d3-45a0-8d63-26346244861e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 27 09:16:11.789506 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:11.789506 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 09:16:11.789506 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 09:16:11.789506 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 09:16:11.789506 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 09:16:11.789506 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 09:16:11.789506 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 09:16:11.789506 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 27 09:16:11.789506 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:16:11.789506 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 09:16:11.789506 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:16:11.789506 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:11.789506 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:16:11.789506 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:16:11.789506 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:16:11.789506 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:16:11.790540 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:16:11.790540 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:16:11.790540 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:16:11.790540 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:16:11.790540 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:16:11.790540 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:16:11.790540 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 09:16:11.790540 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 09:16:11.790540 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 09:16:11.790540 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 09:16:11.790540 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:16:11.790540 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:16:11.790540 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:16:11.790540 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:16:11.790540 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:16:11.790540 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:16:11.791395 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:16:11.791395 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:16:11.791395 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:16:11.791395 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:16:11.791395 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:16:11.791395 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:16:11.791395 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:16:11.791395 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:16:11.791395 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:16:11.791395 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:16:11.791395 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 09:16:11.791395 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 09:16:11.791395 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 27 09:16:11.791395 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:16:11.798926 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 500/992] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:16:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:16:11.799065 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd38553-a9a3-46af-bc8e-4f487c6cf2ac None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:11.901830 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd38553-a9a3-46af-bc8e-4f487c6cf2ac None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:11.936079 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab24eb4-b6ae-4f42-ad04-e66a66ac824b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:11.936773 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab24eb4-b6ae-4f42-ad04-e66a66ac824b None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:11.937058 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab24eb4-b6ae-4f42-ad04-e66a66ac824b None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:11.937333 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab24eb4-b6ae-4f42-ad04-e66a66ac824b None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:11.938038 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab24eb4-b6ae-4f42-ad04-e66a66ac824b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:11.938346 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab24eb4-b6ae-4f42-ad04-e66a66ac824b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:11.939728 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab24eb4-b6ae-4f42-ad04-e66a66ac824b None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:11.949941 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 493/993] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Jun 27 09:16:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:11.951147 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391be61a-90d3-45a0-8d63-26346244861e None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:11.997393 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d487ec5-c643-4ee3-ab78-97cecdb7d62b None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:11.997679 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d487ec5-c643-4ee3-ab78-97cecdb7d62b None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:11.997936 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d487ec5-c643-4ee3-ab78-97cecdb7d62b None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:11.999304 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 494/994] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:16:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 09:16:12.004646 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e07ee-700b-4281-a4d7-99f59a14d9c7 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:12.004932 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e07ee-700b-4281-a4d7-99f59a14d9c7 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:12.005201 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e07ee-700b-4281-a4d7-99f59a14d9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:12.011712 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:12.022468 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-a95e07ee-700b-4281-a4d7-99f59a14d9c7 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:16:12.023645 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-a95e07ee-700b-4281-a4d7-99f59a14d9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:16:12.060877 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391be61a-90d3-45a0-8d63-26346244861e None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:12.085302 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:12.096265 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 495/995] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:16:12 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 09:16:12.110522 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efbc46b-0107-4c1f-9e1d-85c7bb49caa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:12.111612 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbc46b-0107-4c1f-9e1d-85c7bb49caa6 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:12.111612 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbc46b-0107-4c1f-9e1d-85c7bb49caa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:12.111937 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbc46b-0107-4c1f-9e1d-85c7bb49caa6 None admin] PATH_INFO: `/v3/services` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:12.114991 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efbc46b-0107-4c1f-9e1d-85c7bb49caa6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:12.115439 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efbc46b-0107-4c1f-9e1d-85c7bb49caa6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:12.117013 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efbc46b-0107-4c1f-9e1d-85c7bb49caa6 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:12.119363 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e07ee-700b-4281-a4d7-99f59a14d9c7 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:12.123464 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 501/996] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Jun 27 09:16:11 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:16:12.129944 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efbc46b-0107-4c1f-9e1d-85c7bb49caa6 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:12.231168 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e07ee-700b-4281-a4d7-99f59a14d9c7 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:12.235124 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efbc46b-0107-4c1f-9e1d-85c7bb49caa6 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:12.252826 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:12.270177 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4928ecd2-b8e3-4deb-88ae-12c8c0bc59f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:12.270413 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31e36d-4908-4e28-841f-cb1a1762af08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:12.270898 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31e36d-4908-4e28-841f-cb1a1762af08 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:12.271000 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928ecd2-b8e3-4deb-88ae-12c8c0bc59f8 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:12.271184 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31e36d-4908-4e28-841f-cb1a1762af08 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:12.271292 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928ecd2-b8e3-4deb-88ae-12c8c0bc59f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:12.271470 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31e36d-4908-4e28-841f-cb1a1762af08 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:12.271566 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928ecd2-b8e3-4deb-88ae-12c8c0bc59f8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:12.272131 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4928ecd2-b8e3-4deb-88ae-12c8c0bc59f8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:12.272311 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab31e36d-4908-4e28-841f-cb1a1762af08 None admin] RBAC: Adding query filter params (interface=public, service_id=c21e71b67e4f413da23b3bf37d47149e, region_id=RegionOne) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:12.272599 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab31e36d-4908-4e28-841f-cb1a1762af08 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:12.273514 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4928ecd2-b8e3-4deb-88ae-12c8c0bc59f8 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:12.273956 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab31e36d-4908-4e28-841f-cb1a1762af08 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:12.279541 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 502/997] 10.222.0.62 () {56 vars in 1251 bytes} [Mon Jun 27 09:16:12 2022] GET /identity/v3/endpoints?service_id=c21e71b67e4f413da23b3bf37d47149e&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:16:12.285919 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31e36d-4908-4e28-841f-cb1a1762af08 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:12.287075 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-4928ecd2-b8e3-4deb-88ae-12c8c0bc59f8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 09:16:12.287075 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:12.287075 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 09:16:12.287075 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 09:16:12.287075 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 09:16:12.287075 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 09:16:12.287075 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 09:16:12.287075 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 09:16:12.287075 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 09:16:12.287075 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:16:12.287075 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 09:16:12.287075 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:16:12.287075 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:12.287075 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:16:12.287075 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:16:12.287075 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:16:12.287075 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:16:12.288587 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:16:12.288587 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:16:12.288587 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:16:12.288587 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:16:12.288587 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:16:12.288587 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:16:12.288587 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 09:16:12.288587 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 09:16:12.288587 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 09:16:12.288587 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 09:16:12.288587 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:16:12.288587 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:16:12.288587 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:16:12.288587 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:16:12.288587 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:16:12.288587 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:16:12.289924 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:16:12.289924 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:16:12.289924 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:16:12.289924 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:16:12.289924 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:16:12.289924 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:16:12.289924 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:16:12.289924 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:16:12.289924 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:16:12.289924 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:16:12.289924 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 09:16:12.289924 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 09:16:12.289924 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 09:16:12.289924 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:16:12.293209 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 496/998] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Jun 27 09:16:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 09:16:12.294083 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4928ecd2-b8e3-4deb-88ae-12c8c0bc59f8 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:12.357078 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:12.404779 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31e36d-4908-4e28-841f-cb1a1762af08 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:12.411452 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4928ecd2-b8e3-4deb-88ae-12c8c0bc59f8 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:12.442028 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30eb66-72ac-4f37-bb09-aeb69b430c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:12.442998 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30eb66-72ac-4f37-bb09-aeb69b430c23 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:12.443471 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30eb66-72ac-4f37-bb09-aeb69b430c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:12.443752 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30eb66-72ac-4f37-bb09-aeb69b430c23 None admin] PATH_INFO: `/v3/services` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:12.444477 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a30eb66-72ac-4f37-bb09-aeb69b430c23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:12.445833 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a30eb66-72ac-4f37-bb09-aeb69b430c23 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:12.450854 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b28f4b-17c1-40cb-b42b-f4b0868a988c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:12.451540 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b28f4b-17c1-40cb-b42b-f4b0868a988c None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:12.451802 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b28f4b-17c1-40cb-b42b-f4b0868a988c None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:12.452106 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b28f4b-17c1-40cb-b42b-f4b0868a988c None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:12.452609 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 503/999] 10.222.0.62 () {56 vars in 1087 bytes} [Mon Jun 27 09:16:12 2022] GET /identity/v3/services => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 09:16:12.456905 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b28f4b-17c1-40cb-b42b-f4b0868a988c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:12.457302 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b28f4b-17c1-40cb-b42b-f4b0868a988c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:12.458805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b28f4b-17c1-40cb-b42b-f4b0868a988c None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:12.464797 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 497/1000] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Jun 27 09:16:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:12.470768 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30eb66-72ac-4f37-bb09-aeb69b430c23 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:12.523157 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:12.603365 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30eb66-72ac-4f37-bb09-aeb69b430c23 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:12.640345 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c1530-17d3-4169-80ad-9549cb5ead90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:12.640992 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c1530-17d3-4169-80ad-9549cb5ead90 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:12.641275 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c1530-17d3-4169-80ad-9549cb5ead90 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:12.641547 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c1530-17d3-4169-80ad-9549cb5ead90 None admin] PATH_INFO: `/v3/services` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:12.642758 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c1530-17d3-4169-80ad-9549cb5ead90 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:12.642758 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c1530-17d3-4169-80ad-9549cb5ead90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:12.644534 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c1530-17d3-4169-80ad-9549cb5ead90 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:12.650167 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 504/1001] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Jun 27 09:16:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:12.656290 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b28f4b-17c1-40cb-b42b-f4b0868a988c None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:12.763913 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b28f4b-17c1-40cb-b42b-f4b0868a988c None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:12.785096 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:12.799425 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d896bb-a5e8-4562-9c62-f5d2c449e7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:12.800162 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d896bb-a5e8-4562-9c62-f5d2c449e7fd None admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:12.800519 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d896bb-a5e8-4562-9c62-f5d2c449e7fd None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:12.800796 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d896bb-a5e8-4562-9c62-f5d2c449e7fd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:12.801548 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d896bb-a5e8-4562-9c62-f5d2c449e7fd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:12.802889 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d896bb-a5e8-4562-9c62-f5d2c449e7fd None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:12.828321 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a5448-18ab-4937-9b5b-de06227a466e None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:12.828603 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a5448-18ab-4937-9b5b-de06227a466e None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:12.828888 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a5448-18ab-4937-9b5b-de06227a466e None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:12.830322 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 505/1002] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 09:16:12.835801 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77efa240-390f-4229-b487-6f5d267513b3 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:12.836089 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77efa240-390f-4229-b487-6f5d267513b3 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:12.836393 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77efa240-390f-4229-b487-6f5d267513b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:12.854257 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-77efa240-390f-4229-b487-6f5d267513b3 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:16:12.864226 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-77efa240-390f-4229-b487-6f5d267513b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:16:12.864481 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 498/1003] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Jun 27 09:16:12 2022] POST /identity/v3/endpoints => generated 325 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:16:12.954937 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 506/1004] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:16:12 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 09:16:12.978462 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d896bb-a5e8-4562-9c62-f5d2c449e7fd None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:13.087519 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d896bb-a5e8-4562-9c62-f5d2c449e7fd None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:13.127324 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22db6ca-fecb-46a9-bf64-ce8f61419886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:13.128704 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22db6ca-fecb-46a9-bf64-ce8f61419886 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:13.128981 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22db6ca-fecb-46a9-bf64-ce8f61419886 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:13.129249 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22db6ca-fecb-46a9-bf64-ce8f61419886 None admin] PATH_INFO: `/v3/services/image` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:13.129902 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22db6ca-fecb-46a9-bf64-ce8f61419886 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:13.131281 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22db6ca-fecb-46a9-bf64-ce8f61419886 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:13.143900 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-b22db6ca-fecb-46a9-bf64-ce8f61419886 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 27 09:16:13.143900 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:13.143900 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 09:16:13.143900 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 09:16:13.143900 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 09:16:13.143900 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 09:16:13.143900 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 09:16:13.143900 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 09:16:13.143900 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 27 09:16:13.143900 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:16:13.143900 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 09:16:13.143900 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:16:13.143900 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:13.143900 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:16:13.143900 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:16:13.143900 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:16:13.143900 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:16:13.145219 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:16:13.145219 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:16:13.145219 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:16:13.145219 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:16:13.145219 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:16:13.145219 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:16:13.145219 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 09:16:13.145219 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 09:16:13.145219 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 09:16:13.145219 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 09:16:13.145219 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:16:13.145219 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:16:13.145219 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:16:13.145219 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:16:13.145219 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:16:13.145219 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:16:13.146058 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:16:13.146058 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:16:13.146058 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:16:13.146058 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:16:13.146058 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:16:13.146058 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:16:13.146058 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:16:13.146058 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:16:13.146058 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:16:13.146058 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:16:13.146058 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 09:16:13.146058 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 09:16:13.146058 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 27 09:16:13.146058 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:16:13.146058 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 499/1005] 10.222.0.62 () {56 vars in 1105 bytes} [Mon Jun 27 09:16:12 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:16:13.153231 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77efa240-390f-4229-b487-6f5d267513b3 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:13.188906 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:13.258934 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77efa240-390f-4229-b487-6f5d267513b3 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:13.297912 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59c07c-ed4d-463a-aa33-84b0ac34f2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:13.298579 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59c07c-ed4d-463a-aa33-84b0ac34f2ed None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:13.298864 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59c07c-ed4d-463a-aa33-84b0ac34f2ed None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:13.299134 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59c07c-ed4d-463a-aa33-84b0ac34f2ed None admin] PATH_INFO: `/v3/services` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:13.300434 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59c07c-ed4d-463a-aa33-84b0ac34f2ed None admin] RBAC: Adding query filter params (name=image) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:13.300739 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59c07c-ed4d-463a-aa33-84b0ac34f2ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:13.302096 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59c07c-ed4d-463a-aa33-84b0ac34f2ed None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:13.313676 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 507/1006] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:16:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:13.315198 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22db6ca-fecb-46a9-bf64-ce8f61419886 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:13.363280 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:13.418762 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22db6ca-fecb-46a9-bf64-ce8f61419886 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:13.463492 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe71760d-0f69-4246-b475-b6920145386f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:13.464161 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71760d-0f69-4246-b475-b6920145386f None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:13.464467 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71760d-0f69-4246-b475-b6920145386f None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:13.464740 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71760d-0f69-4246-b475-b6920145386f None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:13.465447 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe71760d-0f69-4246-b475-b6920145386f None admin] RBAC: Adding query filter params (type=image) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:13.465755 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe71760d-0f69-4246-b475-b6920145386f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:13.467120 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe71760d-0f69-4246-b475-b6920145386f None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:13.472237 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 500/1007] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:16:13 2022] GET /identity/v3/services?type=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:16:14.561187 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6eb47-3bda-41a1-9877-cd3450443fad None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:14.561747 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6eb47-3bda-41a1-9877-cd3450443fad None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:14.561747 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6eb47-3bda-41a1-9877-cd3450443fad None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:14.564297 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 508/1008] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:16:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:16:14.569026 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d1991-1d71-4df1-842c-db342650731e None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:14.569549 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d1991-1d71-4df1-842c-db342650731e None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:14.569549 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d1991-1d71-4df1-842c-db342650731e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:14.586893 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-6b6d1991-1d71-4df1-842c-db342650731e None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:16:14.588070 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-6b6d1991-1d71-4df1-842c-db342650731e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:16:14.657306 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 501/1009] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:16:14 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 09:16:14.680550 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6eb47-3bda-41a1-9877-cd3450443fad None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:14.779356 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:14.783695 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6eb47-3bda-41a1-9877-cd3450443fad None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:14.817810 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d7508-7712-405f-b712-e2c3511254f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:14.818507 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d7508-7712-405f-b712-e2c3511254f0 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:14.818788 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d7508-7712-405f-b712-e2c3511254f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:14.819059 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d7508-7712-405f-b712-e2c3511254f0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:14.819708 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336d7508-7712-405f-b712-e2c3511254f0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:14.821113 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336d7508-7712-405f-b712-e2c3511254f0 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:14.833443 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-336d7508-7712-405f-b712-e2c3511254f0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 27 09:16:14.833443 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:14.833443 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 09:16:14.833443 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 09:16:14.833443 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 09:16:14.833443 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 09:16:14.833443 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 09:16:14.833443 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 09:16:14.833443 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 27 09:16:14.833443 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:16:14.833443 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 09:16:14.833443 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:16:14.833443 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:14.833443 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:16:14.833443 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:16:14.833443 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:16:14.833443 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:16:14.834472 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:16:14.834472 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:16:14.834472 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:16:14.834472 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:16:14.834472 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:16:14.834472 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:16:14.834472 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 09:16:14.834472 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 09:16:14.834472 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 09:16:14.834472 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 09:16:14.834472 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:16:14.834472 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:16:14.834472 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:16:14.834472 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:16:14.834472 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:16:14.834472 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:16:14.835341 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:16:14.835341 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:16:14.835341 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:16:14.835341 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:16:14.835341 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:16:14.835341 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:16:14.835341 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:16:14.835341 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:16:14.835341 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:16:14.835341 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:16:14.835341 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 09:16:14.835341 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 09:16:14.835341 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 27 09:16:14.835341 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:16:14.842855 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 509/1010] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:16:14 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:16:14.843010 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d1991-1d71-4df1-842c-db342650731e None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:14.882528 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:14.949031 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d1991-1d71-4df1-842c-db342650731e None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:14.980553 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56556c-ea5a-4dee-b29a-1ecf7cf8c1dc None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:14.981030 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56556c-ea5a-4dee-b29a-1ecf7cf8c1dc None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:14.981469 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56556c-ea5a-4dee-b29a-1ecf7cf8c1dc None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:14.982911 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 510/1011] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:16:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 09:16:14.984310 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8164e36f-9521-44fc-b414-63b0f857b6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:14.984971 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164e36f-9521-44fc-b414-63b0f857b6f2 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:14.985248 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164e36f-9521-44fc-b414-63b0f857b6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:14.985518 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164e36f-9521-44fc-b414-63b0f857b6f2 None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:14.986221 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8164e36f-9521-44fc-b414-63b0f857b6f2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:14.986524 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8164e36f-9521-44fc-b414-63b0f857b6f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:14.988456 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8164e36f-9521-44fc-b414-63b0f857b6f2 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:14.988646 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3248a79-8e46-4541-b721-ccc5692b46a3 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:14.988913 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3248a79-8e46-4541-b721-ccc5692b46a3 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:14.989193 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3248a79-8e46-4541-b721-ccc5692b46a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:14.997963 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 502/1012] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Jun 27 09:16:14 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:14.999000 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8164e36f-9521-44fc-b414-63b0f857b6f2 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:15.010892 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-e3248a79-8e46-4541-b721-ccc5692b46a3 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:16:15.012192 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-e3248a79-8e46-4541-b721-ccc5692b46a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:16:15.088350 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 511/1013] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:16:14 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 09:16:15.113438 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3248a79-8e46-4541-b721-ccc5692b46a3 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:15.116688 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8164e36f-9521-44fc-b414-63b0f857b6f2 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:15.118693 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:15.156486 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5662bcbd-ebe5-4ed3-af90-f91e35f57ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:15.157154 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662bcbd-ebe5-4ed3-af90-f91e35f57ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:15.157436 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662bcbd-ebe5-4ed3-af90-f91e35f57ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:15.157712 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662bcbd-ebe5-4ed3-af90-f91e35f57ec0 None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:15.158753 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5662bcbd-ebe5-4ed3-af90-f91e35f57ec0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:15.158753 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5662bcbd-ebe5-4ed3-af90-f91e35f57ec0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:15.160703 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5662bcbd-ebe5-4ed3-af90-f91e35f57ec0 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:15.166073 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 503/1014] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Jun 27 09:16:14 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:15.171423 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5662bcbd-ebe5-4ed3-af90-f91e35f57ec0 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:15.216181 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:15.224981 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3248a79-8e46-4541-b721-ccc5692b46a3 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:15.266302 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791afe8-dd51-4499-a8e7-50944d9bfe8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:15.267129 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791afe8-dd51-4499-a8e7-50944d9bfe8b None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:15.267398 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791afe8-dd51-4499-a8e7-50944d9bfe8b None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:15.267676 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791afe8-dd51-4499-a8e7-50944d9bfe8b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:15.268963 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1791afe8-dd51-4499-a8e7-50944d9bfe8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:15.270396 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1791afe8-dd51-4499-a8e7-50944d9bfe8b None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:15.272330 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 512/1015] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:16:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:16:15.278308 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791afe8-dd51-4499-a8e7-50944d9bfe8b None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:15.291369 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5662bcbd-ebe5-4ed3-af90-f91e35f57ec0 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:15.327846 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cff5b5-9e23-49e0-9b54-a2f92e7814d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:15.328536 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cff5b5-9e23-49e0-9b54-a2f92e7814d4 None admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:15.328820 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cff5b5-9e23-49e0-9b54-a2f92e7814d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:15.329101 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cff5b5-9e23-49e0-9b54-a2f92e7814d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:15.329866 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cff5b5-9e23-49e0-9b54-a2f92e7814d4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:15.331269 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cff5b5-9e23-49e0-9b54-a2f92e7814d4 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:15.386069 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791afe8-dd51-4499-a8e7-50944d9bfe8b None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:15.398169 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 504/1016] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Jun 27 09:16:15 2022] POST /identity/v3/endpoints => generated 334 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 09:16:15.438963 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f824b-214a-4e63-beb5-e99d7440f8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:15.439629 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f824b-214a-4e63-beb5-e99d7440f8de None admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:15.439910 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f824b-214a-4e63-beb5-e99d7440f8de None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:15.440239 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f824b-214a-4e63-beb5-e99d7440f8de None admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:15.440958 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f824b-214a-4e63-beb5-e99d7440f8de None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:15.442448 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f824b-214a-4e63-beb5-e99d7440f8de None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:15.513993 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 513/1017] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Jun 27 09:16:15 2022] POST /identity/v3/projects => generated 311 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 09:16:15.521413 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30949b08-08ed-4044-9932-6bccfcd5a345 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:15.521794 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30949b08-08ed-4044-9932-6bccfcd5a345 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:15.521982 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30949b08-08ed-4044-9932-6bccfcd5a345 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:15.523515 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 505/1018] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:16:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:16:15.530093 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fadd3fb-e875-42a6-b079-9da24540011d None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:15.530448 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fadd3fb-e875-42a6-b079-9da24540011d None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:15.530691 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fadd3fb-e875-42a6-b079-9da24540011d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:15.550168 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-0fadd3fb-e875-42a6-b079-9da24540011d None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:16:15.551453 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-0fadd3fb-e875-42a6-b079-9da24540011d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:16:15.555813 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:15.642302 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 514/1019] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:16:15 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 09:16:15.667221 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30949b08-08ed-4044-9932-6bccfcd5a345 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:15.695034 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:15.778556 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30949b08-08ed-4044-9932-6bccfcd5a345 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:15.813561 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086dd0ff-cbfc-4183-93d1-50b0b5ed7330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:15.814224 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086dd0ff-cbfc-4183-93d1-50b0b5ed7330 None admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:15.814504 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086dd0ff-cbfc-4183-93d1-50b0b5ed7330 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:15.814782 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086dd0ff-cbfc-4183-93d1-50b0b5ed7330 None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:15.815569 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086dd0ff-cbfc-4183-93d1-50b0b5ed7330 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:15.816975 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086dd0ff-cbfc-4183-93d1-50b0b5ed7330 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:15.884060 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 506/1020] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Jun 27 09:16:15 2022] POST /identity/v3/services => generated 242 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 09:16:17.628431 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b9859-3c07-4265-ac75-f7dc0755923a None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:17.628970 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b9859-3c07-4265-ac75-f7dc0755923a None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:17.628970 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b9859-3c07-4265-ac75-f7dc0755923a None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:17.630551 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 515/1021] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:16:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:16:17.635897 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079147d3-851b-4517-8101-d3992aa8b6a5 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:17.636406 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079147d3-851b-4517-8101-d3992aa8b6a5 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:17.636560 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079147d3-851b-4517-8101-d3992aa8b6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:17.654217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-079147d3-851b-4517-8101-d3992aa8b6a5 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:16:17.655426 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-079147d3-851b-4517-8101-d3992aa8b6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:16:17.662115 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6117d-5dae-40cd-b4dd-ed73de578c73 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:17.662408 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6117d-5dae-40cd-b4dd-ed73de578c73 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:17.662686 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6117d-5dae-40cd-b4dd-ed73de578c73 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:17.664190 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 516/1022] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:16:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 09:16:17.669116 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a37b9f-f160-4327-bff0-3a49e9eb7fe4 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:17.669406 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a37b9f-f160-4327-bff0-3a49e9eb7fe4 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:17.669687 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a37b9f-f160-4327-bff0-3a49e9eb7fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:17.686623 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-24a37b9f-f160-4327-bff0-3a49e9eb7fe4 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:16:17.687807 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-24a37b9f-f160-4327-bff0-3a49e9eb7fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:16:17.736110 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 507/1023] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:16:17 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 09:16:17.757756 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 517/1024] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:16:17 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 09:16:17.761449 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079147d3-851b-4517-8101-d3992aa8b6a5 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:17.772624 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:17.782844 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a37b9f-f160-4327-bff0-3a49e9eb7fe4 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:17.856145 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:17.875146 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079147d3-851b-4517-8101-d3992aa8b6a5 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:17.886490 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a37b9f-f160-4327-bff0-3a49e9eb7fe4 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:17.914316 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5557d-5401-46a3-bb3f-52dd419a55f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:17.914974 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5557d-5401-46a3-bb3f-52dd419a55f6 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:17.915258 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5557d-5401-46a3-bb3f-52dd419a55f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:17.915557 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5557d-5401-46a3-bb3f-52dd419a55f6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:17.925648 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3612fa-e0f7-4821-b177-c0cc2cf31b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:17.926498 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3612fa-e0f7-4821-b177-c0cc2cf31b23 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:17.926725 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5557d-5401-46a3-bb3f-52dd419a55f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:16:17.926996 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3612fa-e0f7-4821-b177-c0cc2cf31b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:17.926996 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3612fa-e0f7-4821-b177-c0cc2cf31b23 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:17.928187 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3612fa-e0f7-4821-b177-c0cc2cf31b23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:17.929649 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3612fa-e0f7-4821-b177-c0cc2cf31b23 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:17.931469 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 518/1025] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:16:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:16:17.936903 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-07e5557d-5401-46a3-bb3f-52dd419a55f6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 09:16:17.936903 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:17.936903 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:16:17.936903 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:16:17.936903 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:16:17.936903 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:16:17.936903 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:16:17.936903 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:16:17.936903 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:16:17.936903 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:16:17.936903 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:16:17.936903 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:16:17.936903 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:16:17.936903 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:16:17.936903 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:16:17.936903 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:16:17.937939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:16:17.937939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:16:17.937939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:16:17.937939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:16:17.937939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:16:17.937939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:16:17.937939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:16:17.937939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:16:17.937939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:16:17.937939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:16:17.937939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:16:17.937939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:16:17.937939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:16:17.937939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:16:17.937939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:16:17.937939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:16:17.938833 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:16:17.938833 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:16:17.938833 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:16:17.938833 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:16:17.938833 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:16:17.938833 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:16:17.938833 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:16:17.938833 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:16:17.938833 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:16:17.938833 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:16:17.938833 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 09:16:17.938833 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:16:17.939497 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3612fa-e0f7-4821-b177-c0cc2cf31b23 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:17.939571 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 508/1026] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Jun 27 09:16:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 09:16:17.945292 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5557d-5401-46a3-bb3f-52dd419a55f6 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:18.012112 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:18.041090 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3612fa-e0f7-4821-b177-c0cc2cf31b23 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:18.048775 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5557d-5401-46a3-bb3f-52dd419a55f6 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:18.075337 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d546d-6a90-415b-bf19-8489fec4488e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:18.076008 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d546d-6a90-415b-bf19-8489fec4488e None admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:18.076325 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d546d-6a90-415b-bf19-8489fec4488e None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:18.076604 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d546d-6a90-415b-bf19-8489fec4488e None admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:18.077316 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078d546d-6a90-415b-bf19-8489fec4488e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:18.078747 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078d546d-6a90-415b-bf19-8489fec4488e None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:18.082741 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf9e9a-10fe-4ac6-b530-856684ebe5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:18.083397 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf9e9a-10fe-4ac6-b530-856684ebe5c6 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:18.083671 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf9e9a-10fe-4ac6-b530-856684ebe5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:18.083940 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf9e9a-10fe-4ac6-b530-856684ebe5c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:18.084731 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf9e9a-10fe-4ac6-b530-856684ebe5c6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:18.085036 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf9e9a-10fe-4ac6-b530-856684ebe5c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:18.086375 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf9e9a-10fe-4ac6-b530-856684ebe5c6 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:18.087843 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:18.094777 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 509/1027] 10.222.0.62 () {56 vars in 1115 bytes} [Mon Jun 27 09:16:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:16:18.096069 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75952ea2-7d83-4236-900d-1b7b004d749a None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:18.096977 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75952ea2-7d83-4236-900d-1b7b004d749a None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:18.097256 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75952ea2-7d83-4236-900d-1b7b004d749a None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:18.098545 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 510/1028] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:16:18.101434 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75952ea2-7d83-4236-900d-1b7b004d749a None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:18.199237 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 519/1029] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Jun 27 09:16:17 2022] POST /identity/v3/users => generated 285 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 09:16:18.199237 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325e05e-a40f-4bab-b27b-49f958d68561 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:18.199237 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325e05e-a40f-4bab-b27b-49f958d68561 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:18.199237 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325e05e-a40f-4bab-b27b-49f958d68561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:18.212269 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-1325e05e-a40f-4bab-b27b-49f958d68561 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:16:18.213021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75952ea2-7d83-4236-900d-1b7b004d749a None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:18.213549 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-1325e05e-a40f-4bab-b27b-49f958d68561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:16:18.250929 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:18.258695 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79847d2-d4fd-4ba8-9695-10e82045134e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:18.259657 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79847d2-d4fd-4ba8-9695-10e82045134e None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:18.259775 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79847d2-d4fd-4ba8-9695-10e82045134e None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:18.260173 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79847d2-d4fd-4ba8-9695-10e82045134e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:18.272747 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79847d2-d4fd-4ba8-9695-10e82045134e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:18.274237 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79847d2-d4fd-4ba8-9695-10e82045134e None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:18.291510 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 520/1030] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:16:18 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 09:16:18.295337 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-b79847d2-d4fd-4ba8-9695-10e82045134e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:16:18.295337 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:18.295337 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:16:18.295337 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:16:18.295337 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:16:18.295337 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:16:18.295337 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:16:18.295337 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:16:18.295337 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:16:18.295337 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:16:18.295337 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:16:18.295337 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:16:18.295337 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:16:18.295337 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:16:18.295337 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:16:18.296253 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:16:18.296253 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:16:18.296253 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:16:18.296253 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:16:18.296253 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:16:18.296253 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:16:18.296253 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:16:18.296253 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:16:18.296253 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:16:18.296253 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:16:18.296253 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:16:18.296253 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:16:18.296253 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:16:18.296253 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:16:18.296253 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:16:18.296253 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:16:18.296253 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:16:18.297165 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:16:18.297165 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:16:18.297165 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:16:18.297165 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:16:18.297165 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 511/1031] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:16:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 09:16:18.302617 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325e05e-a40f-4bab-b27b-49f958d68561 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:18.319072 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79847d2-d4fd-4ba8-9695-10e82045134e None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:18.415846 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325e05e-a40f-4bab-b27b-49f958d68561 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:18.440780 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79847d2-d4fd-4ba8-9695-10e82045134e None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:18.441699 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:18.461805 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ef57a-ea50-435a-995a-578fcee2f9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:18.461805 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ef57a-ea50-435a-995a-578fcee2f9cf None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:18.461805 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ef57a-ea50-435a-995a-578fcee2f9cf None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:18.461805 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ef57a-ea50-435a-995a-578fcee2f9cf None admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:18.462282 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2ef57a-ea50-435a-995a-578fcee2f9cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:18.462282 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2ef57a-ea50-435a-995a-578fcee2f9cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:18.462282 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2ef57a-ea50-435a-995a-578fcee2f9cf None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:18.467799 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 521/1032] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:16:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:18.473784 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ef57a-ea50-435a-995a-578fcee2f9cf None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:18.478746 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c5fce-328c-413e-94d7-a223c654f919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:18.479555 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c5fce-328c-413e-94d7-a223c654f919 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:18.479817 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c5fce-328c-413e-94d7-a223c654f919 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:18.480088 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c5fce-328c-413e-94d7-a223c654f919 None admin] PATH_INFO: `/v3/services/image` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:18.480769 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c5fce-328c-413e-94d7-a223c654f919 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:18.482132 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c5fce-328c-413e-94d7-a223c654f919 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:18.496563 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-4b3c5fce-328c-413e-94d7-a223c654f919 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 27 09:16:18.496563 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:18.496563 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 09:16:18.496563 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 09:16:18.496563 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 09:16:18.496563 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 09:16:18.496563 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 09:16:18.496563 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 09:16:18.496563 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 27 09:16:18.496563 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:16:18.496563 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 09:16:18.496563 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:16:18.496563 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:18.496563 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:16:18.496563 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:16:18.496563 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:16:18.496563 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:16:18.497628 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:16:18.497628 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:16:18.497628 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:16:18.497628 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:16:18.497628 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:16:18.497628 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:16:18.497628 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 09:16:18.497628 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 09:16:18.497628 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 09:16:18.497628 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 09:16:18.497628 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:16:18.497628 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:16:18.497628 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:16:18.497628 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:16:18.497628 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:16:18.497628 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:16:18.499051 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:16:18.499051 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:16:18.499051 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:16:18.499051 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:16:18.499051 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:16:18.499051 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:16:18.499051 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:16:18.499051 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:16:18.499051 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:16:18.499051 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:16:18.499051 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 09:16:18.499051 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 09:16:18.499051 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 27 09:16:18.499051 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:16:18.499051 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 512/1033] 10.222.0.62 () {56 vars in 1105 bytes} [Mon Jun 27 09:16:18 2022] GET /identity/v3/services/image => generated 86 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 09:16:18.503932 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c5fce-328c-413e-94d7-a223c654f919 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:18.556292 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:18.583666 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ef57a-ea50-435a-995a-578fcee2f9cf None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:18.615819 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c5fce-328c-413e-94d7-a223c654f919 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:18.620210 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9548e-a98c-45ef-b67b-156f0b2a5967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:18.621027 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9548e-a98c-45ef-b67b-156f0b2a5967 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:18.621309 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9548e-a98c-45ef-b67b-156f0b2a5967 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:18.621585 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9548e-a98c-45ef-b67b-156f0b2a5967 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:18.629616 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c9548e-a98c-45ef-b67b-156f0b2a5967 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:18.631130 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c9548e-a98c-45ef-b67b-156f0b2a5967 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:18.646296 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-c7c9548e-a98c-45ef-b67b-156f0b2a5967 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 27 09:16:18.646296 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:18.646296 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:16:18.646296 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:16:18.646296 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:16:18.646296 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:16:18.646296 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:16:18.646296 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:16:18.646296 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:16:18.646296 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:16:18.646296 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:16:18.646296 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:16:18.646296 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 09:16:18.646296 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 09:16:18.646296 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 09:16:18.646296 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 09:16:18.647296 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:16:18.647296 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:16:18.647296 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 09:16:18.647296 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:16:18.647296 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 09:16:18.647296 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:16:18.647296 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:16:18.647296 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:16:18.647296 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:16:18.647296 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:16:18.647296 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:16:18.647296 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:16:18.647296 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:16:18.647296 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:16:18.647296 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:16:18.647296 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:16:18.647296 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:16:18.647296 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:16:18.648738 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:16:18.648738 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:16:18.648738 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 09:16:18.648738 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 09:16:18.648738 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 09:16:18.648738 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 09:16:18.648738 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 09:16:18.648738 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 09:16:18.648738 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 27 09:16:18.648738 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:16:18.648738 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 522/1034] 10.222.0.62 () {56 vars in 1093 bytes} [Mon Jun 27 09:16:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 09:16:18.653663 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9548e-a98c-45ef-b67b-156f0b2a5967 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:18.656022 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59357527-237b-48a3-8aff-cb5ad1bcb35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:18.656714 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59357527-237b-48a3-8aff-cb5ad1bcb35a None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:18.656989 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59357527-237b-48a3-8aff-cb5ad1bcb35a None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:18.657262 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59357527-237b-48a3-8aff-cb5ad1bcb35a None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:18.657965 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59357527-237b-48a3-8aff-cb5ad1bcb35a None admin] RBAC: Adding query filter params (name=image) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:18.658269 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59357527-237b-48a3-8aff-cb5ad1bcb35a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:18.659860 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59357527-237b-48a3-8aff-cb5ad1bcb35a None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:18.669869 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 513/1035] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:16:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:16:18.674144 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59357527-237b-48a3-8aff-cb5ad1bcb35a None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:18.708428 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:18.768536 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9548e-a98c-45ef-b67b-156f0b2a5967 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:18.780306 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59357527-237b-48a3-8aff-cb5ad1bcb35a None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:18.791935 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:18.804481 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba167e-b7dc-4635-88e7-019b96274226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:18.807061 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba167e-b7dc-4635-88e7-019b96274226 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:18.807061 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba167e-b7dc-4635-88e7-019b96274226 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:18.807061 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba167e-b7dc-4635-88e7-019b96274226 None admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:18.807061 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ba167e-b7dc-4635-88e7-019b96274226 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:18.807061 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ba167e-b7dc-4635-88e7-019b96274226 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:18.808385 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ba167e-b7dc-4635-88e7-019b96274226 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:18.817895 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5d3a2-5e98-456b-92e2-a13442c1ee75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:18.818629 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5d3a2-5e98-456b-92e2-a13442c1ee75 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:18.818945 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5d3a2-5e98-456b-92e2-a13442c1ee75 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:18.819212 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5d3a2-5e98-456b-92e2-a13442c1ee75 None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:18.819915 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5d3a2-5e98-456b-92e2-a13442c1ee75 None admin] RBAC: Adding query filter params (type=image) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:18.820253 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5d3a2-5e98-456b-92e2-a13442c1ee75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:18.821613 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5d3a2-5e98-456b-92e2-a13442c1ee75 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:18.831841 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 523/1036] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Jun 27 09:16:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:16:18.833385 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 514/1037] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:16:18 2022] GET /identity/v3/services?type=image => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:16:18.833728 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba167e-b7dc-4635-88e7-019b96274226 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:18.834214 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5d3a2-5e98-456b-92e2-a13442c1ee75 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:18.936259 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba167e-b7dc-4635-88e7-019b96274226 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:18.937837 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:18.946496 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5d3a2-5e98-456b-92e2-a13442c1ee75 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:18.975093 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0c317-3a95-40c3-a8f9-73bcbf9bc3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:18.975821 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0c317-3a95-40c3-a8f9-73bcbf9bc3ab None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:18.976100 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0c317-3a95-40c3-a8f9-73bcbf9bc3ab None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:18.976398 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0c317-3a95-40c3-a8f9-73bcbf9bc3ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:18.977184 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0c317-3a95-40c3-a8f9-73bcbf9bc3ab None admin] RBAC: Adding query filter params (interface=public, service_id=40d78a4f0ee147c0bb978716b0d54f93, region_id=RegionOne) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:18.977494 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0c317-3a95-40c3-a8f9-73bcbf9bc3ab None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:18.978900 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0c317-3a95-40c3-a8f9-73bcbf9bc3ab None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:18.989530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 524/1038] 10.222.0.62 () {56 vars in 1251 bytes} [Mon Jun 27 09:16:18 2022] GET /identity/v3/endpoints?service_id=40d78a4f0ee147c0bb978716b0d54f93&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:18.990500 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0c317-3a95-40c3-a8f9-73bcbf9bc3ab None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:18.991433 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c44dda-8ef1-4b66-9519-5ec6227a74df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:18.992085 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c44dda-8ef1-4b66-9519-5ec6227a74df None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:18.992397 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c44dda-8ef1-4b66-9519-5ec6227a74df None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:18.992673 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c44dda-8ef1-4b66-9519-5ec6227a74df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:19.038266 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:19.065782 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c44dda-8ef1-4b66-9519-5ec6227a74df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:19.067405 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c44dda-8ef1-4b66-9519-5ec6227a74df None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:19.099237 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0c317-3a95-40c3-a8f9-73bcbf9bc3ab None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:19.145779 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5286b-065c-48cb-bd7c-b68425be48a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:19.146490 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5286b-065c-48cb-bd7c-b68425be48a6 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:19.146763 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5286b-065c-48cb-bd7c-b68425be48a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:19.147080 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5286b-065c-48cb-bd7c-b68425be48a6 None admin] PATH_INFO: `/v3/services` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:19.147759 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5286b-065c-48cb-bd7c-b68425be48a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:19.149691 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5286b-065c-48cb-bd7c-b68425be48a6 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:19.157997 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 525/1039] 10.222.0.62 () {56 vars in 1087 bytes} [Mon Jun 27 09:16:18 2022] GET /identity/v3/services => generated 1957 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:16:19.187823 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 515/1040] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:16:18 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 09:16:19.194474 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5286b-065c-48cb-bd7c-b68425be48a6 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:19.228370 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:19.305059 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5286b-065c-48cb-bd7c-b68425be48a6 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:19.342923 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423dc506-6d25-4246-80e4-33c21a356d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:19.343719 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423dc506-6d25-4246-80e4-33c21a356d27 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:19.343998 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423dc506-6d25-4246-80e4-33c21a356d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:19.344304 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423dc506-6d25-4246-80e4-33c21a356d27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:19.355535 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423dc506-6d25-4246-80e4-33c21a356d27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:19.357027 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423dc506-6d25-4246-80e4-33c21a356d27 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:19.376046 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-423dc506-6d25-4246-80e4-33c21a356d27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:16:19.376046 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:19.376046 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:16:19.376046 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:16:19.376046 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:16:19.376046 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:16:19.376046 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:16:19.376046 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:16:19.376046 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:16:19.376046 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:16:19.376046 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:16:19.376046 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:16:19.376046 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:16:19.376046 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:16:19.376046 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:16:19.377223 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:16:19.377223 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:16:19.377223 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:16:19.377223 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:16:19.377223 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:16:19.377223 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:16:19.377223 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:16:19.377223 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:16:19.377223 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:16:19.377223 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:16:19.377223 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:16:19.377223 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:16:19.377223 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:16:19.377223 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:16:19.377223 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:16:19.377223 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:16:19.377223 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:16:19.378199 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:16:19.378199 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:16:19.378199 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:16:19.378199 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:16:19.378199 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 526/1041] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:16:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:16:19.382940 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c44dda-8ef1-4b66-9519-5ec6227a74df None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:19.465431 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:19.490894 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c44dda-8ef1-4b66-9519-5ec6227a74df None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:19.562418 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f3b3ef-70da-4ca8-82d7-c87663eb3ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:19.562418 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3b3ef-70da-4ca8-82d7-c87663eb3ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:19.562418 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3b3ef-70da-4ca8-82d7-c87663eb3ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:19.562418 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3b3ef-70da-4ca8-82d7-c87663eb3ff4 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:19.562739 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f3b3ef-70da-4ca8-82d7-c87663eb3ff4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:19.562739 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f3b3ef-70da-4ca8-82d7-c87663eb3ff4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:19.562739 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f3b3ef-70da-4ca8-82d7-c87663eb3ff4 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:19.562739 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 516/1042] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:16:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:19.566436 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423dc506-6d25-4246-80e4-33c21a356d27 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:19.673779 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:19.693145 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423dc506-6d25-4246-80e4-33c21a356d27 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:19.729424 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a1112-6ce2-42e1-8fde-9e3e76d80e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:19.730218 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a1112-6ce2-42e1-8fde-9e3e76d80e91 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:19.730518 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a1112-6ce2-42e1-8fde-9e3e76d80e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:19.730802 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a1112-6ce2-42e1-8fde-9e3e76d80e91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:19.738047 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a1112-6ce2-42e1-8fde-9e3e76d80e91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:19.739494 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a1112-6ce2-42e1-8fde-9e3e76d80e91 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:19.754029 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-3d6a1112-6ce2-42e1-8fde-9e3e76d80e91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:16:19.754029 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:19.754029 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:16:19.754029 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:16:19.754029 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:16:19.754029 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:16:19.754029 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:16:19.754029 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:16:19.754029 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:16:19.754029 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:16:19.754029 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:16:19.754029 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:16:19.754029 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 09:16:19.754029 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 09:16:19.754029 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 09:16:19.755165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 09:16:19.755165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:16:19.755165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:16:19.755165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:16:19.755165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:16:19.755165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:16:19.755165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:16:19.755165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:16:19.755165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:16:19.755165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:16:19.755165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:16:19.755165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:16:19.755165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:16:19.755165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:16:19.755165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:16:19.755165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:16:19.755165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:16:19.761018 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 09:16:19.761018 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 09:16:19.761018 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 09:16:19.761018 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 09:16:19.761018 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 09:16:19.761018 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 09:16:19.761018 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:16:19.761018 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:16:19.761018 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 527/1043] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:16:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:16:19.761530 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f3b3ef-70da-4ca8-82d7-c87663eb3ff4 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:19.865582 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f3b3ef-70da-4ca8-82d7-c87663eb3ff4 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:19.900722 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74859a-9dd4-4412-a5fb-ea68f319f37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:19.901391 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74859a-9dd4-4412-a5fb-ea68f319f37f None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:19.901674 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74859a-9dd4-4412-a5fb-ea68f319f37f None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:19.901951 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74859a-9dd4-4412-a5fb-ea68f319f37f None admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:19.902768 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd74859a-9dd4-4412-a5fb-ea68f319f37f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:19.903083 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd74859a-9dd4-4412-a5fb-ea68f319f37f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:19.904544 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd74859a-9dd4-4412-a5fb-ea68f319f37f None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:19.906270 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:19.922698 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 517/1044] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Jun 27 09:16:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:19.923952 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a1112-6ce2-42e1-8fde-9e3e76d80e91 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:20.035457 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a1112-6ce2-42e1-8fde-9e3e76d80e91 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:20.071450 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc1db68-316d-4e86-b208-80e89b1d5fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:20.072102 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1db68-316d-4e86-b208-80e89b1d5fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:20.072410 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1db68-316d-4e86-b208-80e89b1d5fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:20.072687 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1db68-316d-4e86-b208-80e89b1d5fe1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:20.073509 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc1db68-316d-4e86-b208-80e89b1d5fe1 None admin] RBAC: Adding query filter params (role.id=6278d7f8619447b4b75ea2e9f2d03cb4, scope.project.id=4ba8e40538db4d89b93469b79322d20e, user.id=2c1434a85b30411c9c59cc50c3980cd8) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:20.073819 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc1db68-316d-4e86-b208-80e89b1d5fe1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:20.075238 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc1db68-316d-4e86-b208-80e89b1d5fe1 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:20.081027 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 528/1045] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Jun 27 09:16:19 2022] GET /identity/v3/role_assignments?user.id=2c1434a85b30411c9c59cc50c3980cd8&scope.project.id=4ba8e40538db4d89b93469b79322d20e&role.id=6278d7f8619447b4b75ea2e9f2d03cb4 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:16:20.333078 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c3f72-d70e-4dfd-b871-b87f66714ea2 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:20.333475 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c3f72-d70e-4dfd-b871-b87f66714ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:20.333754 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c3f72-d70e-4dfd-b871-b87f66714ea2 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:20.335585 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 518/1046] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:16:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:16:20.341521 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d29288-6d2c-4054-87f7-3f61fbdc25a8 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:20.341790 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d29288-6d2c-4054-87f7-3f61fbdc25a8 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:20.342086 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d29288-6d2c-4054-87f7-3f61fbdc25a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:20.354707 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:20.360432 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-e1d29288-6d2c-4054-87f7-3f61fbdc25a8 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:16:20.362374 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-e1d29288-6d2c-4054-87f7-3f61fbdc25a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:16:20.437431 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 529/1047] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:16:20 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 09:16:20.460937 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c3f72-d70e-4dfd-b871-b87f66714ea2 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:20.566103 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c3f72-d70e-4dfd-b871-b87f66714ea2 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:20.603064 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af358a-d8e6-46db-ac40-02866d52b441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:20.603763 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af358a-d8e6-46db-ac40-02866d52b441 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:20.604047 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af358a-d8e6-46db-ac40-02866d52b441 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:20.604351 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af358a-d8e6-46db-ac40-02866d52b441 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:20.615735 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33af358a-d8e6-46db-ac40-02866d52b441 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:16:20.623412 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-33af358a-d8e6-46db-ac40-02866d52b441 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:16:20.623412 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:20.623412 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:16:20.623412 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:16:20.623412 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:16:20.623412 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:16:20.623412 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:16:20.623412 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:16:20.623412 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:16:20.623412 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:16:20.623412 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:16:20.623412 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:16:20.623412 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:16:20.623412 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:16:20.623412 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:16:20.623412 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:16:20.624600 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:16:20.624600 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:16:20.624600 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:16:20.624600 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:16:20.624600 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:16:20.624600 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:16:20.624600 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:16:20.624600 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:16:20.624600 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:16:20.624600 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:16:20.624600 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:16:20.624600 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:16:20.624600 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:16:20.624600 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:16:20.624600 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:16:20.624600 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:16:20.625437 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:16:20.625437 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:16:20.625437 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:16:20.625437 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:16:20.625437 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:16:20.625437 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:16:20.625437 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:16:20.625437 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:16:20.625437 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:16:20.625437 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:16:20.625437 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:16:20.625437 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:16:20.628799 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 519/1048] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Jun 27 09:16:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:16:20.630775 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d29288-6d2c-4054-87f7-3f61fbdc25a8 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:20.738562 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d29288-6d2c-4054-87f7-3f61fbdc25a8 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:20.773685 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee21ab-7656-48d6-b76e-fcd0f804eb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:20.774358 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee21ab-7656-48d6-b76e-fcd0f804eb4e None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:20.774641 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee21ab-7656-48d6-b76e-fcd0f804eb4e None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:20.774916 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee21ab-7656-48d6-b76e-fcd0f804eb4e None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:20.775914 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee21ab-7656-48d6-b76e-fcd0f804eb4e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:20.776238 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee21ab-7656-48d6-b76e-fcd0f804eb4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:20.777616 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee21ab-7656-48d6-b76e-fcd0f804eb4e None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:20.779951 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:20.787709 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 530/1049] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:16:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:20.793410 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af358a-d8e6-46db-ac40-02866d52b441 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:20.852396 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:20.900259 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af358a-d8e6-46db-ac40-02866d52b441 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:20.934633 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f608e52-10db-4471-995a-2cc36ac3e7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:20.935504 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f608e52-10db-4471-995a-2cc36ac3e7fd None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:20.935781 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f608e52-10db-4471-995a-2cc36ac3e7fd None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:20.936057 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f608e52-10db-4471-995a-2cc36ac3e7fd None admin] PATH_INFO: `/v3/users/f9116fb936e3481cb446b8ddb32b1b9f` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:20.949507 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f608e52-10db-4471-995a-2cc36ac3e7fd None admin] RBAC: Authorizing `identity:get_user(user_id=f9116fb936e3481cb446b8ddb32b1b9f)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:20.950942 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f608e52-10db-4471-995a-2cc36ac3e7fd None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:20.952800 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 520/1050] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Jun 27 09:16:20 2022] GET /identity/v3/users/f9116fb936e3481cb446b8ddb32b1b9f => generated 285 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:20.958962 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee21ab-7656-48d6-b76e-fcd0f804eb4e None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:21.067381 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee21ab-7656-48d6-b76e-fcd0f804eb4e None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:21.105104 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79358375-3060-45bc-98c3-a0c1825a71b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:21.105104 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79358375-3060-45bc-98c3-a0c1825a71b8 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:21.105104 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79358375-3060-45bc-98c3-a0c1825a71b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:21.105104 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79358375-3060-45bc-98c3-a0c1825a71b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:21.178798 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:21.183755 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79358375-3060-45bc-98c3-a0c1825a71b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:21.185276 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79358375-3060-45bc-98c3-a0c1825a71b8 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:21.232265 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914ad78-da57-4e48-b47d-237a5f140dd2 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:21.232696 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914ad78-da57-4e48-b47d-237a5f140dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:21.232805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914ad78-da57-4e48-b47d-237a5f140dd2 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:21.234530 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 521/1051] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:16:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:16:21.239183 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292e363-285b-4869-958d-7949b9d578ac None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:21.239464 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292e363-285b-4869-958d-7949b9d578ac None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:21.239731 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292e363-285b-4869-958d-7949b9d578ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:21.256781 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-f292e363-285b-4869-958d-7949b9d578ac None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:16:21.257986 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-f292e363-285b-4869-958d-7949b9d578ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:16:21.294327 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 531/1052] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:16:20 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 09:16:21.301180 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79358375-3060-45bc-98c3-a0c1825a71b8 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:21.335234 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 522/1053] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:16:21 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 09:16:21.360271 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f292e363-285b-4869-958d-7949b9d578ac None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:21.404217 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:21.408034 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79358375-3060-45bc-98c3-a0c1825a71b8 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:21.410693 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:21.444926 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f221376-9aaa-42fc-bb9c-33e560801b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:21.445565 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f221376-9aaa-42fc-bb9c-33e560801b26 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:21.445847 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f221376-9aaa-42fc-bb9c-33e560801b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:21.446131 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f221376-9aaa-42fc-bb9c-33e560801b26 None admin] PATH_INFO: `/v3/projects/0dfdd9951adb4668af803c2402e22b1f` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:21.447423 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f221376-9aaa-42fc-bb9c-33e560801b26 None admin] RBAC: Authorizing `identity:get_project(project_id=0dfdd9951adb4668af803c2402e22b1f)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:21.448887 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f221376-9aaa-42fc-bb9c-33e560801b26 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:21.456257 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 532/1054] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:16:21 2022] GET /identity/v3/projects/0dfdd9951adb4668af803c2402e22b1f => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:21.457620 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f221376-9aaa-42fc-bb9c-33e560801b26 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:21.484582 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f292e363-285b-4869-958d-7949b9d578ac None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:21.526443 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8546926-55b1-43b2-8161-a5aea0ebdfab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:21.527342 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8546926-55b1-43b2-8161-a5aea0ebdfab None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:21.527622 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8546926-55b1-43b2-8161-a5aea0ebdfab None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:21.527895 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8546926-55b1-43b2-8161-a5aea0ebdfab None admin] PATH_INFO: `/v3/services/image` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:21.528578 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8546926-55b1-43b2-8161-a5aea0ebdfab None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:21.530210 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8546926-55b1-43b2-8161-a5aea0ebdfab None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:21.543478 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-e8546926-55b1-43b2-8161-a5aea0ebdfab None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 27 09:16:21.543478 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:21.543478 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 09:16:21.543478 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 09:16:21.543478 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 09:16:21.543478 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 09:16:21.543478 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 09:16:21.543478 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 09:16:21.543478 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 27 09:16:21.543478 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:16:21.543478 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 09:16:21.543478 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:16:21.543478 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:21.543478 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:16:21.543478 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:16:21.543478 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:16:21.543478 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:16:21.544596 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:16:21.544596 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:16:21.544596 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:16:21.544596 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:16:21.544596 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:16:21.544596 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:16:21.544596 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 09:16:21.544596 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 09:16:21.544596 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 09:16:21.544596 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 09:16:21.544596 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:16:21.544596 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:16:21.544596 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:16:21.544596 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:16:21.544596 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:16:21.544596 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:16:21.545478 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:16:21.545478 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:16:21.545478 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:16:21.545478 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:16:21.545478 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:16:21.545478 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:16:21.545478 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:16:21.545478 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:16:21.545478 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:16:21.545478 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:16:21.545478 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 09:16:21.545478 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 09:16:21.545478 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 27 09:16:21.545478 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:16:21.546232 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 523/1055] 10.222.0.62 () {56 vars in 1105 bytes} [Mon Jun 27 09:16:21 2022] GET /identity/v3/services/image => generated 86 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:16:21.553990 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8546926-55b1-43b2-8161-a5aea0ebdfab None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:21.581221 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f221376-9aaa-42fc-bb9c-33e560801b26 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:21.620231 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce1074-eec2-44b3-b9f7-d785960231a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:21.621223 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce1074-eec2-44b3-b9f7-d785960231a1 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:21.621512 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce1074-eec2-44b3-b9f7-d785960231a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:21.621790 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce1074-eec2-44b3-b9f7-d785960231a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:21.622622 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ce1074-eec2-44b3-b9f7-d785960231a1 None admin] RBAC: Adding query filter params (role.id=91c77942515d45f1ad8189c9fddf4424, scope.project.id=0dfdd9951adb4668af803c2402e22b1f, user.id=f9116fb936e3481cb446b8ddb32b1b9f) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:21.622934 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ce1074-eec2-44b3-b9f7-d785960231a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:21.624441 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ce1074-eec2-44b3-b9f7-d785960231a1 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:21.639701 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 533/1056] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Jun 27 09:16:21 2022] GET /identity/v3/role_assignments?user.id=f9116fb936e3481cb446b8ddb32b1b9f&scope.project.id=0dfdd9951adb4668af803c2402e22b1f&role.id=91c77942515d45f1ad8189c9fddf4424 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:21.675990 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8546926-55b1-43b2-8161-a5aea0ebdfab None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:21.683781 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:21.713583 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb349fc-283f-47b3-afca-fcf9c01427ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:21.714180 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb349fc-283f-47b3-afca-fcf9c01427ce None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:21.714458 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb349fc-283f-47b3-afca-fcf9c01427ce None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:21.714736 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb349fc-283f-47b3-afca-fcf9c01427ce None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:21.715459 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb349fc-283f-47b3-afca-fcf9c01427ce None admin] RBAC: Adding query filter params (name=image) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:21.715767 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb349fc-283f-47b3-afca-fcf9c01427ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:21.717221 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb349fc-283f-47b3-afca-fcf9c01427ce None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:21.723088 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 524/1057] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:16:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:21.728658 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce1074-eec2-44b3-b9f7-d785960231a1 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:21.762212 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:21.846177 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce1074-eec2-44b3-b9f7-d785960231a1 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:21.881797 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a014f-dd80-4747-bcd6-2cbab9929157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:21.882458 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a014f-dd80-4747-bcd6-2cbab9929157 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:21.882737 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a014f-dd80-4747-bcd6-2cbab9929157 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:21.883040 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a014f-dd80-4747-bcd6-2cbab9929157 None admin] PATH_INFO: `/v3/services` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:21.883714 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a014f-dd80-4747-bcd6-2cbab9929157 None admin] RBAC: Adding query filter params (type=image) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:21.884024 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a014f-dd80-4747-bcd6-2cbab9929157 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:21.885413 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a014f-dd80-4747-bcd6-2cbab9929157 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:21.890586 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 534/1058] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:16:21 2022] GET /identity/v3/services?type=image => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:21.896110 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb349fc-283f-47b3-afca-fcf9c01427ce None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:21.998607 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb349fc-283f-47b3-afca-fcf9c01427ce None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:22.033832 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467908fe-d328-4baf-8e40-43d99bbd67fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:22.034489 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467908fe-d328-4baf-8e40-43d99bbd67fc None admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:22.034789 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467908fe-d328-4baf-8e40-43d99bbd67fc None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:22.035042 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467908fe-d328-4baf-8e40-43d99bbd67fc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:22.035783 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467908fe-d328-4baf-8e40-43d99bbd67fc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:22.037187 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467908fe-d328-4baf-8e40-43d99bbd67fc None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:22.120683 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 525/1059] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Jun 27 09:16:21 2022] POST /identity/v3/endpoints => generated 327 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:16:22.167212 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364a75d-71db-4aa1-8381-3602373e755c None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:22.167546 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364a75d-71db-4aa1-8381-3602373e755c None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:22.167772 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364a75d-71db-4aa1-8381-3602373e755c None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:22.169516 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 535/1060] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:16:22.175148 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f94ea-aae6-4a9f-bbb6-35b720e4a6c6 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:22.175449 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f94ea-aae6-4a9f-bbb6-35b720e4a6c6 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:22.175716 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f94ea-aae6-4a9f-bbb6-35b720e4a6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:22.194030 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-4f8f94ea-aae6-4a9f-bbb6-35b720e4a6c6 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:16:22.195260 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-4f8f94ea-aae6-4a9f-bbb6-35b720e4a6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:16:22.217775 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:22.277204 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 526/1061] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:16:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 09:16:22.299826 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364a75d-71db-4aa1-8381-3602373e755c None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:22.402862 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:22.411037 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364a75d-71db-4aa1-8381-3602373e755c None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:22.448384 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f5a684-988b-42d0-9eb7-16dde14aa5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:22.449248 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5a684-988b-42d0-9eb7-16dde14aa5d3 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:22.449528 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5a684-988b-42d0-9eb7-16dde14aa5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:22.449826 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5a684-988b-42d0-9eb7-16dde14aa5d3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:22.460379 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f5a684-988b-42d0-9eb7-16dde14aa5d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:16:22.468498 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-c4f5a684-988b-42d0-9eb7-16dde14aa5d3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 09:16:22.468498 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:22.468498 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:16:22.468498 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:16:22.468498 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:16:22.468498 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:16:22.468498 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:16:22.468498 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:16:22.468498 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:16:22.468498 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:16:22.468498 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:16:22.468498 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:16:22.468498 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:16:22.468498 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:16:22.468498 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:16:22.468498 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:16:22.469450 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:16:22.469450 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:16:22.469450 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:16:22.469450 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:16:22.469450 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:16:22.469450 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:16:22.469450 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:16:22.469450 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:16:22.469450 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:16:22.469450 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:16:22.469450 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:16:22.469450 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:16:22.469450 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:16:22.469450 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:16:22.469450 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:16:22.469450 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:16:22.470431 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:16:22.470431 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:16:22.470431 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:16:22.470431 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:16:22.470431 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:16:22.470431 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:16:22.470431 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:16:22.470431 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:16:22.470431 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:16:22.470431 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:16:22.470431 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 09:16:22.470431 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:16:22.470431 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 536/1062] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Jun 27 09:16:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:16:22.477982 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f94ea-aae6-4a9f-bbb6-35b720e4a6c6 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:22.581643 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f94ea-aae6-4a9f-bbb6-35b720e4a6c6 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:22.619340 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a05eb-c558-43ad-8ee5-8a85b4a727dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:22.620022 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a05eb-c558-43ad-8ee5-8a85b4a727dd None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:22.620347 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a05eb-c558-43ad-8ee5-8a85b4a727dd None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:22.620621 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a05eb-c558-43ad-8ee5-8a85b4a727dd None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:22.621361 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a05eb-c558-43ad-8ee5-8a85b4a727dd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:22.621664 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a05eb-c558-43ad-8ee5-8a85b4a727dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:22.623025 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a05eb-c558-43ad-8ee5-8a85b4a727dd None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:22.635891 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 527/1063] 10.222.0.62 () {56 vars in 1115 bytes} [Mon Jun 27 09:16:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:22.637513 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f5a684-988b-42d0-9eb7-16dde14aa5d3 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:22.744877 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f5a684-988b-42d0-9eb7-16dde14aa5d3 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:22.783238 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2d17b-3273-401e-936f-04fcef6a336d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:22.784065 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2d17b-3273-401e-936f-04fcef6a336d None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:22.784378 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2d17b-3273-401e-936f-04fcef6a336d None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:22.784659 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2d17b-3273-401e-936f-04fcef6a336d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:22.795725 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c2d17b-3273-401e-936f-04fcef6a336d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:22.797233 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c2d17b-3273-401e-936f-04fcef6a336d None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:22.814638 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-73c2d17b-3273-401e-936f-04fcef6a336d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:16:22.814638 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:22.814638 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:16:22.814638 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:16:22.814638 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:16:22.814638 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:16:22.814638 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:16:22.814638 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:16:22.814638 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:16:22.814638 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:16:22.814638 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:16:22.814638 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:16:22.814638 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:16:22.814638 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:16:22.814638 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:16:22.816100 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:16:22.816100 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:16:22.816100 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:16:22.816100 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:16:22.816100 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:16:22.816100 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:16:22.816100 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:16:22.816100 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:16:22.816100 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:16:22.816100 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:16:22.816100 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:16:22.816100 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:16:22.816100 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:16:22.816100 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:16:22.816100 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:16:22.816100 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:16:22.816100 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:16:22.817353 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:16:22.817353 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:16:22.817353 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:16:22.817353 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:16:22.820263 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 537/1064] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:16:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:16:22.822476 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a05eb-c558-43ad-8ee5-8a85b4a727dd None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:22.839825 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:22.926916 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a05eb-c558-43ad-8ee5-8a85b4a727dd None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:22.963231 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0b697-dc6c-4013-9d53-95ad43bc150c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:22.964267 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0b697-dc6c-4013-9d53-95ad43bc150c None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:22.964745 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0b697-dc6c-4013-9d53-95ad43bc150c None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:22.965238 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0b697-dc6c-4013-9d53-95ad43bc150c None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:22.966143 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0b697-dc6c-4013-9d53-95ad43bc150c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:22.966651 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0b697-dc6c-4013-9d53-95ad43bc150c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:22.968221 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0b697-dc6c-4013-9d53-95ad43bc150c None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:22.980290 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 528/1065] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:16:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:22.985735 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2d17b-3273-401e-936f-04fcef6a336d None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:22.995735 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:23.087624 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2d17b-3273-401e-936f-04fcef6a336d None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:23.132734 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e305ab-0ab6-46e9-bc8b-83fd83d72eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:23.133528 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e305ab-0ab6-46e9-bc8b-83fd83d72eca None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:23.133810 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e305ab-0ab6-46e9-bc8b-83fd83d72eca None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:23.134086 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e305ab-0ab6-46e9-bc8b-83fd83d72eca None admin] PATH_INFO: `/v3/users/nova` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:23.142463 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e305ab-0ab6-46e9-bc8b-83fd83d72eca None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:23.143666 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e305ab-0ab6-46e9-bc8b-83fd83d72eca None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:23.157857 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-f4e305ab-0ab6-46e9-bc8b-83fd83d72eca None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 27 09:16:23.157857 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:23.157857 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:16:23.157857 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:16:23.157857 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:16:23.157857 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:16:23.157857 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:16:23.157857 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:16:23.157857 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:16:23.157857 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:16:23.157857 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:16:23.157857 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:16:23.157857 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 09:16:23.157857 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 09:16:23.157857 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 09:16:23.157857 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 09:16:23.158833 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:16:23.158833 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:16:23.158833 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 09:16:23.158833 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:16:23.158833 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 09:16:23.158833 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:16:23.158833 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:16:23.158833 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:16:23.158833 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:16:23.158833 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:16:23.158833 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:16:23.158833 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:16:23.158833 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:16:23.158833 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:16:23.158833 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:16:23.158833 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:16:23.158833 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:16:23.158833 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:16:23.159814 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:16:23.159814 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:16:23.159814 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 09:16:23.159814 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 09:16:23.159814 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 09:16:23.159814 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 09:16:23.159814 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 09:16:23.159814 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 09:16:23.159814 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 27 09:16:23.159814 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:16:23.163857 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 538/1066] 10.222.0.62 () {56 vars in 1093 bytes} [Mon Jun 27 09:16:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:16:23.165122 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0b697-dc6c-4013-9d53-95ad43bc150c None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:23.243694 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:23.273867 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0b697-dc6c-4013-9d53-95ad43bc150c None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:23.309030 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1180a19-b002-4825-b470-1a3948d64fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:23.310031 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1180a19-b002-4825-b470-1a3948d64fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:23.310533 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1180a19-b002-4825-b470-1a3948d64fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:23.311009 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1180a19-b002-4825-b470-1a3948d64fb9 None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:23.312091 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1180a19-b002-4825-b470-1a3948d64fb9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:23.312658 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1180a19-b002-4825-b470-1a3948d64fb9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:23.314276 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1180a19-b002-4825-b470-1a3948d64fb9 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:23.333405 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 529/1067] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Jun 27 09:16:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:23.338767 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e305ab-0ab6-46e9-bc8b-83fd83d72eca None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:23.407652 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:23.448010 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e305ab-0ab6-46e9-bc8b-83fd83d72eca None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:23.488357 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ac40b-04bf-423d-97a1-bdb27d2b849a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:23.489501 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ac40b-04bf-423d-97a1-bdb27d2b849a None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:23.490061 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ac40b-04bf-423d-97a1-bdb27d2b849a None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:23.490549 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ac40b-04bf-423d-97a1-bdb27d2b849a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:23.501666 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ac40b-04bf-423d-97a1-bdb27d2b849a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:23.503365 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ac40b-04bf-423d-97a1-bdb27d2b849a None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:23.521795 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-435ac40b-04bf-423d-97a1-bdb27d2b849a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:16:23.521795 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:23.521795 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:16:23.521795 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:16:23.521795 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:16:23.521795 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:16:23.521795 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:16:23.521795 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:16:23.521795 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:16:23.521795 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:16:23.521795 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:16:23.521795 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:16:23.521795 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:16:23.521795 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:16:23.521795 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:16:23.522934 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:16:23.522934 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:16:23.522934 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:16:23.522934 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:16:23.522934 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:16:23.522934 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:16:23.522934 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:16:23.522934 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:16:23.522934 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:16:23.522934 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:16:23.522934 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:16:23.522934 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:16:23.522934 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:16:23.522934 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:16:23.522934 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:16:23.522934 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:16:23.522934 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:16:23.523923 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:16:23.523923 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:16:23.523923 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:16:23.523923 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:16:23.528358 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 539/1068] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:16:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:16:23.531613 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1180a19-b002-4825-b470-1a3948d64fb9 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:23.639954 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1180a19-b002-4825-b470-1a3948d64fb9 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:23.671490 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:23.677613 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c9c0b-8bee-4d25-9403-81ea75767438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:23.678680 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c9c0b-8bee-4d25-9403-81ea75767438 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:23.679183 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c9c0b-8bee-4d25-9403-81ea75767438 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:23.679617 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c9c0b-8bee-4d25-9403-81ea75767438 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:23.684418 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c9c0b-8bee-4d25-9403-81ea75767438 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:23.684418 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c9c0b-8bee-4d25-9403-81ea75767438 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:23.684418 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c9c0b-8bee-4d25-9403-81ea75767438 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:23.694275 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 530/1069] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:16:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:23.696583 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85de9c8-750f-4c2a-923e-3e073c44fdf1 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:23.696949 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85de9c8-750f-4c2a-923e-3e073c44fdf1 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:23.697235 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85de9c8-750f-4c2a-923e-3e073c44fdf1 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:23.700232 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 540/1070] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:16:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 09:16:23.700350 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c9c0b-8bee-4d25-9403-81ea75767438 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:23.703685 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbb5cc-b154-46e4-a9dc-7498916d9deb None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:23.703969 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbb5cc-b154-46e4-a9dc-7498916d9deb None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:23.704341 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbb5cc-b154-46e4-a9dc-7498916d9deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:23.721617 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-d3dbb5cc-b154-46e4-a9dc-7498916d9deb None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:16:23.722789 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-d3dbb5cc-b154-46e4-a9dc-7498916d9deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:16:23.796431 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 541/1071] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:16:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 09:16:23.809996 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c9c0b-8bee-4d25-9403-81ea75767438 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:23.818788 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dbb5cc-b154-46e4-a9dc-7498916d9deb None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:23.846609 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f513eb5b-5f9e-45c0-a37b-8e870168b551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:23.847397 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513eb5b-5f9e-45c0-a37b-8e870168b551 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:23.847673 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513eb5b-5f9e-45c0-a37b-8e870168b551 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:23.848529 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513eb5b-5f9e-45c0-a37b-8e870168b551 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:23.855181 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f513eb5b-5f9e-45c0-a37b-8e870168b551 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:23.856652 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f513eb5b-5f9e-45c0-a37b-8e870168b551 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:23.871399 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:23.872021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-f513eb5b-5f9e-45c0-a37b-8e870168b551 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:16:23.872021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:23.872021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:16:23.872021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:16:23.872021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:16:23.872021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:16:23.872021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:16:23.872021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:16:23.872021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:16:23.872021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:16:23.872021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:16:23.872021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:16:23.872021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 09:16:23.872021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 09:16:23.872021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 09:16:23.873017 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 09:16:23.873017 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:16:23.873017 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:16:23.873017 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:16:23.873017 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:16:23.873017 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:16:23.873017 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:16:23.873017 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:16:23.873017 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:16:23.873017 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:16:23.873017 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:16:23.873017 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:16:23.873017 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:16:23.873017 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:16:23.873017 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:16:23.873017 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:16:23.873017 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:16:23.873967 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 09:16:23.873967 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 09:16:23.873967 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 09:16:23.873967 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 09:16:23.873967 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 09:16:23.873967 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 09:16:23.873967 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:16:23.873967 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:16:23.873967 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 531/1072] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:16:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 09:16:23.882607 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f513eb5b-5f9e-45c0-a37b-8e870168b551 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:23.933976 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dbb5cc-b154-46e4-a9dc-7498916d9deb None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:23.938975 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:23.971743 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb72205-3708-4478-b625-4692bac15858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:23.972581 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb72205-3708-4478-b625-4692bac15858 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:23.972857 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb72205-3708-4478-b625-4692bac15858 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:23.973124 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb72205-3708-4478-b625-4692bac15858 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:23.984482 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb72205-3708-4478-b625-4692bac15858 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:16:23.987947 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f513eb5b-5f9e-45c0-a37b-8e870168b551 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:23.992077 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-5bb72205-3708-4478-b625-4692bac15858 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:16:23.992077 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:23.992077 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:16:23.992077 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:16:23.992077 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:16:23.992077 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:16:23.992077 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:16:23.992077 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:16:23.992077 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:16:23.992077 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:16:23.992077 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:16:23.992077 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:16:23.992077 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:16:23.992077 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:16:23.992077 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:16:23.992077 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:16:23.993284 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:16:23.993284 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:16:23.993284 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:16:23.993284 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:16:23.993284 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:16:23.993284 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:16:23.993284 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:16:23.993284 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:16:23.993284 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:16:23.993284 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:16:23.993284 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:16:23.993284 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:16:23.993284 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:16:23.993284 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:16:23.993284 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:16:23.993284 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:16:23.994125 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:16:23.994125 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:16:23.994125 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:16:23.994125 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:16:23.994125 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:16:23.994125 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:16:23.994125 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:16:23.994125 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:16:23.994125 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:16:23.994125 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:16:23.994125 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:16:23.994125 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:16:23.998665 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 542/1073] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Jun 27 09:16:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 09:16:23.999341 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb72205-3708-4478-b625-4692bac15858 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:24.023191 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd24961-101a-447a-8b12-2de21db16241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:24.023850 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd24961-101a-447a-8b12-2de21db16241 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:24.024137 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd24961-101a-447a-8b12-2de21db16241 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:24.024425 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd24961-101a-447a-8b12-2de21db16241 None admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:24.025469 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd24961-101a-447a-8b12-2de21db16241 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:24.025777 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd24961-101a-447a-8b12-2de21db16241 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:24.027204 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd24961-101a-447a-8b12-2de21db16241 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:24.040135 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 532/1074] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Jun 27 09:16:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:24.046792 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd24961-101a-447a-8b12-2de21db16241 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:24.119652 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb72205-3708-4478-b625-4692bac15858 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:24.129139 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:24.155090 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138760e0-0fa4-4ccc-a3b4-8a3845716000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:24.155761 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138760e0-0fa4-4ccc-a3b4-8a3845716000 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:24.156057 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138760e0-0fa4-4ccc-a3b4-8a3845716000 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:24.156631 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138760e0-0fa4-4ccc-a3b4-8a3845716000 None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:24.157600 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138760e0-0fa4-4ccc-a3b4-8a3845716000 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:24.158294 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138760e0-0fa4-4ccc-a3b4-8a3845716000 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:24.160292 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138760e0-0fa4-4ccc-a3b4-8a3845716000 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:24.169016 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd24961-101a-447a-8b12-2de21db16241 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:24.169414 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 543/1075] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:16:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:24.175136 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138760e0-0fa4-4ccc-a3b4-8a3845716000 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:24.187365 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:24.210799 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c4dae6-1a49-4095-a7b3-0396300926c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:24.216440 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4dae6-1a49-4095-a7b3-0396300926c8 None admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:24.216440 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4dae6-1a49-4095-a7b3-0396300926c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:24.216440 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4dae6-1a49-4095-a7b3-0396300926c8 None admin] PATH_INFO: `/v3/projects/4ba8e40538db4d89b93469b79322d20e/users/2c1434a85b30411c9c59cc50c3980cd8/roles/6278d7f8619447b4b75ea2e9f2d03cb4` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:24.216440 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c4dae6-1a49-4095-a7b3-0396300926c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=4ba8e40538db4d89b93469b79322d20e, user_id=2c1434a85b30411c9c59cc50c3980cd8, role_id=6278d7f8619447b4b75ea2e9f2d03cb4)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:24.216896 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c4dae6-1a49-4095-a7b3-0396300926c8 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:24.275931 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138760e0-0fa4-4ccc-a3b4-8a3845716000 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:24.299644 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 533/1076] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Jun 27 09:16:24 2022] PUT /identity/v3/projects/4ba8e40538db4d89b93469b79322d20e/users/2c1434a85b30411c9c59cc50c3980cd8/roles/6278d7f8619447b4b75ea2e9f2d03cb4 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:16:24.300989 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8797509-adb3-4ecc-b398-020a9cb24a52 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:24.301276 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8797509-adb3-4ecc-b398-020a9cb24a52 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:24.301553 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8797509-adb3-4ecc-b398-020a9cb24a52 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:24.302858 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 534/1077] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:16:24.308791 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c46da-60bd-4b33-9772-6a35e3e1df38 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:24.309129 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c46da-60bd-4b33-9772-6a35e3e1df38 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:24.309360 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c46da-60bd-4b33-9772-6a35e3e1df38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:24.317740 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1c545-0a0f-4571-a407-8f0450e2f3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:24.318652 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1c545-0a0f-4571-a407-8f0450e2f3b1 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:24.319051 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1c545-0a0f-4571-a407-8f0450e2f3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:24.319386 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1c545-0a0f-4571-a407-8f0450e2f3b1 None admin] PATH_INFO: `/v3/users/f9116fb936e3481cb446b8ddb32b1b9f` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:24.320815 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba1c545-0a0f-4571-a407-8f0450e2f3b1 None admin] RBAC: Authorizing `identity:get_user(user_id=f9116fb936e3481cb446b8ddb32b1b9f)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:24.323010 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba1c545-0a0f-4571-a407-8f0450e2f3b1 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:24.325215 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 544/1078] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Jun 27 09:16:24 2022] GET /identity/v3/users/f9116fb936e3481cb446b8ddb32b1b9f => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:16:24.328683 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-9d9c46da-60bd-4b33-9772-6a35e3e1df38 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:16:24.329899 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-9d9c46da-60bd-4b33-9772-6a35e3e1df38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:16:24.331795 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1c545-0a0f-4571-a407-8f0450e2f3b1 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:24.379449 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:24.409381 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 535/1079] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:16:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 09:16:24.432443 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c46da-60bd-4b33-9772-6a35e3e1df38 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:24.458098 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1c545-0a0f-4571-a407-8f0450e2f3b1 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:24.496657 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b635ab29-ae61-4570-89e6-fe2d240ce42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:24.497565 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635ab29-ae61-4570-89e6-fe2d240ce42e None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:24.497846 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635ab29-ae61-4570-89e6-fe2d240ce42e None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:24.498117 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635ab29-ae61-4570-89e6-fe2d240ce42e None admin] PATH_INFO: `/v3/projects/0dfdd9951adb4668af803c2402e22b1f` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:24.499397 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b635ab29-ae61-4570-89e6-fe2d240ce42e None admin] RBAC: Authorizing `identity:get_project(project_id=0dfdd9951adb4668af803c2402e22b1f)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:24.500997 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b635ab29-ae61-4570-89e6-fe2d240ce42e None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:24.503632 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 545/1080] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:16:24 2022] GET /identity/v3/projects/0dfdd9951adb4668af803c2402e22b1f => generated 311 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:16:24.509379 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b635ab29-ae61-4570-89e6-fe2d240ce42e None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:24.555438 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c46da-60bd-4b33-9772-6a35e3e1df38 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:24.557726 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:24.594526 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d7171-3905-442a-a8f2-95714cae054a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:24.595179 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d7171-3905-442a-a8f2-95714cae054a None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:24.595575 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d7171-3905-442a-a8f2-95714cae054a None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:24.595849 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d7171-3905-442a-a8f2-95714cae054a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:24.615217 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b635ab29-ae61-4570-89e6-fe2d240ce42e None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:24.623116 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:24.652850 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1232e-c950-4296-9f84-11f698721aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:24.654044 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1232e-c950-4296-9f84-11f698721aa2 None admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:24.654462 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1232e-c950-4296-9f84-11f698721aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:24.654832 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1232e-c950-4296-9f84-11f698721aa2 None admin] PATH_INFO: `/v3/projects/0dfdd9951adb4668af803c2402e22b1f/users/f9116fb936e3481cb446b8ddb32b1b9f/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:24.657317 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d1232e-c950-4296-9f84-11f698721aa2 None admin] RBAC: Authorizing `identity:create_grant(project_id=0dfdd9951adb4668af803c2402e22b1f, user_id=f9116fb936e3481cb446b8ddb32b1b9f, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:24.658831 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d1232e-c950-4296-9f84-11f698721aa2 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:24.672436 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9d7171-3905-442a-a8f2-95714cae054a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:24.674571 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9d7171-3905-442a-a8f2-95714cae054a None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:24.741772 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 546/1081] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Jun 27 09:16:24 2022] PUT /identity/v3/projects/0dfdd9951adb4668af803c2402e22b1f/users/f9116fb936e3481cb446b8ddb32b1b9f/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:16:24.780374 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 536/1082] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:16:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 27 09:16:24.786173 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1232e-c950-4296-9f84-11f698721aa2 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:24.896508 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1232e-c950-4296-9f84-11f698721aa2 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:24.935255 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09efbbb-5da7-4401-b968-a23d6dca5348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:24.936064 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09efbbb-5da7-4401-b968-a23d6dca5348 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:24.936418 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09efbbb-5da7-4401-b968-a23d6dca5348 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:24.936701 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09efbbb-5da7-4401-b968-a23d6dca5348 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:24.947547 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09efbbb-5da7-4401-b968-a23d6dca5348 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:24.949032 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09efbbb-5da7-4401-b968-a23d6dca5348 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:24.966723 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-b09efbbb-5da7-4401-b968-a23d6dca5348 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:16:24.966723 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:24.966723 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:16:24.966723 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:16:24.966723 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:16:24.966723 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:16:24.966723 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:16:24.966723 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:16:24.966723 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:16:24.966723 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:16:24.966723 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:16:24.966723 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:16:24.966723 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:16:24.966723 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:16:24.966723 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:16:24.967663 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:16:24.967663 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:16:24.967663 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:16:24.967663 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:16:24.967663 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:16:24.967663 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:16:24.967663 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:16:24.967663 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:16:24.967663 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:16:24.967663 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:16:24.967663 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:16:24.967663 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:16:24.967663 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:16:24.967663 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:16:24.967663 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:16:24.967663 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:16:24.967663 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:16:24.968635 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:16:24.968635 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:16:24.968635 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:16:24.968635 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:16:24.972267 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 547/1083] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:16:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 09:16:24.974667 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d7171-3905-442a-a8f2-95714cae054a None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:24.977048 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:25.088343 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d7171-3905-442a-a8f2-95714cae054a None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:25.138910 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc264d1f-8f04-45b8-9912-0587998ff8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:25.139577 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc264d1f-8f04-45b8-9912-0587998ff8a2 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:25.139861 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc264d1f-8f04-45b8-9912-0587998ff8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:25.140152 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc264d1f-8f04-45b8-9912-0587998ff8a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:25.140893 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc264d1f-8f04-45b8-9912-0587998ff8a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:25.141200 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc264d1f-8f04-45b8-9912-0587998ff8a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:25.142580 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc264d1f-8f04-45b8-9912-0587998ff8a2 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:25.155347 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 537/1084] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:16:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:26.358164 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824fc9c8-141e-4ada-97fb-3b4fb6b62e9b None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:26.358756 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824fc9c8-141e-4ada-97fb-3b4fb6b62e9b None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:26.358756 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824fc9c8-141e-4ada-97fb-3b4fb6b62e9b None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:26.360219 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 548/1085] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:16:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:16:26.365728 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c69867c-48c4-46fd-968e-bb5b290265cc None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:26.366143 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c69867c-48c4-46fd-968e-bb5b290265cc None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:26.366433 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c69867c-48c4-46fd-968e-bb5b290265cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:26.383721 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-2c69867c-48c4-46fd-968e-bb5b290265cc None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:16:26.384930 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-2c69867c-48c4-46fd-968e-bb5b290265cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:16:26.442259 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:26.452711 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 538/1086] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:16:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 09:16:26.476597 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824fc9c8-141e-4ada-97fb-3b4fb6b62e9b None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:26.496178 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:26.579843 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824fc9c8-141e-4ada-97fb-3b4fb6b62e9b None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:26.614841 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e66920-0cec-40f5-ab40-5e674b2464c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:26.615508 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e66920-0cec-40f5-ab40-5e674b2464c1 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:26.615840 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e66920-0cec-40f5-ab40-5e674b2464c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:26.616059 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e66920-0cec-40f5-ab40-5e674b2464c1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:26.626433 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e66920-0cec-40f5-ab40-5e674b2464c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:16:26.635148 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-c2e66920-0cec-40f5-ab40-5e674b2464c1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 09:16:26.635148 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:26.635148 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:16:26.635148 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:16:26.635148 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:16:26.635148 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:16:26.635148 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:16:26.635148 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:16:26.635148 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:16:26.635148 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:16:26.635148 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:16:26.635148 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:16:26.635148 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:16:26.635148 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:16:26.635148 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:16:26.635148 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:16:26.636348 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:16:26.636348 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:16:26.636348 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:16:26.636348 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:16:26.636348 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:16:26.636348 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:16:26.636348 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:16:26.636348 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:16:26.636348 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:16:26.636348 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:16:26.636348 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:16:26.636348 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:16:26.636348 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:16:26.636348 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:16:26.636348 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:16:26.636348 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:16:26.637289 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:16:26.637289 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:16:26.637289 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:16:26.637289 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:16:26.637289 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:16:26.637289 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:16:26.637289 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:16:26.637289 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:16:26.637289 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:16:26.637289 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:16:26.637289 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 09:16:26.637289 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:16:26.637289 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 549/1087] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Jun 27 09:16:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:16:26.642378 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c69867c-48c4-46fd-968e-bb5b290265cc None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:26.742340 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c69867c-48c4-46fd-968e-bb5b290265cc None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:26.776806 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c46dc-2f77-4d98-b496-79b6ab393de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:26.777471 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c46dc-2f77-4d98-b496-79b6ab393de6 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:26.777754 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c46dc-2f77-4d98-b496-79b6ab393de6 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:26.778033 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c46dc-2f77-4d98-b496-79b6ab393de6 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:26.778766 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3c46dc-2f77-4d98-b496-79b6ab393de6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:26.779070 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3c46dc-2f77-4d98-b496-79b6ab393de6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:26.780451 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3c46dc-2f77-4d98-b496-79b6ab393de6 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:26.788606 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 539/1088] 10.222.0.62 () {56 vars in 1115 bytes} [Mon Jun 27 09:16:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:26.794056 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e66920-0cec-40f5-ab40-5e674b2464c1 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:26.823308 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558879fe-6f3d-427a-9f95-b836dad37c79 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:26.823602 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558879fe-6f3d-427a-9f95-b836dad37c79 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:26.823880 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558879fe-6f3d-427a-9f95-b836dad37c79 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:26.825430 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 540/1089] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:16:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:16:26.831115 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7f604-db04-40a9-bc60-0e5549bcb35a None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:26.831400 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7f604-db04-40a9-bc60-0e5549bcb35a None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:26.831678 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7f604-db04-40a9-bc60-0e5549bcb35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:26.849267 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-50d7f604-db04-40a9-bc60-0e5549bcb35a None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:16:26.850385 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-50d7f604-db04-40a9-bc60-0e5549bcb35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:16:26.873794 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:26.895043 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e66920-0cec-40f5-ab40-5e674b2464c1 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:26.900737 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:26.918848 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 541/1090] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:16:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 09:16:26.931698 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d83539-6f40-4ccf-85fc-cf9e174bde3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:26.932522 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d83539-6f40-4ccf-85fc-cf9e174bde3b None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:26.932807 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d83539-6f40-4ccf-85fc-cf9e174bde3b None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:26.933082 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d83539-6f40-4ccf-85fc-cf9e174bde3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:26.943831 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d83539-6f40-4ccf-85fc-cf9e174bde3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:26.943992 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7f604-db04-40a9-bc60-0e5549bcb35a None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:26.945327 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d83539-6f40-4ccf-85fc-cf9e174bde3b None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:26.963163 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-40d83539-6f40-4ccf-85fc-cf9e174bde3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:16:26.963163 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:26.963163 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:16:26.963163 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:16:26.963163 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:16:26.963163 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:16:26.963163 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:16:26.963163 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:16:26.963163 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:16:26.963163 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:16:26.963163 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:16:26.963163 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:16:26.963163 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:16:26.963163 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:16:26.963163 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:16:26.964181 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:16:26.964181 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:16:26.964181 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:16:26.964181 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:16:26.964181 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:16:26.964181 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:16:26.964181 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:16:26.964181 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:16:26.964181 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:16:26.964181 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:16:26.964181 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:16:26.964181 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:16:26.964181 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:16:26.964181 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:16:26.964181 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:16:26.964181 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:16:26.964181 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:16:26.965124 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:16:26.965124 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:16:26.965124 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:16:26.965124 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:16:26.965124 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 550/1091] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:16:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 09:16:26.970043 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d83539-6f40-4ccf-85fc-cf9e174bde3b None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:27.044754 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7f604-db04-40a9-bc60-0e5549bcb35a None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:27.068179 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d83539-6f40-4ccf-85fc-cf9e174bde3b None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:27.079740 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2623af-1a0c-4368-8b15-6313d44e0aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:27.080595 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2623af-1a0c-4368-8b15-6313d44e0aab None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:27.080871 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2623af-1a0c-4368-8b15-6313d44e0aab None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:27.081142 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2623af-1a0c-4368-8b15-6313d44e0aab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:27.091086 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2623af-1a0c-4368-8b15-6313d44e0aab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:16:27.097044 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:27.098702 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-4b2623af-1a0c-4368-8b15-6313d44e0aab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:16:27.098702 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:27.098702 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:16:27.098702 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:16:27.098702 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:16:27.098702 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:16:27.098702 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:16:27.098702 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:16:27.098702 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:16:27.098702 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:16:27.098702 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:16:27.098702 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:16:27.098702 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:16:27.098702 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:16:27.098702 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:16:27.098702 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:16:27.099819 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:16:27.099819 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:16:27.099819 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:16:27.099819 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:16:27.099819 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:16:27.099819 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:16:27.099819 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:16:27.099819 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:16:27.099819 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:16:27.099819 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:16:27.099819 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:16:27.099819 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:16:27.099819 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:16:27.099819 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:16:27.099819 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:16:27.099819 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:16:27.100893 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:16:27.100893 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:16:27.100893 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:16:27.100893 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:16:27.100893 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:16:27.100893 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:16:27.100893 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:16:27.100893 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:16:27.100893 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:16:27.100893 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:16:27.100893 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:16:27.100893 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:16:27.100893 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 542/1092] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Jun 27 09:16:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 09:16:27.105825 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2623af-1a0c-4368-8b15-6313d44e0aab None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:27.109203 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74892aa7-2a0c-4b72-a51e-a750ee4c7828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:27.109203 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74892aa7-2a0c-4b72-a51e-a750ee4c7828 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:27.109203 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74892aa7-2a0c-4b72-a51e-a750ee4c7828 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:27.109203 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74892aa7-2a0c-4b72-a51e-a750ee4c7828 None admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:27.109578 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74892aa7-2a0c-4b72-a51e-a750ee4c7828 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:27.109578 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74892aa7-2a0c-4b72-a51e-a750ee4c7828 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:27.109578 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74892aa7-2a0c-4b72-a51e-a750ee4c7828 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:27.121959 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 551/1093] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:16:27.128140 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74892aa7-2a0c-4b72-a51e-a750ee4c7828 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:27.155215 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:27.211019 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2623af-1a0c-4368-8b15-6313d44e0aab None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:27.230775 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74892aa7-2a0c-4b72-a51e-a750ee4c7828 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:27.247749 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eba676-d235-4e77-8f5d-41a23ea47212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:27.248941 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eba676-d235-4e77-8f5d-41a23ea47212 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:27.249416 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eba676-d235-4e77-8f5d-41a23ea47212 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:27.249710 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eba676-d235-4e77-8f5d-41a23ea47212 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:27.250508 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eba676-d235-4e77-8f5d-41a23ea47212 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:27.250819 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eba676-d235-4e77-8f5d-41a23ea47212 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:27.252234 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eba676-d235-4e77-8f5d-41a23ea47212 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:27.261344 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 543/1094] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:16:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:16:27.265865 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e84c7a-4a3c-465f-9db9-79d2e6bf04ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:27.266719 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e84c7a-4a3c-465f-9db9-79d2e6bf04ad None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:27.267003 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e84c7a-4a3c-465f-9db9-79d2e6bf04ad None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:27.267114 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eba676-d235-4e77-8f5d-41a23ea47212 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:27.267276 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e84c7a-4a3c-465f-9db9-79d2e6bf04ad None admin] PATH_INFO: `/v3/users/nova` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:27.275584 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e84c7a-4a3c-465f-9db9-79d2e6bf04ad None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:27.277063 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e84c7a-4a3c-465f-9db9-79d2e6bf04ad None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:27.291679 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-b2e84c7a-4a3c-465f-9db9-79d2e6bf04ad None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 27 09:16:27.291679 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:27.291679 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:16:27.291679 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:16:27.291679 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:16:27.291679 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:16:27.291679 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:16:27.291679 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:16:27.291679 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:16:27.291679 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:16:27.291679 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:16:27.291679 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:16:27.291679 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 09:16:27.291679 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 09:16:27.291679 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 09:16:27.291679 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 09:16:27.292934 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:16:27.292934 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:16:27.292934 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 09:16:27.292934 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:16:27.292934 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 09:16:27.292934 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:16:27.292934 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:16:27.292934 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:16:27.292934 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:16:27.292934 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:16:27.292934 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:16:27.292934 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:16:27.292934 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:16:27.292934 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:16:27.292934 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:16:27.292934 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:16:27.292934 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:16:27.292934 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:16:27.293918 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:16:27.293918 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:16:27.293918 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 09:16:27.293918 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 09:16:27.293918 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 09:16:27.293918 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 09:16:27.293918 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 09:16:27.293918 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 09:16:27.293918 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 27 09:16:27.293918 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:16:27.293918 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 552/1095] 10.222.0.62 () {56 vars in 1093 bytes} [Mon Jun 27 09:16:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 09:16:27.298633 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e84c7a-4a3c-465f-9db9-79d2e6bf04ad None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:27.349663 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:27.371210 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eba676-d235-4e77-8f5d-41a23ea47212 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:27.378289 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:27.400831 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e84c7a-4a3c-465f-9db9-79d2e6bf04ad None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:27.404971 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe806f7-44e7-4234-8264-369595774ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:27.405849 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe806f7-44e7-4234-8264-369595774ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:27.406130 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe806f7-44e7-4234-8264-369595774ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:27.406403 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe806f7-44e7-4234-8264-369595774ed6 None admin] PATH_INFO: `/v3/users/f9116fb936e3481cb446b8ddb32b1b9f` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:27.407654 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe806f7-44e7-4234-8264-369595774ed6 None admin] RBAC: Authorizing `identity:get_user(user_id=f9116fb936e3481cb446b8ddb32b1b9f)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:27.410463 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe806f7-44e7-4234-8264-369595774ed6 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:27.416962 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 544/1096] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Jun 27 09:16:27 2022] GET /identity/v3/users/f9116fb936e3481cb446b8ddb32b1b9f => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:16:27.418028 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe806f7-44e7-4234-8264-369595774ed6 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:27.435252 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f83194-c0b0-4831-ad73-dde949f172e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:27.435920 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f83194-c0b0-4831-ad73-dde949f172e1 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:27.436228 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f83194-c0b0-4831-ad73-dde949f172e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:27.436506 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f83194-c0b0-4831-ad73-dde949f172e1 None admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:27.437337 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f83194-c0b0-4831-ad73-dde949f172e1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:27.437648 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f83194-c0b0-4831-ad73-dde949f172e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:27.439075 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f83194-c0b0-4831-ad73-dde949f172e1 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:27.456181 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 553/1097] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Jun 27 09:16:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:16:27.461853 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f83194-c0b0-4831-ad73-dde949f172e1 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:27.518181 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe806f7-44e7-4234-8264-369595774ed6 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:27.552156 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb7d93-8022-4d1e-ac71-25dea37b4580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:27.552832 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb7d93-8022-4d1e-ac71-25dea37b4580 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:27.553114 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb7d93-8022-4d1e-ac71-25dea37b4580 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:27.553394 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb7d93-8022-4d1e-ac71-25dea37b4580 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:27.558789 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f83194-c0b0-4831-ad73-dde949f172e1 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:27.568748 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:27.593878 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff8146-f578-4a76-850d-0acb5323d957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:27.594523 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff8146-f578-4a76-850d-0acb5323d957 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:27.594804 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff8146-f578-4a76-850d-0acb5323d957 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:27.595123 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff8146-f578-4a76-850d-0acb5323d957 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:27.603593 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:27.628991 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb7d93-8022-4d1e-ac71-25dea37b4580 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:27.630385 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb7d93-8022-4d1e-ac71-25dea37b4580 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:27.665545 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff8146-f578-4a76-850d-0acb5323d957 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:27.666999 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff8146-f578-4a76-850d-0acb5323d957 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:27.734184 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 545/1098] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:16:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 27 09:16:27.735251 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb7d93-8022-4d1e-ac71-25dea37b4580 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:27.764561 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 554/1099] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:16:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 27 09:16:27.770465 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff8146-f578-4a76-850d-0acb5323d957 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:27.781409 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:27.809077 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:27.835703 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb7d93-8022-4d1e-ac71-25dea37b4580 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:27.874176 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff8146-f578-4a76-850d-0acb5323d957 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:27.881915 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd01b2-005e-41f9-99a1-d74a08908bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:27.883035 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd01b2-005e-41f9-99a1-d74a08908bad None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:27.883315 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd01b2-005e-41f9-99a1-d74a08908bad None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:27.883592 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd01b2-005e-41f9-99a1-d74a08908bad None admin] PATH_INFO: `/v3/projects/0dfdd9951adb4668af803c2402e22b1f` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:27.884828 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdd01b2-005e-41f9-99a1-d74a08908bad None admin] RBAC: Authorizing `identity:get_project(project_id=0dfdd9951adb4668af803c2402e22b1f)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:27.886265 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdd01b2-005e-41f9-99a1-d74a08908bad None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:27.888153 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 546/1100] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:16:27 2022] GET /identity/v3/projects/0dfdd9951adb4668af803c2402e22b1f => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:27.894589 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd01b2-005e-41f9-99a1-d74a08908bad None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:27.911041 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ccd72-fa77-478e-a623-0cd86c9d75dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:27.911846 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ccd72-fa77-478e-a623-0cd86c9d75dd None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:27.912125 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ccd72-fa77-478e-a623-0cd86c9d75dd None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:27.912426 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ccd72-fa77-478e-a623-0cd86c9d75dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:27.924667 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1ccd72-fa77-478e-a623-0cd86c9d75dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:27.926776 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1ccd72-fa77-478e-a623-0cd86c9d75dd None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:27.948603 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-6a1ccd72-fa77-478e-a623-0cd86c9d75dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:16:27.948603 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:27.948603 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:16:27.948603 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:16:27.948603 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:16:27.948603 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:16:27.948603 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:16:27.948603 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:16:27.948603 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:16:27.948603 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:16:27.948603 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:16:27.948603 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:16:27.948603 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:16:27.948603 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:16:27.948603 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:16:27.949589 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:16:27.949589 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:16:27.949589 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:16:27.949589 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:16:27.949589 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:16:27.949589 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:16:27.949589 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:16:27.949589 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:16:27.949589 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:16:27.949589 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:16:27.949589 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:16:27.949589 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:16:27.949589 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:16:27.949589 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:16:27.949589 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:16:27.949589 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:16:27.949589 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:16:27.950479 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:16:27.950479 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:16:27.950479 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:16:27.950479 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:16:27.952367 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 555/1101] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:16:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 09:16:27.955639 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ccd72-fa77-478e-a623-0cd86c9d75dd None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:28.002915 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd01b2-005e-41f9-99a1-d74a08908bad None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:28.025730 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:28.039720 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1372b2b7-1e5d-4353-a4c7-03ef0f93ce4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:28.041930 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372b2b7-1e5d-4353-a4c7-03ef0f93ce4d None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:28.041930 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372b2b7-1e5d-4353-a4c7-03ef0f93ce4d None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:28.041930 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372b2b7-1e5d-4353-a4c7-03ef0f93ce4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:28.041930 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1372b2b7-1e5d-4353-a4c7-03ef0f93ce4d None admin] RBAC: Adding query filter params (role.id=91c77942515d45f1ad8189c9fddf4424, scope.project.id=0dfdd9951adb4668af803c2402e22b1f, user.id=f9116fb936e3481cb446b8ddb32b1b9f) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:28.042232 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1372b2b7-1e5d-4353-a4c7-03ef0f93ce4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:28.044444 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1372b2b7-1e5d-4353-a4c7-03ef0f93ce4d None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:28.053602 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 547/1102] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Jun 27 09:16:27 2022] GET /identity/v3/role_assignments?user.id=f9116fb936e3481cb446b8ddb32b1b9f&scope.project.id=0dfdd9951adb4668af803c2402e22b1f&role.id=91c77942515d45f1ad8189c9fddf4424 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:28.069838 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ccd72-fa77-478e-a623-0cd86c9d75dd None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:28.124952 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7946a03-8f79-4704-a3dc-61072db2458c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:28.126003 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7946a03-8f79-4704-a3dc-61072db2458c None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:28.126477 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7946a03-8f79-4704-a3dc-61072db2458c None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:28.126951 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7946a03-8f79-4704-a3dc-61072db2458c None admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:28.128370 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7946a03-8f79-4704-a3dc-61072db2458c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:28.128874 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7946a03-8f79-4704-a3dc-61072db2458c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:28.131210 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7946a03-8f79-4704-a3dc-61072db2458c None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:28.153047 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 556/1103] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:16:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:28.160369 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1372b2b7-1e5d-4353-a4c7-03ef0f93ce4d None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:28.175350 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:28.272098 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1372b2b7-1e5d-4353-a4c7-03ef0f93ce4d None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:28.306436 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3031a0-b229-4f76-98c7-d85001e82bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:28.307218 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3031a0-b229-4f76-98c7-d85001e82bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:28.307497 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3031a0-b229-4f76-98c7-d85001e82bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:28.307763 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3031a0-b229-4f76-98c7-d85001e82bc8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:28.314286 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3031a0-b229-4f76-98c7-d85001e82bc8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:28.315742 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3031a0-b229-4f76-98c7-d85001e82bc8 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:28.329720 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-7a3031a0-b229-4f76-98c7-d85001e82bc8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:16:28.329720 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:28.329720 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:16:28.329720 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:16:28.329720 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:16:28.329720 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:16:28.329720 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:16:28.329720 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:16:28.329720 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:16:28.329720 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:16:28.329720 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:16:28.329720 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:16:28.329720 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 09:16:28.329720 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 09:16:28.329720 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 09:16:28.331217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 09:16:28.331217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:16:28.331217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:16:28.331217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:16:28.331217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:16:28.331217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:16:28.331217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:16:28.331217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:16:28.331217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:16:28.331217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:16:28.331217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:16:28.331217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:16:28.331217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:16:28.331217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:16:28.331217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:16:28.331217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:16:28.331217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:16:28.332134 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 09:16:28.332134 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 09:16:28.332134 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 09:16:28.332134 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 09:16:28.332134 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 09:16:28.332134 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 09:16:28.332134 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:16:28.332134 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:16:28.332134 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 548/1104] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:16:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:16:28.337328 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7946a03-8f79-4704-a3dc-61072db2458c None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:28.439857 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7946a03-8f79-4704-a3dc-61072db2458c None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:28.462623 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:28.481927 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78a8f2-5f1b-42ad-a5a9-512ed30284a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:28.482584 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78a8f2-5f1b-42ad-a5a9-512ed30284a8 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:28.482869 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78a8f2-5f1b-42ad-a5a9-512ed30284a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:28.483148 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78a8f2-5f1b-42ad-a5a9-512ed30284a8 None admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:28.483938 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78a8f2-5f1b-42ad-a5a9-512ed30284a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:28.484279 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78a8f2-5f1b-42ad-a5a9-512ed30284a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:28.485719 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78a8f2-5f1b-42ad-a5a9-512ed30284a8 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:28.497909 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 557/1105] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Jun 27 09:16:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:28.503949 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3031a0-b229-4f76-98c7-d85001e82bc8 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:28.570391 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:28.604812 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3031a0-b229-4f76-98c7-d85001e82bc8 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:28.638544 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ff8e3-0b47-40a4-b75e-282cfd3373a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:28.639199 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ff8e3-0b47-40a4-b75e-282cfd3373a3 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:28.639478 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ff8e3-0b47-40a4-b75e-282cfd3373a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:28.639788 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ff8e3-0b47-40a4-b75e-282cfd3373a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:28.640659 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ff8e3-0b47-40a4-b75e-282cfd3373a3 None admin] RBAC: Adding query filter params (role.id=6278d7f8619447b4b75ea2e9f2d03cb4, scope.project.id=4ba8e40538db4d89b93469b79322d20e, user.id=2c1434a85b30411c9c59cc50c3980cd8) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:28.640971 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ff8e3-0b47-40a4-b75e-282cfd3373a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:28.642412 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ff8e3-0b47-40a4-b75e-282cfd3373a3 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:28.649102 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 549/1106] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Jun 27 09:16:28 2022] GET /identity/v3/role_assignments?user.id=2c1434a85b30411c9c59cc50c3980cd8&scope.project.id=4ba8e40538db4d89b93469b79322d20e&role.id=6278d7f8619447b4b75ea2e9f2d03cb4 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:16:30.187680 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01af53-8211-485d-9bd9-844f83e68db0 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:30.188192 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01af53-8211-485d-9bd9-844f83e68db0 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:30.188307 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01af53-8211-485d-9bd9-844f83e68db0 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:30.189711 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 558/1107] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:16:30.194915 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cbb84-55f8-4def-8de1-c4e43747840b None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:30.195342 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cbb84-55f8-4def-8de1-c4e43747840b None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:30.195471 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cbb84-55f8-4def-8de1-c4e43747840b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:30.211703 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-361cbb84-55f8-4def-8de1-c4e43747840b None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:16:30.212917 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-361cbb84-55f8-4def-8de1-c4e43747840b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:16:30.278388 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 550/1108] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:16:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 09:16:30.303897 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01af53-8211-485d-9bd9-844f83e68db0 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:30.406002 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01af53-8211-485d-9bd9-844f83e68db0 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:30.439962 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf139b-00a3-41e4-a149-ac9c71ab0e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:30.440766 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf139b-00a3-41e4-a149-ac9c71ab0e8f None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:30.441041 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf139b-00a3-41e4-a149-ac9c71ab0e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:30.441311 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf139b-00a3-41e4-a149-ac9c71ab0e8f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:30.442465 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf139b-00a3-41e4-a149-ac9c71ab0e8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:30.443895 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf139b-00a3-41e4-a149-ac9c71ab0e8f None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:30.445532 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 559/1109] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:16:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:30.451489 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361cbb84-55f8-4def-8de1-c4e43747840b None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:30.510554 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:30.550546 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361cbb84-55f8-4def-8de1-c4e43747840b None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:30.584504 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54944d87-1cfe-4dcf-9937-51524e6db7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:30.585166 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54944d87-1cfe-4dcf-9937-51524e6db7db None admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:30.585446 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54944d87-1cfe-4dcf-9937-51524e6db7db None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:30.585802 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54944d87-1cfe-4dcf-9937-51524e6db7db None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:30.586409 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54944d87-1cfe-4dcf-9937-51524e6db7db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:30.587834 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54944d87-1cfe-4dcf-9937-51524e6db7db None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:30.723359 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 551/1110] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Jun 27 09:16:30 2022] POST /identity/v3/users => generated 286 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:16:32.807231 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db8eba-c71f-4f03-b80d-fd6b98348394 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:32.807800 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db8eba-c71f-4f03-b80d-fd6b98348394 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:32.807800 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db8eba-c71f-4f03-b80d-fd6b98348394 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:32.809198 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 560/1111] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:16:32.814707 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d815ec6-ccbe-46a5-aedc-4e2a452cfeee None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:32.815167 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d815ec6-ccbe-46a5-aedc-4e2a452cfeee None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:32.815260 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d815ec6-ccbe-46a5-aedc-4e2a452cfeee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:32.834526 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-1d815ec6-ccbe-46a5-aedc-4e2a452cfeee None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:16:32.835707 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-1d815ec6-ccbe-46a5-aedc-4e2a452cfeee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:16:32.900490 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 552/1112] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:16:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 09:16:32.924720 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db8eba-c71f-4f03-b80d-fd6b98348394 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:32.975090 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:33.025293 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db8eba-c71f-4f03-b80d-fd6b98348394 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:33.057849 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc099ed8-337d-4eb1-92ef-87ad29d1b2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:33.058619 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc099ed8-337d-4eb1-92ef-87ad29d1b2aa None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:33.058896 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc099ed8-337d-4eb1-92ef-87ad29d1b2aa None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:33.059163 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc099ed8-337d-4eb1-92ef-87ad29d1b2aa None admin] PATH_INFO: `/v3/roles/b137366eb53b42aab629a88be737eaf9` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:33.060626 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc099ed8-337d-4eb1-92ef-87ad29d1b2aa None admin] RBAC: Authorizing `identity:get_role(role_id=b137366eb53b42aab629a88be737eaf9)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:33.062032 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc099ed8-337d-4eb1-92ef-87ad29d1b2aa None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:33.063395 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 561/1113] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Jun 27 09:16:32 2022] GET /identity/v3/roles/b137366eb53b42aab629a88be737eaf9 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:33.069313 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d815ec6-ccbe-46a5-aedc-4e2a452cfeee None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:33.122533 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:33.175439 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d815ec6-ccbe-46a5-aedc-4e2a452cfeee None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:33.211209 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c840caf-4846-4e1d-bcb0-015d74e9499d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:33.212074 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c840caf-4846-4e1d-bcb0-015d74e9499d None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:33.212391 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c840caf-4846-4e1d-bcb0-015d74e9499d None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:33.212666 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c840caf-4846-4e1d-bcb0-015d74e9499d None admin] PATH_INFO: `/v3/users/b2c149f29a4c4fadbc2fea3a342465ad` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:33.225725 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c840caf-4846-4e1d-bcb0-015d74e9499d None admin] RBAC: Authorizing `identity:get_user(user_id=b2c149f29a4c4fadbc2fea3a342465ad)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:33.227182 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c840caf-4846-4e1d-bcb0-015d74e9499d None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:33.228903 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 553/1114] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Jun 27 09:16:33 2022] GET /identity/v3/users/b2c149f29a4c4fadbc2fea3a342465ad => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:33.234629 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc099ed8-337d-4eb1-92ef-87ad29d1b2aa None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:33.332562 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc099ed8-337d-4eb1-92ef-87ad29d1b2aa None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:33.347703 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:33.364826 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0e576-eedc-4282-b856-fd7577743605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:33.365461 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0e576-eedc-4282-b856-fd7577743605 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:33.365739 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0e576-eedc-4282-b856-fd7577743605 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:33.366013 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0e576-eedc-4282-b856-fd7577743605 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:33.432959 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed0e576-eedc-4282-b856-fd7577743605 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:33.434401 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed0e576-eedc-4282-b856-fd7577743605 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:33.533601 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 562/1115] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:16:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 09:16:33.539537 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c840caf-4846-4e1d-bcb0-015d74e9499d None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:33.638623 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c840caf-4846-4e1d-bcb0-015d74e9499d None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:33.640944 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:33.683135 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b8f03-6ef1-4a58-9cc0-1beb4573a5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:33.683993 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b8f03-6ef1-4a58-9cc0-1beb4573a5ba None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:33.684299 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b8f03-6ef1-4a58-9cc0-1beb4573a5ba None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:33.684574 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b8f03-6ef1-4a58-9cc0-1beb4573a5ba None admin] PATH_INFO: `/v3/projects/0dfdd9951adb4668af803c2402e22b1f` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:33.685750 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3b8f03-6ef1-4a58-9cc0-1beb4573a5ba None admin] RBAC: Authorizing `identity:get_project(project_id=0dfdd9951adb4668af803c2402e22b1f)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:33.687200 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3b8f03-6ef1-4a58-9cc0-1beb4573a5ba None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:33.690079 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 554/1116] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:16:33 2022] GET /identity/v3/projects/0dfdd9951adb4668af803c2402e22b1f => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:33.696474 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0e576-eedc-4282-b856-fd7577743605 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:33.715165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:33.799215 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0e576-eedc-4282-b856-fd7577743605 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:33.835463 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1412c-9f9e-4e7a-88b4-7dc23123301d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:33.836399 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1412c-9f9e-4e7a-88b4-7dc23123301d None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:33.836717 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1412c-9f9e-4e7a-88b4-7dc23123301d None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:33.837015 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1412c-9f9e-4e7a-88b4-7dc23123301d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:33.837998 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1412c-9f9e-4e7a-88b4-7dc23123301d None admin] RBAC: Adding query filter params (role.id=b137366eb53b42aab629a88be737eaf9, scope.project.id=0dfdd9951adb4668af803c2402e22b1f, user.id=b2c149f29a4c4fadbc2fea3a342465ad) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:33.838395 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1412c-9f9e-4e7a-88b4-7dc23123301d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:33.840189 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1412c-9f9e-4e7a-88b4-7dc23123301d None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:33.846741 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 563/1117] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Jun 27 09:16:33 2022] GET /identity/v3/role_assignments?user.id=b2c149f29a4c4fadbc2fea3a342465ad&scope.project.id=0dfdd9951adb4668af803c2402e22b1f&role.id=b137366eb53b42aab629a88be737eaf9 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:35.838355 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ae204-460d-4c78-9e82-43d6ff7428d5 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:35.838899 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ae204-460d-4c78-9e82-43d6ff7428d5 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:35.838899 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ae204-460d-4c78-9e82-43d6ff7428d5 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:35.840330 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 555/1118] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:16:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:16:35.848377 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2283b4a-2797-4951-9bb7-ee1a87ad8fae None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:35.848858 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2283b4a-2797-4951-9bb7-ee1a87ad8fae None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:35.848953 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2283b4a-2797-4951-9bb7-ee1a87ad8fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:35.866573 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-a2283b4a-2797-4951-9bb7-ee1a87ad8fae None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:16:35.867772 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-a2283b4a-2797-4951-9bb7-ee1a87ad8fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:16:35.934062 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 564/1119] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:16:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 09:16:35.957325 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ae204-460d-4c78-9e82-43d6ff7428d5 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:36.054039 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ae204-460d-4c78-9e82-43d6ff7428d5 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:36.086501 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9bc253-8fc2-477b-b66b-e4cc8e52e0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:36.087343 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bc253-8fc2-477b-b66b-e4cc8e52e0d5 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:36.087618 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bc253-8fc2-477b-b66b-e4cc8e52e0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:36.087887 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bc253-8fc2-477b-b66b-e4cc8e52e0d5 None admin] PATH_INFO: `/v3/roles/b137366eb53b42aab629a88be737eaf9` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:36.089424 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9bc253-8fc2-477b-b66b-e4cc8e52e0d5 None admin] RBAC: Authorizing `identity:get_role(role_id=b137366eb53b42aab629a88be737eaf9)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:36.090723 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9bc253-8fc2-477b-b66b-e4cc8e52e0d5 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:36.092082 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 556/1120] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Jun 27 09:16:35 2022] GET /identity/v3/roles/b137366eb53b42aab629a88be737eaf9 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:36.098833 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2283b4a-2797-4951-9bb7-ee1a87ad8fae None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:36.110684 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:36.210260 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2283b4a-2797-4951-9bb7-ee1a87ad8fae None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:36.243077 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a5418-c08b-466d-833e-99505c80136c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:36.243943 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a5418-c08b-466d-833e-99505c80136c None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:36.244244 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a5418-c08b-466d-833e-99505c80136c None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:36.244523 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a5418-c08b-466d-833e-99505c80136c None admin] PATH_INFO: `/v3/users/b2c149f29a4c4fadbc2fea3a342465ad` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:36.245710 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a5418-c08b-466d-833e-99505c80136c None admin] RBAC: Authorizing `identity:get_user(user_id=b2c149f29a4c4fadbc2fea3a342465ad)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:36.247139 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a5418-c08b-466d-833e-99505c80136c None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:36.248788 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 565/1121] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Jun 27 09:16:36 2022] GET /identity/v3/users/b2c149f29a4c4fadbc2fea3a342465ad => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:36.255306 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9bc253-8fc2-477b-b66b-e4cc8e52e0d5 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:36.296732 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:36.354549 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9bc253-8fc2-477b-b66b-e4cc8e52e0d5 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:36.387850 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb0957-a1dd-41c9-a378-15ec90274e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:36.388733 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb0957-a1dd-41c9-a378-15ec90274e63 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:36.389013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb0957-a1dd-41c9-a378-15ec90274e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:36.389288 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb0957-a1dd-41c9-a378-15ec90274e63 None admin] PATH_INFO: `/v3/projects/0dfdd9951adb4668af803c2402e22b1f` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:36.390484 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb0957-a1dd-41c9-a378-15ec90274e63 None admin] RBAC: Authorizing `identity:get_project(project_id=0dfdd9951adb4668af803c2402e22b1f)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:36.391955 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb0957-a1dd-41c9-a378-15ec90274e63 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:36.394312 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 557/1122] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:16:36 2022] GET /identity/v3/projects/0dfdd9951adb4668af803c2402e22b1f => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:36.400508 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a5418-c08b-466d-833e-99505c80136c None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:36.477870 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:36.499693 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a5418-c08b-466d-833e-99505c80136c None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:36.536041 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea87d914-e61a-409a-8804-aefed8dfd5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:36.537004 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87d914-e61a-409a-8804-aefed8dfd5de None admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:36.537290 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87d914-e61a-409a-8804-aefed8dfd5de None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:36.537568 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87d914-e61a-409a-8804-aefed8dfd5de None admin] PATH_INFO: `/v3/projects/0dfdd9951adb4668af803c2402e22b1f/users/b2c149f29a4c4fadbc2fea3a342465ad/roles/b137366eb53b42aab629a88be737eaf9` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:36.539796 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea87d914-e61a-409a-8804-aefed8dfd5de None admin] RBAC: Authorizing `identity:create_grant(project_id=0dfdd9951adb4668af803c2402e22b1f, user_id=b2c149f29a4c4fadbc2fea3a342465ad, role_id=b137366eb53b42aab629a88be737eaf9)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:36.541265 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea87d914-e61a-409a-8804-aefed8dfd5de None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:36.614593 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 566/1123] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Jun 27 09:16:36 2022] PUT /identity/v3/projects/0dfdd9951adb4668af803c2402e22b1f/users/b2c149f29a4c4fadbc2fea3a342465ad/roles/b137366eb53b42aab629a88be737eaf9 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:16:38.619482 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c73ade-8e38-4a14-89fc-45776156ece5 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:38.620046 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c73ade-8e38-4a14-89fc-45776156ece5 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:38.620046 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c73ade-8e38-4a14-89fc-45776156ece5 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:38.621432 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 558/1124] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:16:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:16:38.626942 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1451836-4e4e-4bae-8bed-ac8666beaae9 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:38.627348 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1451836-4e4e-4bae-8bed-ac8666beaae9 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:38.627493 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1451836-4e4e-4bae-8bed-ac8666beaae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:38.643838 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-a1451836-4e4e-4bae-8bed-ac8666beaae9 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:16:38.645062 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-a1451836-4e4e-4bae-8bed-ac8666beaae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:16:38.709398 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 567/1125] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:16:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 09:16:38.733549 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c73ade-8e38-4a14-89fc-45776156ece5 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:38.832336 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c73ade-8e38-4a14-89fc-45776156ece5 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:38.841205 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:38.865394 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe85426-d486-49ef-b0cc-368c25731473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:38.866237 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe85426-d486-49ef-b0cc-368c25731473 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:38.866512 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe85426-d486-49ef-b0cc-368c25731473 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:38.866781 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe85426-d486-49ef-b0cc-368c25731473 None admin] PATH_INFO: `/v3/roles/b137366eb53b42aab629a88be737eaf9` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:38.868281 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe85426-d486-49ef-b0cc-368c25731473 None admin] RBAC: Authorizing `identity:get_role(role_id=b137366eb53b42aab629a88be737eaf9)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:38.869702 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe85426-d486-49ef-b0cc-368c25731473 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:38.871028 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 559/1126] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Jun 27 09:16:38 2022] GET /identity/v3/roles/b137366eb53b42aab629a88be737eaf9 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:38.876904 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1451836-4e4e-4bae-8bed-ac8666beaae9 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:38.940459 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:38.973840 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1451836-4e4e-4bae-8bed-ac8666beaae9 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:39.006398 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d721e-7b34-424c-a157-91141057da27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:39.007258 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d721e-7b34-424c-a157-91141057da27 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:39.007538 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d721e-7b34-424c-a157-91141057da27 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:39.007811 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d721e-7b34-424c-a157-91141057da27 None admin] PATH_INFO: `/v3/users/b2c149f29a4c4fadbc2fea3a342465ad` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:39.009031 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d721e-7b34-424c-a157-91141057da27 None admin] RBAC: Authorizing `identity:get_user(user_id=b2c149f29a4c4fadbc2fea3a342465ad)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:39.010460 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d721e-7b34-424c-a157-91141057da27 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:39.012085 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 568/1127] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Jun 27 09:16:38 2022] GET /identity/v3/users/b2c149f29a4c4fadbc2fea3a342465ad => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:39.018478 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe85426-d486-49ef-b0cc-368c25731473 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:39.115808 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe85426-d486-49ef-b0cc-368c25731473 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:39.149145 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d3f19-c487-4fd2-9fb3-ba0b3f847fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:39.149975 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d3f19-c487-4fd2-9fb3-ba0b3f847fac None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:39.150255 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d3f19-c487-4fd2-9fb3-ba0b3f847fac None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:39.150526 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d3f19-c487-4fd2-9fb3-ba0b3f847fac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:39.194974 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:39.217009 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d3f19-c487-4fd2-9fb3-ba0b3f847fac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:39.218455 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d3f19-c487-4fd2-9fb3-ba0b3f847fac None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:39.313334 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 560/1128] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:16:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 09:16:39.319824 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d721e-7b34-424c-a157-91141057da27 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:39.414831 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d721e-7b34-424c-a157-91141057da27 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:39.447816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeba70e-53c5-4834-89e3-a9fa624a2b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:39.448681 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeba70e-53c5-4834-89e3-a9fa624a2b81 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:39.448960 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeba70e-53c5-4834-89e3-a9fa624a2b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:39.449229 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeba70e-53c5-4834-89e3-a9fa624a2b81 None admin] PATH_INFO: `/v3/projects/0dfdd9951adb4668af803c2402e22b1f` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:39.450388 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeba70e-53c5-4834-89e3-a9fa624a2b81 None admin] RBAC: Authorizing `identity:get_project(project_id=0dfdd9951adb4668af803c2402e22b1f)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:39.451800 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeba70e-53c5-4834-89e3-a9fa624a2b81 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:39.453487 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 569/1129] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:16:39 2022] GET /identity/v3/projects/0dfdd9951adb4668af803c2402e22b1f => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:39.460219 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d3f19-c487-4fd2-9fb3-ba0b3f847fac None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:39.535373 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:39.557339 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d3f19-c487-4fd2-9fb3-ba0b3f847fac None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:39.590814 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e6b07a-6ab7-4f29-b4f0-301d57ae522e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:39.591448 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6b07a-6ab7-4f29-b4f0-301d57ae522e None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:39.591727 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6b07a-6ab7-4f29-b4f0-301d57ae522e None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:39.592000 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6b07a-6ab7-4f29-b4f0-301d57ae522e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:39.592849 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e6b07a-6ab7-4f29-b4f0-301d57ae522e None admin] RBAC: Adding query filter params (role.id=b137366eb53b42aab629a88be737eaf9, scope.project.id=0dfdd9951adb4668af803c2402e22b1f, user.id=b2c149f29a4c4fadbc2fea3a342465ad) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:39.593162 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e6b07a-6ab7-4f29-b4f0-301d57ae522e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:39.594578 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e6b07a-6ab7-4f29-b4f0-301d57ae522e None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:39.600262 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 561/1130] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Jun 27 09:16:39 2022] GET /identity/v3/role_assignments?user.id=b2c149f29a4c4fadbc2fea3a342465ad&scope.project.id=0dfdd9951adb4668af803c2402e22b1f&role.id=b137366eb53b42aab629a88be737eaf9 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:41.628801 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f720f-77ae-44b2-aeea-5bc376becf6f None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:41.629368 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f720f-77ae-44b2-aeea-5bc376becf6f None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:41.629368 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f720f-77ae-44b2-aeea-5bc376becf6f None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:41.630707 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 570/1131] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:16:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:16:41.636038 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a3e81-2c13-422e-8aa1-0e4ef9a02229 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:41.636499 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a3e81-2c13-422e-8aa1-0e4ef9a02229 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:41.636616 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a3e81-2c13-422e-8aa1-0e4ef9a02229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:41.653673 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-fa5a3e81-2c13-422e-8aa1-0e4ef9a02229 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:16:41.654835 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-fa5a3e81-2c13-422e-8aa1-0e4ef9a02229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:16:41.719661 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 562/1132] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:16:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 09:16:41.743248 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f720f-77ae-44b2-aeea-5bc376becf6f None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:41.747284 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:41.849040 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f720f-77ae-44b2-aeea-5bc376becf6f None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:41.882492 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66ec55-8802-4335-a62d-57ee9e0d3a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:41.883200 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66ec55-8802-4335-a62d-57ee9e0d3a44 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:41.883478 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66ec55-8802-4335-a62d-57ee9e0d3a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:41.883748 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66ec55-8802-4335-a62d-57ee9e0d3a44 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:41.884926 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd66ec55-8802-4335-a62d-57ee9e0d3a44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:41.886344 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd66ec55-8802-4335-a62d-57ee9e0d3a44 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:41.887952 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 571/1133] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:16:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:41.893913 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a3e81-2c13-422e-8aa1-0e4ef9a02229 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:41.959936 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:41.988889 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a3e81-2c13-422e-8aa1-0e4ef9a02229 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:42.022037 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c71f6-15fd-45e2-afde-61e166fba89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:42.022684 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c71f6-15fd-45e2-afde-61e166fba89a None admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:42.022966 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c71f6-15fd-45e2-afde-61e166fba89a None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:42.023239 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c71f6-15fd-45e2-afde-61e166fba89a None admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:42.023948 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851c71f6-15fd-45e2-afde-61e166fba89a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:42.025675 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851c71f6-15fd-45e2-afde-61e166fba89a None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:42.114282 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 563/1134] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Jun 27 09:16:41 2022] POST /identity/v3/projects => generated 311 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:16:44.153941 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba02afb-a546-45ae-930d-059d94f1bc70 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:44.154412 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba02afb-a546-45ae-930d-059d94f1bc70 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:44.154523 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba02afb-a546-45ae-930d-059d94f1bc70 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:44.155859 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 572/1135] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:16:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:16:44.161281 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e2f4d-ef6c-4bf1-91ff-22e2468edc5e None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:44.161703 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e2f4d-ef6c-4bf1-91ff-22e2468edc5e None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:44.161845 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e2f4d-ef6c-4bf1-91ff-22e2468edc5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:44.178840 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-e98e2f4d-ef6c-4bf1-91ff-22e2468edc5e None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:16:44.180024 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-e98e2f4d-ef6c-4bf1-91ff-22e2468edc5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:16:44.245020 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 564/1136] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:16:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 09:16:44.270050 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba02afb-a546-45ae-930d-059d94f1bc70 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:44.342313 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:44.371865 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba02afb-a546-45ae-930d-059d94f1bc70 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:44.405657 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1201b2-feba-4ec3-8b79-f6be3f6840d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:44.406431 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1201b2-feba-4ec3-8b79-f6be3f6840d5 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:44.406705 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1201b2-feba-4ec3-8b79-f6be3f6840d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:44.406972 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1201b2-feba-4ec3-8b79-f6be3f6840d5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:44.408665 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1201b2-feba-4ec3-8b79-f6be3f6840d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:44.410080 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1201b2-feba-4ec3-8b79-f6be3f6840d5 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:44.411690 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 573/1137] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:16:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:44.417506 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e2f4d-ef6c-4bf1-91ff-22e2468edc5e None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:44.468445 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:44.512811 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e2f4d-ef6c-4bf1-91ff-22e2468edc5e None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:44.547198 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5720cf7-1157-4f77-af07-cf9b736a3cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:44.547841 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5720cf7-1157-4f77-af07-cf9b736a3cd7 None admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:44.548119 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5720cf7-1157-4f77-af07-cf9b736a3cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:44.548966 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5720cf7-1157-4f77-af07-cf9b736a3cd7 None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:44.549672 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5720cf7-1157-4f77-af07-cf9b736a3cd7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:44.551076 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5720cf7-1157-4f77-af07-cf9b736a3cd7 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:44.637014 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 565/1138] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Jun 27 09:16:44 2022] POST /identity/v3/users => generated 286 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:16:46.749285 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4b6dd-2106-48fa-9482-469cfd02f0a8 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:46.749822 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4b6dd-2106-48fa-9482-469cfd02f0a8 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:46.749822 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4b6dd-2106-48fa-9482-469cfd02f0a8 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:46.751965 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 574/1139] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:16:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:16:46.760880 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45493653-8322-4d67-8cea-398da085570c None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:46.761336 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45493653-8322-4d67-8cea-398da085570c None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:46.761439 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45493653-8322-4d67-8cea-398da085570c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:46.778777 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-45493653-8322-4d67-8cea-398da085570c None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:16:46.779954 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-45493653-8322-4d67-8cea-398da085570c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:16:46.857997 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 566/1140] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:16:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 09:16:46.885269 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4b6dd-2106-48fa-9482-469cfd02f0a8 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:46.995457 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4b6dd-2106-48fa-9482-469cfd02f0a8 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:47.032852 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9c51d-fdce-4a79-bb73-331f8f440010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:47.033644 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9c51d-fdce-4a79-bb73-331f8f440010 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:47.033923 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9c51d-fdce-4a79-bb73-331f8f440010 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:47.034196 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9c51d-fdce-4a79-bb73-331f8f440010 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:47.041852 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:47.044803 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e9c51d-fdce-4a79-bb73-331f8f440010 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:16:47.058555 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-c7e9c51d-fdce-4a79-bb73-331f8f440010 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:16:47.058555 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:47.058555 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:16:47.058555 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:16:47.058555 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:16:47.058555 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:16:47.058555 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:16:47.058555 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:16:47.058555 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:16:47.058555 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:16:47.058555 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:16:47.058555 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:16:47.058555 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:16:47.058555 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:16:47.058555 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:16:47.058555 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:16:47.063078 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:16:47.063078 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:16:47.063078 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:16:47.063078 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:16:47.063078 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:16:47.063078 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:16:47.063078 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:16:47.063078 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:16:47.063078 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:16:47.063078 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:16:47.063078 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:16:47.063078 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:16:47.063078 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:16:47.063078 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:16:47.063078 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:16:47.063078 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:16:47.064159 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:16:47.064159 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:16:47.064159 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:16:47.064159 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:16:47.064159 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:16:47.064159 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:16:47.064159 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:16:47.064159 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:16:47.064159 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:16:47.064159 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:16:47.064159 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:16:47.064159 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:16:47.064159 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 575/1141] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Jun 27 09:16:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:16:47.067066 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45493653-8322-4d67-8cea-398da085570c None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:47.107715 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:47.171039 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45493653-8322-4d67-8cea-398da085570c None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:47.205833 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939c8d7f-de9d-450a-81e9-f9c0a4833e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:47.206486 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c8d7f-de9d-450a-81e9-f9c0a4833e9c None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:47.206762 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c8d7f-de9d-450a-81e9-f9c0a4833e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:47.207150 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c8d7f-de9d-450a-81e9-f9c0a4833e9c None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:47.207884 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939c8d7f-de9d-450a-81e9-f9c0a4833e9c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:47.208184 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939c8d7f-de9d-450a-81e9-f9c0a4833e9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:47.209578 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939c8d7f-de9d-450a-81e9-f9c0a4833e9c None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:47.217829 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 567/1142] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:16:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:47.223725 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9c51d-fdce-4a79-bb73-331f8f440010 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:47.329851 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9c51d-fdce-4a79-bb73-331f8f440010 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:47.363649 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29cbec-3e9d-4cd0-9d49-997e9ca8329a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:47.364543 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29cbec-3e9d-4cd0-9d49-997e9ca8329a None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:47.364822 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29cbec-3e9d-4cd0-9d49-997e9ca8329a None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:47.365091 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29cbec-3e9d-4cd0-9d49-997e9ca8329a None admin] PATH_INFO: `/v3/users/eb93f87d27d64278906eb4d8bdaa2145` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:47.378731 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a29cbec-3e9d-4cd0-9d49-997e9ca8329a None admin] RBAC: Authorizing `identity:get_user(user_id=eb93f87d27d64278906eb4d8bdaa2145)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:47.380157 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a29cbec-3e9d-4cd0-9d49-997e9ca8329a None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:47.381820 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 576/1143] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Jun 27 09:16:47 2022] GET /identity/v3/users/eb93f87d27d64278906eb4d8bdaa2145 => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:47.387715 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939c8d7f-de9d-450a-81e9-f9c0a4833e9c None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:47.482157 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:47.485027 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939c8d7f-de9d-450a-81e9-f9c0a4833e9c None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:47.517588 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894f346-a428-4670-8e0f-a5d0665184aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:47.518218 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894f346-a428-4670-8e0f-a5d0665184aa None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:47.518497 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894f346-a428-4670-8e0f-a5d0665184aa None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:47.518769 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894f346-a428-4670-8e0f-a5d0665184aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:47.583880 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b894f346-a428-4670-8e0f-a5d0665184aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:47.585267 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b894f346-a428-4670-8e0f-a5d0665184aa None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:47.677256 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:47.680816 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 568/1144] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:16:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 09:16:47.686871 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29cbec-3e9d-4cd0-9d49-997e9ca8329a None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:47.744240 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:47.790915 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29cbec-3e9d-4cd0-9d49-997e9ca8329a None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:47.823096 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be999d63-4a8f-4c05-887b-0c58b2bcba44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:47.823936 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be999d63-4a8f-4c05-887b-0c58b2bcba44 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:47.824234 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be999d63-4a8f-4c05-887b-0c58b2bcba44 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:47.824512 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be999d63-4a8f-4c05-887b-0c58b2bcba44 None admin] PATH_INFO: `/v3/projects/b5e65bfedfef4444b3cea7b7a58d6031` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:47.825667 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be999d63-4a8f-4c05-887b-0c58b2bcba44 None admin] RBAC: Authorizing `identity:get_project(project_id=b5e65bfedfef4444b3cea7b7a58d6031)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:47.827090 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be999d63-4a8f-4c05-887b-0c58b2bcba44 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:47.828803 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 577/1145] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:16:47 2022] GET /identity/v3/projects/b5e65bfedfef4444b3cea7b7a58d6031 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:47.835387 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894f346-a428-4670-8e0f-a5d0665184aa None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:47.932143 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894f346-a428-4670-8e0f-a5d0665184aa None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:47.968148 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877f383-e42d-4ef0-9329-e7257e9b8cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:47.968827 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877f383-e42d-4ef0-9329-e7257e9b8cac None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:47.969109 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877f383-e42d-4ef0-9329-e7257e9b8cac None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:47.969385 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877f383-e42d-4ef0-9329-e7257e9b8cac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:47.970746 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877f383-e42d-4ef0-9329-e7257e9b8cac None admin] RBAC: Adding query filter params (role.id=91c77942515d45f1ad8189c9fddf4424, scope.project.id=b5e65bfedfef4444b3cea7b7a58d6031, user.id=eb93f87d27d64278906eb4d8bdaa2145) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:47.971066 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877f383-e42d-4ef0-9329-e7257e9b8cac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:47.972522 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877f383-e42d-4ef0-9329-e7257e9b8cac None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:47.978007 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 569/1146] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Jun 27 09:16:47 2022] GET /identity/v3/role_assignments?user.id=eb93f87d27d64278906eb4d8bdaa2145&scope.project.id=b5e65bfedfef4444b3cea7b7a58d6031&role.id=91c77942515d45f1ad8189c9fddf4424 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:49.972873 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befaf533-ca0d-44cc-ae71-32b29f7f6821 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:49.973406 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befaf533-ca0d-44cc-ae71-32b29f7f6821 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:49.973406 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befaf533-ca0d-44cc-ae71-32b29f7f6821 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:49.974770 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 578/1147] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:16:49.980221 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d2411-0ad8-4e65-b37d-38e4792d836c None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:49.980645 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d2411-0ad8-4e65-b37d-38e4792d836c None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:49.980799 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d2411-0ad8-4e65-b37d-38e4792d836c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:49.997103 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-d03d2411-0ad8-4e65-b37d-38e4792d836c None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:16:49.998278 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-d03d2411-0ad8-4e65-b37d-38e4792d836c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:16:50.055715 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:50.064433 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 570/1148] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:16:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 09:16:50.087433 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befaf533-ca0d-44cc-ae71-32b29f7f6821 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:50.188283 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befaf533-ca0d-44cc-ae71-32b29f7f6821 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:50.213626 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:50.222538 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6047e-fcaf-47dd-8616-b9d33fbfb795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:50.223412 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6047e-fcaf-47dd-8616-b9d33fbfb795 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:50.223671 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6047e-fcaf-47dd-8616-b9d33fbfb795 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:50.223943 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6047e-fcaf-47dd-8616-b9d33fbfb795 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:50.233894 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6047e-fcaf-47dd-8616-b9d33fbfb795 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:16:50.242113 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-3db6047e-fcaf-47dd-8616-b9d33fbfb795 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:16:50.242113 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:50.242113 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:16:50.242113 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:16:50.242113 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:16:50.242113 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:16:50.242113 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:16:50.242113 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:16:50.242113 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:16:50.242113 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:16:50.242113 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:16:50.242113 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:16:50.242113 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:16:50.242113 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:16:50.242113 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:16:50.242113 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:16:50.243215 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:16:50.243215 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:16:50.243215 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:16:50.243215 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:16:50.243215 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:16:50.243215 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:16:50.243215 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:16:50.243215 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:16:50.243215 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:16:50.243215 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:16:50.243215 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:16:50.243215 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:16:50.243215 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:16:50.243215 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:16:50.243215 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:16:50.243215 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:16:50.244144 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:16:50.244144 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:16:50.244144 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:16:50.244144 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:16:50.244144 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:16:50.244144 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:16:50.244144 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:16:50.244144 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:16:50.244144 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:16:50.244144 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:16:50.244144 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:16:50.244144 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:16:50.244144 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 579/1149] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Jun 27 09:16:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:16:50.249874 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d2411-0ad8-4e65-b37d-38e4792d836c None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:50.345789 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d2411-0ad8-4e65-b37d-38e4792d836c None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:50.377528 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae80889-5b81-4504-904d-9f2c8588e2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:50.378253 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae80889-5b81-4504-904d-9f2c8588e2b4 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:50.378462 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae80889-5b81-4504-904d-9f2c8588e2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:50.378718 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae80889-5b81-4504-904d-9f2c8588e2b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:50.379449 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae80889-5b81-4504-904d-9f2c8588e2b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:50.379748 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae80889-5b81-4504-904d-9f2c8588e2b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:50.381115 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae80889-5b81-4504-904d-9f2c8588e2b4 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:50.388864 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 571/1150] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:16:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:50.395282 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6047e-fcaf-47dd-8616-b9d33fbfb795 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:50.493442 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6047e-fcaf-47dd-8616-b9d33fbfb795 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:50.527292 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d5a1f-be04-4eaa-9a98-477a561f51c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:50.528157 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d5a1f-be04-4eaa-9a98-477a561f51c5 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:50.528464 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d5a1f-be04-4eaa-9a98-477a561f51c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:50.528737 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d5a1f-be04-4eaa-9a98-477a561f51c5 None admin] PATH_INFO: `/v3/users/eb93f87d27d64278906eb4d8bdaa2145` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:50.529910 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d5a1f-be04-4eaa-9a98-477a561f51c5 None admin] RBAC: Authorizing `identity:get_user(user_id=eb93f87d27d64278906eb4d8bdaa2145)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:50.531379 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d5a1f-be04-4eaa-9a98-477a561f51c5 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:50.533621 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 580/1151] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Jun 27 09:16:50 2022] GET /identity/v3/users/eb93f87d27d64278906eb4d8bdaa2145 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:50.539498 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae80889-5b81-4504-904d-9f2c8588e2b4 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:50.595322 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:50.637997 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae80889-5b81-4504-904d-9f2c8588e2b4 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:50.670600 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd04ae6-dbb2-48f6-9514-d4fb0b6e489f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:50.671447 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd04ae6-dbb2-48f6-9514-d4fb0b6e489f None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:50.671730 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd04ae6-dbb2-48f6-9514-d4fb0b6e489f None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:50.672006 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd04ae6-dbb2-48f6-9514-d4fb0b6e489f None admin] PATH_INFO: `/v3/projects/b5e65bfedfef4444b3cea7b7a58d6031` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:50.673234 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd04ae6-dbb2-48f6-9514-d4fb0b6e489f None admin] RBAC: Authorizing `identity:get_project(project_id=b5e65bfedfef4444b3cea7b7a58d6031)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:50.674667 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd04ae6-dbb2-48f6-9514-d4fb0b6e489f None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:50.676440 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 572/1152] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:16:50 2022] GET /identity/v3/projects/b5e65bfedfef4444b3cea7b7a58d6031 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:50.682455 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d5a1f-be04-4eaa-9a98-477a561f51c5 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:50.736613 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:50.778489 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d5a1f-be04-4eaa-9a98-477a561f51c5 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:50.812322 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91fabc-22af-4f2a-9749-a5832f95a7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:50.813209 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91fabc-22af-4f2a-9749-a5832f95a7fa None admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:50.813495 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91fabc-22af-4f2a-9749-a5832f95a7fa None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:50.813770 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91fabc-22af-4f2a-9749-a5832f95a7fa None admin] PATH_INFO: `/v3/projects/b5e65bfedfef4444b3cea7b7a58d6031/users/eb93f87d27d64278906eb4d8bdaa2145/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:50.815718 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c91fabc-22af-4f2a-9749-a5832f95a7fa None admin] RBAC: Authorizing `identity:create_grant(project_id=b5e65bfedfef4444b3cea7b7a58d6031, user_id=eb93f87d27d64278906eb4d8bdaa2145, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:50.817187 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c91fabc-22af-4f2a-9749-a5832f95a7fa None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:50.904812 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 581/1153] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Jun 27 09:16:50 2022] PUT /identity/v3/projects/b5e65bfedfef4444b3cea7b7a58d6031/users/eb93f87d27d64278906eb4d8bdaa2145/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:16:52.932046 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfce4e-7c0b-42e8-9779-cd63419f7b2e None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:52.932624 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfce4e-7c0b-42e8-9779-cd63419f7b2e None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:52.932624 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfce4e-7c0b-42e8-9779-cd63419f7b2e None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:52.933989 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 573/1154] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:16:52.939735 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84eb336-3e3a-48a4-bad3-c2c4064d948d None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:52.940132 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84eb336-3e3a-48a4-bad3-c2c4064d948d None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:52.940337 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84eb336-3e3a-48a4-bad3-c2c4064d948d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:52.957398 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-e84eb336-3e3a-48a4-bad3-c2c4064d948d None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:16:52.958552 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-e84eb336-3e3a-48a4-bad3-c2c4064d948d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:16:53.023712 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 582/1155] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:16:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 09:16:53.046930 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcfce4e-7c0b-42e8-9779-cd63419f7b2e None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:53.149259 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcfce4e-7c0b-42e8-9779-cd63419f7b2e None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:53.171782 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:53.192634 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5951e5a-45a1-4dd7-8557-6e21e4479bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:53.192634 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5951e5a-45a1-4dd7-8557-6e21e4479bda None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:53.192634 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5951e5a-45a1-4dd7-8557-6e21e4479bda None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:53.192634 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5951e5a-45a1-4dd7-8557-6e21e4479bda None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:53.194109 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5951e5a-45a1-4dd7-8557-6e21e4479bda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:16:53.201714 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-b5951e5a-45a1-4dd7-8557-6e21e4479bda None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:16:53.201714 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:53.201714 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:16:53.201714 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:16:53.201714 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:16:53.201714 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:16:53.201714 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:16:53.201714 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:16:53.201714 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:16:53.201714 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:16:53.201714 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:16:53.201714 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:16:53.201714 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:16:53.201714 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:16:53.201714 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:16:53.201714 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:16:53.202805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:16:53.202805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:16:53.202805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:16:53.202805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:16:53.202805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:16:53.202805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:16:53.202805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:16:53.202805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:16:53.202805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:16:53.202805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:16:53.202805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:16:53.202805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:16:53.202805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:16:53.202805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:16:53.202805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:16:53.202805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:16:53.203926 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:16:53.203926 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:16:53.203926 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:16:53.203926 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:16:53.203926 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:16:53.203926 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:16:53.203926 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:16:53.203926 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:16:53.203926 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:16:53.203926 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:16:53.203926 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:16:53.203926 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:16:53.203926 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 574/1156] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Jun 27 09:16:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:16:53.209030 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84eb336-3e3a-48a4-bad3-c2c4064d948d None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:53.253349 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:53.307419 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84eb336-3e3a-48a4-bad3-c2c4064d948d None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:53.340441 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbda944-2654-444f-8d06-2109da4039cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:53.341106 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbda944-2654-444f-8d06-2109da4039cb None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:53.341417 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbda944-2654-444f-8d06-2109da4039cb None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:53.341660 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbda944-2654-444f-8d06-2109da4039cb None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:53.342404 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbda944-2654-444f-8d06-2109da4039cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:53.342706 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbda944-2654-444f-8d06-2109da4039cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:53.344067 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbda944-2654-444f-8d06-2109da4039cb None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:53.351946 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 583/1157] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:16:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:53.357736 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5951e5a-45a1-4dd7-8557-6e21e4479bda None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:53.456766 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5951e5a-45a1-4dd7-8557-6e21e4479bda None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:53.492010 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc2a61-e2bd-48cc-a266-d3cee9ea9fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:53.497512 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc2a61-e2bd-48cc-a266-d3cee9ea9fdd None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:53.497512 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc2a61-e2bd-48cc-a266-d3cee9ea9fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:53.497512 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc2a61-e2bd-48cc-a266-d3cee9ea9fdd None admin] PATH_INFO: `/v3/users/eb93f87d27d64278906eb4d8bdaa2145` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:53.497512 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccc2a61-e2bd-48cc-a266-d3cee9ea9fdd None admin] RBAC: Authorizing `identity:get_user(user_id=eb93f87d27d64278906eb4d8bdaa2145)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:53.497512 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccc2a61-e2bd-48cc-a266-d3cee9ea9fdd None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:53.497918 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 575/1158] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Jun 27 09:16:53 2022] GET /identity/v3/users/eb93f87d27d64278906eb4d8bdaa2145 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:53.503681 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbda944-2654-444f-8d06-2109da4039cb None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:53.600449 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbda944-2654-444f-8d06-2109da4039cb None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:53.607299 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:53.633366 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4aeb61-e31d-4304-a41c-40a63b6e30a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:53.633997 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4aeb61-e31d-4304-a41c-40a63b6e30a4 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:53.634277 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4aeb61-e31d-4304-a41c-40a63b6e30a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:53.634544 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4aeb61-e31d-4304-a41c-40a63b6e30a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:53.699522 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4aeb61-e31d-4304-a41c-40a63b6e30a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:53.700987 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4aeb61-e31d-4304-a41c-40a63b6e30a4 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:53.794289 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 584/1159] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:16:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 09:16:53.800271 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc2a61-e2bd-48cc-a266-d3cee9ea9fdd None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:53.864391 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:53.911414 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc2a61-e2bd-48cc-a266-d3cee9ea9fdd None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:53.943378 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a78138-706d-4239-b86b-09f4813cbffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:53.944242 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a78138-706d-4239-b86b-09f4813cbffc None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:53.944523 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a78138-706d-4239-b86b-09f4813cbffc None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:53.944792 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a78138-706d-4239-b86b-09f4813cbffc None admin] PATH_INFO: `/v3/projects/b5e65bfedfef4444b3cea7b7a58d6031` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:53.945956 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a78138-706d-4239-b86b-09f4813cbffc None admin] RBAC: Authorizing `identity:get_project(project_id=b5e65bfedfef4444b3cea7b7a58d6031)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:53.947379 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a78138-706d-4239-b86b-09f4813cbffc None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:53.949085 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 576/1160] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:16:53 2022] GET /identity/v3/projects/b5e65bfedfef4444b3cea7b7a58d6031 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:53.955742 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4aeb61-e31d-4304-a41c-40a63b6e30a4 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:53.963796 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:54.052189 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4aeb61-e31d-4304-a41c-40a63b6e30a4 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:54.085031 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9c880-c0db-4933-a2c5-204534d7be5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:54.085667 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9c880-c0db-4933-a2c5-204534d7be5b None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:54.085947 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9c880-c0db-4933-a2c5-204534d7be5b None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:54.086217 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9c880-c0db-4933-a2c5-204534d7be5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:54.087037 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b9c880-c0db-4933-a2c5-204534d7be5b None admin] RBAC: Adding query filter params (role.id=91c77942515d45f1ad8189c9fddf4424, scope.project.id=b5e65bfedfef4444b3cea7b7a58d6031, user.id=eb93f87d27d64278906eb4d8bdaa2145) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:54.087343 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b9c880-c0db-4933-a2c5-204534d7be5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:54.088790 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b9c880-c0db-4933-a2c5-204534d7be5b None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:54.094517 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 585/1161] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Jun 27 09:16:53 2022] GET /identity/v3/role_assignments?user.id=eb93f87d27d64278906eb4d8bdaa2145&scope.project.id=b5e65bfedfef4444b3cea7b7a58d6031&role.id=91c77942515d45f1ad8189c9fddf4424 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:56.143110 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137c877-60b2-4d70-9788-2ace4b3bccbd None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:56.143660 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137c877-60b2-4d70-9788-2ace4b3bccbd None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:56.143660 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137c877-60b2-4d70-9788-2ace4b3bccbd None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:56.145062 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 577/1162] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:16:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:16:56.150523 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda15378-0928-451d-a1ea-4b473091db43 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:56.150943 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda15378-0928-451d-a1ea-4b473091db43 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:56.151067 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda15378-0928-451d-a1ea-4b473091db43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:56.167351 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-dda15378-0928-451d-a1ea-4b473091db43 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:16:56.168553 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-dda15378-0928-451d-a1ea-4b473091db43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:16:56.229949 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:56.234347 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 586/1163] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:16:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 09:16:56.257289 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9137c877-60b2-4d70-9788-2ace4b3bccbd None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:56.359433 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9137c877-60b2-4d70-9788-2ace4b3bccbd None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:56.380451 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:56.393863 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29121d-fb5f-4011-b577-8d68e78db2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:56.395796 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29121d-fb5f-4011-b577-8d68e78db2e0 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:56.395796 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29121d-fb5f-4011-b577-8d68e78db2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:56.395796 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29121d-fb5f-4011-b577-8d68e78db2e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:56.463404 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c29121d-fb5f-4011-b577-8d68e78db2e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:56.464940 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c29121d-fb5f-4011-b577-8d68e78db2e0 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:56.563241 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 578/1164] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:16:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 09:16:56.569372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda15378-0928-451d-a1ea-4b473091db43 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:56.665162 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda15378-0928-451d-a1ea-4b473091db43 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:56.698537 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9bbc0b-a3b3-405f-8d51-accc7faaa410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:56.699318 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9bbc0b-a3b3-405f-8d51-accc7faaa410 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:56.699597 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9bbc0b-a3b3-405f-8d51-accc7faaa410 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:56.699870 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9bbc0b-a3b3-405f-8d51-accc7faaa410 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:56.706440 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9bbc0b-a3b3-405f-8d51-accc7faaa410 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:56.707861 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9bbc0b-a3b3-405f-8d51-accc7faaa410 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:56.722176 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-7e9bbc0b-a3b3-405f-8d51-accc7faaa410 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 27 09:16:56.722176 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:56.722176 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 27 09:16:56.722176 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 27 09:16:56.722176 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 09:16:56.722176 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 09:16:56.722176 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 09:16:56.722176 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 09:16:56.722176 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 27 09:16:56.722176 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:16:56.722176 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 09:16:56.722176 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:16:56.722176 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:16:56.722176 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:16:56.722176 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:16:56.722176 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:16:56.722176 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:16:56.723264 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:16:56.723264 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:16:56.723264 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:16:56.723264 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:16:56.723264 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:16:56.723264 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:16:56.723264 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:16:56.723264 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:16:56.723264 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:16:56.723264 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:16:56.723264 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:16:56.723264 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:16:56.723264 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:16:56.723264 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:16:56.723264 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:16:56.723264 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:16:56.724267 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:16:56.724267 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:16:56.724267 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:16:56.724267 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:16:56.724267 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:16:56.724267 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:16:56.724267 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:16:56.724267 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:16:56.724267 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:16:56.724267 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:16:56.724267 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 27 09:16:56.724267 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:16:56.724267 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 27 09:16:56.724267 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:16:56.724267 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 587/1165] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Jun 27 09:16:56 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:16:56.729493 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29121d-fb5f-4011-b577-8d68e78db2e0 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:56.750799 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:56.827022 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29121d-fb5f-4011-b577-8d68e78db2e0 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:56.859148 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76462f-42d6-4a77-a0c8-f8a69f6b308c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:56.859789 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76462f-42d6-4a77-a0c8-f8a69f6b308c None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:56.860067 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76462f-42d6-4a77-a0c8-f8a69f6b308c None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:56.860891 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76462f-42d6-4a77-a0c8-f8a69f6b308c None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:56.861596 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed76462f-42d6-4a77-a0c8-f8a69f6b308c None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:16:56.861896 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed76462f-42d6-4a77-a0c8-f8a69f6b308c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:56.863248 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed76462f-42d6-4a77-a0c8-f8a69f6b308c None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:56.870262 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 579/1166] 10.222.0.62 () {56 vars in 1115 bytes} [Mon Jun 27 09:16:56 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:16:58.877106 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d41cfd-3471-47cb-a80a-21beac000cc5 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:58.877657 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d41cfd-3471-47cb-a80a-21beac000cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:58.877657 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d41cfd-3471-47cb-a80a-21beac000cc5 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:58.879039 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 588/1167] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:16:58.884141 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bf4e3-9a82-447d-a5b4-9d1538e0cfb2 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:58.884583 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bf4e3-9a82-447d-a5b4-9d1538e0cfb2 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:58.884717 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bf4e3-9a82-447d-a5b4-9d1538e0cfb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:58.901190 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-707bf4e3-9a82-447d-a5b4-9d1538e0cfb2 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:16:58.902353 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-707bf4e3-9a82-447d-a5b4-9d1538e0cfb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:16:58.965619 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 580/1168] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:16:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 09:16:58.989656 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d41cfd-3471-47cb-a80a-21beac000cc5 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:16:59.048670 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:16:59.089184 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d41cfd-3471-47cb-a80a-21beac000cc5 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:16:59.122906 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344a794-d95b-4645-b568-acbe725f2c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:16:59.123566 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344a794-d95b-4645-b568-acbe725f2c2b None admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:16:59.123850 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344a794-d95b-4645-b568-acbe725f2c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:16:59.124127 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344a794-d95b-4645-b568-acbe725f2c2b None admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:16:59.124915 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e344a794-d95b-4645-b568-acbe725f2c2b None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:16:59.126340 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e344a794-d95b-4645-b568-acbe725f2c2b None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:16:59.209695 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 589/1169] 10.222.0.62 () {60 vars in 1138 bytes} [Mon Jun 27 09:16:58 2022] POST /identity/v3/domains => generated 267 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:17:01.235968 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a86774-873c-4d89-978a-f174c3161ec6 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:17:01.236561 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a86774-873c-4d89-978a-f174c3161ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:17:01.236561 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a86774-873c-4d89-978a-f174c3161ec6 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:17:01.237930 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 581/1170] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:17:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:17:01.243185 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d770518-7928-48e2-a14d-dd610962f846 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:17:01.243651 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d770518-7928-48e2-a14d-dd610962f846 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:17:01.243753 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d770518-7928-48e2-a14d-dd610962f846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:17:01.260334 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-7d770518-7928-48e2-a14d-dd610962f846 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:17:01.261517 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-7d770518-7928-48e2-a14d-dd610962f846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:17:01.326756 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 590/1171] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:17:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 09:17:01.351489 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a86774-873c-4d89-978a-f174c3161ec6 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:17:01.367016 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:17:01.450928 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a86774-873c-4d89-978a-f174c3161ec6 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:17:01.483618 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5748b1f5-a5f9-45b4-bfa5-903d84b5a22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:17:01.484492 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748b1f5-a5f9-45b4-bfa5-903d84b5a22c None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:17:01.484768 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748b1f5-a5f9-45b4-bfa5-903d84b5a22c None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:17:01.485053 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748b1f5-a5f9-45b4-bfa5-903d84b5a22c None admin] PATH_INFO: `/v3/domains/990d513849474300bbce52c3101fe52c` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:17:01.495049 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5748b1f5-a5f9-45b4-bfa5-903d84b5a22c None admin] RBAC: Authorizing `identity:get_domain(domain_id=990d513849474300bbce52c3101fe52c)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:17:01.496504 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5748b1f5-a5f9-45b4-bfa5-903d84b5a22c None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:17:01.498123 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 582/1172] 10.222.0.62 () {56 vars in 1183 bytes} [Mon Jun 27 09:17:01 2022] GET /identity/v3/domains/990d513849474300bbce52c3101fe52c => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:17:01.504251 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d770518-7928-48e2-a14d-dd610962f846 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:17:01.553130 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:17:01.601806 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d770518-7928-48e2-a14d-dd610962f846 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:17:01.634959 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c801ca-f200-4f60-96f8-76e75d57187e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:17:01.635535 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c801ca-f200-4f60-96f8-76e75d57187e None admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:17:01.635811 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c801ca-f200-4f60-96f8-76e75d57187e None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:17:01.636084 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c801ca-f200-4f60-96f8-76e75d57187e None admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:17:01.636815 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c801ca-f200-4f60-96f8-76e75d57187e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:17:01.638235 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c801ca-f200-4f60-96f8-76e75d57187e None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:17:01.706482 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 591/1173] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Jun 27 09:17:01 2022] POST /identity/v3/projects => generated 361 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:17:03.763534 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453461e-f176-4a88-8d8d-ea52ec87bd15 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:17:03.764088 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453461e-f176-4a88-8d8d-ea52ec87bd15 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:17:03.764088 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453461e-f176-4a88-8d8d-ea52ec87bd15 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:17:03.765474 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 583/1174] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:17:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:17:03.770740 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a745a8-5036-4501-a5e4-379907f3b2cc None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:17:03.771135 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a745a8-5036-4501-a5e4-379907f3b2cc None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:17:03.771300 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a745a8-5036-4501-a5e4-379907f3b2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:17:03.787758 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-38a745a8-5036-4501-a5e4-379907f3b2cc None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:17:03.788963 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-38a745a8-5036-4501-a5e4-379907f3b2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:17:03.852710 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 592/1175] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:17:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 09:17:03.878651 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453461e-f176-4a88-8d8d-ea52ec87bd15 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:17:03.958111 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:17:03.983096 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453461e-f176-4a88-8d8d-ea52ec87bd15 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:17:04.016387 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94801728-b9c0-4e38-93fe-a26c3d23204d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:17:04.017172 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94801728-b9c0-4e38-93fe-a26c3d23204d None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:17:04.017447 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94801728-b9c0-4e38-93fe-a26c3d23204d None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:17:04.017718 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94801728-b9c0-4e38-93fe-a26c3d23204d None admin] PATH_INFO: `/v3/domains/990d513849474300bbce52c3101fe52c` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:17:04.018884 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94801728-b9c0-4e38-93fe-a26c3d23204d None admin] RBAC: Authorizing `identity:get_domain(domain_id=990d513849474300bbce52c3101fe52c)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:17:04.020350 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94801728-b9c0-4e38-93fe-a26c3d23204d None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:17:04.021967 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 584/1176] 10.222.0.62 () {56 vars in 1183 bytes} [Mon Jun 27 09:17:03 2022] GET /identity/v3/domains/990d513849474300bbce52c3101fe52c => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:17:04.028021 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a745a8-5036-4501-a5e4-379907f3b2cc None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:17:04.058407 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:17:04.125693 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a745a8-5036-4501-a5e4-379907f3b2cc None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:17:04.158979 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2d912-8b3f-456c-b775-d6bf2572a358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:17:04.159643 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2d912-8b3f-456c-b775-d6bf2572a358 None admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:17:04.159923 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2d912-8b3f-456c-b775-d6bf2572a358 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:17:04.160246 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2d912-8b3f-456c-b775-d6bf2572a358 None admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:17:04.160931 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2d912-8b3f-456c-b775-d6bf2572a358 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:17:04.162382 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2d912-8b3f-456c-b775-d6bf2572a358 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:17:04.241200 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 593/1177] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Jun 27 09:17:04 2022] POST /identity/v3/users => generated 311 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:17:06.283748 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b10aa8-fef9-47e2-8be7-fe80dc82097c None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:17:06.284300 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b10aa8-fef9-47e2-8be7-fe80dc82097c None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:17:06.284407 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b10aa8-fef9-47e2-8be7-fe80dc82097c None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:17:06.285759 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 585/1178] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:17:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:17:06.290963 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19cdd93-5a61-4a8c-8e00-a84fb4281abc None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:17:06.291347 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19cdd93-5a61-4a8c-8e00-a84fb4281abc None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:17:06.291510 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19cdd93-5a61-4a8c-8e00-a84fb4281abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:17:06.308957 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-d19cdd93-5a61-4a8c-8e00-a84fb4281abc None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:17:06.310144 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-d19cdd93-5a61-4a8c-8e00-a84fb4281abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:17:06.373058 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 594/1179] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:17:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 09:17:06.396132 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b10aa8-fef9-47e2-8be7-fe80dc82097c None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:17:06.496860 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b10aa8-fef9-47e2-8be7-fe80dc82097c None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:17:06.530749 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958fae8-c9c1-40db-9879-be426edfe29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:17:06.531522 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958fae8-c9c1-40db-9879-be426edfe29a None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:17:06.531858 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958fae8-c9c1-40db-9879-be426edfe29a None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:17:06.532764 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958fae8-c9c1-40db-9879-be426edfe29a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:17:06.542590 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1958fae8-c9c1-40db-9879-be426edfe29a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:17:06.550670 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-1958fae8-c9c1-40db-9879-be426edfe29a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:17:06.550670 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:17:06.550670 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:17:06.550670 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:17:06.550670 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:17:06.550670 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:17:06.550670 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:17:06.550670 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:17:06.550670 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:17:06.550670 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:17:06.550670 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:17:06.550670 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:17:06.550670 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:17:06.550670 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:17:06.550670 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:17:06.550670 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:17:06.551908 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:17:06.551908 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:17:06.551908 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:17:06.551908 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:17:06.551908 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:17:06.551908 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:17:06.551908 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:17:06.551908 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:17:06.551908 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:17:06.551908 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:17:06.551908 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:17:06.551908 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:17:06.551908 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:17:06.551908 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:17:06.551908 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:17:06.551908 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:17:06.553112 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:17:06.553112 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:17:06.553112 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:17:06.553112 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:17:06.553112 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:17:06.553112 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:17:06.553112 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:17:06.553112 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:17:06.553112 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:17:06.553112 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:17:06.553112 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:17:06.553112 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:17:06.553112 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 586/1180] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Jun 27 09:17:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:17:06.557924 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19cdd93-5a61-4a8c-8e00-a84fb4281abc None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:17:06.582676 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:17:06.663123 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19cdd93-5a61-4a8c-8e00-a84fb4281abc None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:17:06.695987 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c39b17-e48e-4f7f-bfa4-3f51ef3b675a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:17:06.696685 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c39b17-e48e-4f7f-bfa4-3f51ef3b675a None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:17:06.696962 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c39b17-e48e-4f7f-bfa4-3f51ef3b675a None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:17:06.697237 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c39b17-e48e-4f7f-bfa4-3f51ef3b675a None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:17:06.697965 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c39b17-e48e-4f7f-bfa4-3f51ef3b675a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:17:06.698262 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c39b17-e48e-4f7f-bfa4-3f51ef3b675a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:17:06.699618 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c39b17-e48e-4f7f-bfa4-3f51ef3b675a None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:17:06.707358 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 595/1181] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:17:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:17:06.713457 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958fae8-c9c1-40db-9879-be426edfe29a None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:17:06.716401 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:17:06.812222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958fae8-c9c1-40db-9879-be426edfe29a None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:17:06.845047 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f54e95-533d-4c4c-af5d-b642e73c999a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:17:06.845891 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f54e95-533d-4c4c-af5d-b642e73c999a None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:17:06.846173 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f54e95-533d-4c4c-af5d-b642e73c999a None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:17:06.846447 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f54e95-533d-4c4c-af5d-b642e73c999a None admin] PATH_INFO: `/v3/users/528faf9559cd4b1dadc19738f3454ae2` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:17:06.859157 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f54e95-533d-4c4c-af5d-b642e73c999a None admin] RBAC: Authorizing `identity:get_user(user_id=528faf9559cd4b1dadc19738f3454ae2)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:17:06.861130 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f54e95-533d-4c4c-af5d-b642e73c999a None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:17:06.862767 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 587/1182] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Jun 27 09:17:06 2022] GET /identity/v3/users/528faf9559cd4b1dadc19738f3454ae2 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:17:06.868530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c39b17-e48e-4f7f-bfa4-3f51ef3b675a None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:17:06.952243 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:17:06.971852 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c39b17-e48e-4f7f-bfa4-3f51ef3b675a None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:17:07.005804 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a7c95-680a-43e7-83bc-ce737fa1a54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:17:07.006442 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a7c95-680a-43e7-83bc-ce737fa1a54a None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:17:07.006720 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a7c95-680a-43e7-83bc-ce737fa1a54a None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:17:07.006996 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a7c95-680a-43e7-83bc-ce737fa1a54a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:17:07.072867 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a7c95-680a-43e7-83bc-ce737fa1a54a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:17:07.074307 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a7c95-680a-43e7-83bc-ce737fa1a54a None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:17:07.151179 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:17:07.170683 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 596/1183] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:17:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 09:17:07.177162 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f54e95-533d-4c4c-af5d-b642e73c999a None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:17:07.238628 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:17:07.281911 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f54e95-533d-4c4c-af5d-b642e73c999a None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:17:07.314819 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74679d9b-7dd7-4780-9d60-f60714c6316d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:17:07.315660 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74679d9b-7dd7-4780-9d60-f60714c6316d None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:17:07.315937 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74679d9b-7dd7-4780-9d60-f60714c6316d None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:17:07.316230 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74679d9b-7dd7-4780-9d60-f60714c6316d None admin] PATH_INFO: `/v3/projects/fa2d98b9d5c2407a812d8f7116d4706c` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:17:07.317393 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74679d9b-7dd7-4780-9d60-f60714c6316d None admin] RBAC: Authorizing `identity:get_project(project_id=fa2d98b9d5c2407a812d8f7116d4706c)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:17:07.318807 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74679d9b-7dd7-4780-9d60-f60714c6316d None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:17:07.320541 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 588/1184] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:17:07 2022] GET /identity/v3/projects/fa2d98b9d5c2407a812d8f7116d4706c => generated 361 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:17:07.326952 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a7c95-680a-43e7-83bc-ce737fa1a54a None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:17:07.425125 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a7c95-680a-43e7-83bc-ce737fa1a54a None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:17:07.458384 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8373c34-5532-46d4-abfe-2080fce41fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:17:07.459035 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8373c34-5532-46d4-abfe-2080fce41fed None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:17:07.459318 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8373c34-5532-46d4-abfe-2080fce41fed None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:17:07.459598 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8373c34-5532-46d4-abfe-2080fce41fed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:17:07.460447 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8373c34-5532-46d4-abfe-2080fce41fed None admin] RBAC: Adding query filter params (role.id=91c77942515d45f1ad8189c9fddf4424, scope.project.id=fa2d98b9d5c2407a812d8f7116d4706c, user.id=528faf9559cd4b1dadc19738f3454ae2) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:17:07.460760 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8373c34-5532-46d4-abfe-2080fce41fed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:17:07.462195 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8373c34-5532-46d4-abfe-2080fce41fed None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:17:07.467497 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 597/1185] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Jun 27 09:17:07 2022] GET /identity/v3/role_assignments?user.id=528faf9559cd4b1dadc19738f3454ae2&scope.project.id=fa2d98b9d5c2407a812d8f7116d4706c&role.id=91c77942515d45f1ad8189c9fddf4424 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:17:09.434972 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144cac0f-db76-4478-8adc-b91eca162243 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:17:09.435492 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144cac0f-db76-4478-8adc-b91eca162243 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:17:09.435492 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144cac0f-db76-4478-8adc-b91eca162243 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:17:09.436798 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 589/1186] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:17:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:17:09.442402 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378ec94-2288-4fa0-acb7-1d9438ff1ae9 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:17:09.442810 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378ec94-2288-4fa0-acb7-1d9438ff1ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:17:09.442958 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378ec94-2288-4fa0-acb7-1d9438ff1ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:17:09.460810 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-3378ec94-2288-4fa0-acb7-1d9438ff1ae9 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:17:09.462007 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-3378ec94-2288-4fa0-acb7-1d9438ff1ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:17:09.501341 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:17:09.527345 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 598/1187] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:17:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 09:17:09.550703 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144cac0f-db76-4478-8adc-b91eca162243 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:17:09.650798 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144cac0f-db76-4478-8adc-b91eca162243 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:17:09.676540 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:17:09.684001 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba1dc9-0dc6-44f0-b32a-2f1b2a6d73c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:17:09.690867 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba1dc9-0dc6-44f0-b32a-2f1b2a6d73c2 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:17:09.690867 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba1dc9-0dc6-44f0-b32a-2f1b2a6d73c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:17:09.690867 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba1dc9-0dc6-44f0-b32a-2f1b2a6d73c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:17:09.695231 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ba1dc9-0dc6-44f0-b32a-2f1b2a6d73c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:17:09.702785 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-45ba1dc9-0dc6-44f0-b32a-2f1b2a6d73c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:17:09.702785 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:17:09.702785 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:17:09.702785 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:17:09.702785 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:17:09.702785 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:17:09.702785 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:17:09.702785 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:17:09.702785 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:17:09.702785 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:17:09.702785 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:17:09.702785 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:17:09.702785 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:17:09.702785 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:17:09.702785 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:17:09.702785 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:17:09.704690 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:17:09.704690 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:17:09.704690 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:17:09.704690 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:17:09.704690 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:17:09.704690 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:17:09.704690 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:17:09.704690 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:17:09.704690 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:17:09.704690 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:17:09.704690 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:17:09.704690 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:17:09.704690 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:17:09.704690 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:17:09.704690 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:17:09.704690 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:17:09.705695 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:17:09.705695 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:17:09.705695 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:17:09.705695 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:17:09.705695 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:17:09.705695 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:17:09.705695 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:17:09.705695 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:17:09.705695 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:17:09.705695 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:17:09.705695 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:17:09.705695 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:17:09.705695 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 590/1188] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Jun 27 09:17:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:17:09.710901 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378ec94-2288-4fa0-acb7-1d9438ff1ae9 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:17:09.807417 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378ec94-2288-4fa0-acb7-1d9438ff1ae9 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:17:09.840423 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1894203-8307-455d-8491-b5bf2b6bcec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:17:09.841112 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1894203-8307-455d-8491-b5bf2b6bcec1 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:17:09.841395 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1894203-8307-455d-8491-b5bf2b6bcec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:17:09.841668 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1894203-8307-455d-8491-b5bf2b6bcec1 None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:17:09.842401 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1894203-8307-455d-8491-b5bf2b6bcec1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:17:09.842708 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1894203-8307-455d-8491-b5bf2b6bcec1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:17:09.844069 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1894203-8307-455d-8491-b5bf2b6bcec1 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:17:09.851931 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 599/1189] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:17:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:17:09.857818 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba1dc9-0dc6-44f0-b32a-2f1b2a6d73c2 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:17:09.959237 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba1dc9-0dc6-44f0-b32a-2f1b2a6d73c2 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:17:09.993183 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51e617-6fd4-4a8d-a1c7-69c03b58c22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:17:09.994040 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51e617-6fd4-4a8d-a1c7-69c03b58c22e None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:17:09.994318 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51e617-6fd4-4a8d-a1c7-69c03b58c22e None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:17:09.994589 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51e617-6fd4-4a8d-a1c7-69c03b58c22e None admin] PATH_INFO: `/v3/users/528faf9559cd4b1dadc19738f3454ae2` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:17:09.995758 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f51e617-6fd4-4a8d-a1c7-69c03b58c22e None admin] RBAC: Authorizing `identity:get_user(user_id=528faf9559cd4b1dadc19738f3454ae2)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:17:09.997209 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f51e617-6fd4-4a8d-a1c7-69c03b58c22e None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:17:09.998832 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 591/1190] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Jun 27 09:17:09 2022] GET /identity/v3/users/528faf9559cd4b1dadc19738f3454ae2 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:17:10.004764 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1894203-8307-455d-8491-b5bf2b6bcec1 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:17:10.039318 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:17:10.102418 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1894203-8307-455d-8491-b5bf2b6bcec1 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:17:10.135673 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6974a4a-d556-40c9-b53f-d16409d5b968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:17:10.136662 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6974a4a-d556-40c9-b53f-d16409d5b968 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:17:10.136939 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6974a4a-d556-40c9-b53f-d16409d5b968 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:17:10.137209 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6974a4a-d556-40c9-b53f-d16409d5b968 None admin] PATH_INFO: `/v3/projects/fa2d98b9d5c2407a812d8f7116d4706c` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:17:10.138361 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6974a4a-d556-40c9-b53f-d16409d5b968 None admin] RBAC: Authorizing `identity:get_project(project_id=fa2d98b9d5c2407a812d8f7116d4706c)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:17:10.139771 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6974a4a-d556-40c9-b53f-d16409d5b968 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:17:10.141487 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 600/1191] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:17:10 2022] GET /identity/v3/projects/fa2d98b9d5c2407a812d8f7116d4706c => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:17:10.147373 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51e617-6fd4-4a8d-a1c7-69c03b58c22e None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:17:10.203077 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:17:10.246644 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51e617-6fd4-4a8d-a1c7-69c03b58c22e None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:17:10.280480 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3098b12-2e4f-4264-ae63-896189ae1461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:17:10.281357 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3098b12-2e4f-4264-ae63-896189ae1461 None admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:17:10.282194 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3098b12-2e4f-4264-ae63-896189ae1461 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:17:10.282469 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3098b12-2e4f-4264-ae63-896189ae1461 None admin] PATH_INFO: `/v3/projects/fa2d98b9d5c2407a812d8f7116d4706c/users/528faf9559cd4b1dadc19738f3454ae2/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:17:10.284433 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3098b12-2e4f-4264-ae63-896189ae1461 None admin] RBAC: Authorizing `identity:create_grant(project_id=fa2d98b9d5c2407a812d8f7116d4706c, user_id=528faf9559cd4b1dadc19738f3454ae2, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:17:10.285867 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3098b12-2e4f-4264-ae63-896189ae1461 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:17:10.354359 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 592/1192] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Jun 27 09:17:10 2022] PUT /identity/v3/projects/fa2d98b9d5c2407a812d8f7116d4706c/users/528faf9559cd4b1dadc19738f3454ae2/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:17:12.333724 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae0a66-588b-414d-b04f-4d00eee193aa None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:17:12.334296 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae0a66-588b-414d-b04f-4d00eee193aa None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:17:12.334296 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae0a66-588b-414d-b04f-4d00eee193aa None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:17:12.335633 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 601/1193] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:17:12.340905 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31160df8-79e7-401b-8468-2a752a4c4d41 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:17:12.341321 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31160df8-79e7-401b-8468-2a752a4c4d41 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:17:12.341467 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31160df8-79e7-401b-8468-2a752a4c4d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:17:12.358167 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-31160df8-79e7-401b-8468-2a752a4c4d41 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:17:12.359355 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-31160df8-79e7-401b-8468-2a752a4c4d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:17:12.427812 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 593/1194] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:17:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 09:17:12.451396 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae0a66-588b-414d-b04f-4d00eee193aa None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:17:12.553344 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae0a66-588b-414d-b04f-4d00eee193aa None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:17:12.555718 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:17:12.586925 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ebee3d-6c3e-498f-8adf-401773d5128c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:17:12.587727 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebee3d-6c3e-498f-8adf-401773d5128c None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:17:12.588022 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebee3d-6c3e-498f-8adf-401773d5128c None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:17:12.588515 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebee3d-6c3e-498f-8adf-401773d5128c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:17:12.599347 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ebee3d-6c3e-498f-8adf-401773d5128c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:17:12.606962 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-b7ebee3d-6c3e-498f-8adf-401773d5128c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:17:12.606962 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:17:12.606962 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:17:12.606962 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:17:12.606962 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:17:12.606962 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:17:12.606962 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:17:12.606962 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:17:12.606962 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:17:12.606962 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:17:12.606962 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:17:12.606962 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:17:12.606962 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:17:12.606962 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:17:12.606962 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:17:12.606962 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:17:12.608087 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:17:12.608087 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:17:12.608087 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:17:12.608087 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:17:12.608087 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:17:12.608087 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:17:12.608087 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:17:12.608087 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:17:12.608087 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:17:12.608087 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:17:12.608087 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:17:12.608087 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:17:12.608087 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:17:12.608087 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:17:12.608087 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:17:12.608087 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:17:12.609190 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:17:12.609190 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:17:12.609190 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:17:12.609190 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:17:12.609190 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:17:12.609190 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:17:12.609190 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:17:12.609190 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:17:12.609190 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:17:12.609190 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:17:12.609190 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:17:12.609190 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:17:12.609190 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 602/1195] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Jun 27 09:17:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:17:12.614181 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31160df8-79e7-401b-8468-2a752a4c4d41 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:17:12.659779 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:17:12.712263 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31160df8-79e7-401b-8468-2a752a4c4d41 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:17:12.746357 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2495c3-993f-43de-b8bd-aa3873df2510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:17:12.747018 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2495c3-993f-43de-b8bd-aa3873df2510 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:17:12.747299 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2495c3-993f-43de-b8bd-aa3873df2510 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:17:12.747574 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2495c3-993f-43de-b8bd-aa3873df2510 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:17:12.748346 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2495c3-993f-43de-b8bd-aa3873df2510 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:17:12.748657 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2495c3-993f-43de-b8bd-aa3873df2510 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:17:12.750071 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2495c3-993f-43de-b8bd-aa3873df2510 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:17:12.758276 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 594/1196] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:17:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:17:12.764051 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ebee3d-6c3e-498f-8adf-401773d5128c None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:17:12.861279 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ebee3d-6c3e-498f-8adf-401773d5128c None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:17:12.894707 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44adce-84c9-4ef6-8688-7a947e1dac85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:17:12.895563 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44adce-84c9-4ef6-8688-7a947e1dac85 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:17:12.895844 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44adce-84c9-4ef6-8688-7a947e1dac85 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:17:12.896118 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44adce-84c9-4ef6-8688-7a947e1dac85 None admin] PATH_INFO: `/v3/users/528faf9559cd4b1dadc19738f3454ae2` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:17:12.897315 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f44adce-84c9-4ef6-8688-7a947e1dac85 None admin] RBAC: Authorizing `identity:get_user(user_id=528faf9559cd4b1dadc19738f3454ae2)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:17:12.899011 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f44adce-84c9-4ef6-8688-7a947e1dac85 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:17:12.900662 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 603/1197] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Jun 27 09:17:12 2022] GET /identity/v3/users/528faf9559cd4b1dadc19738f3454ae2 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:17:12.906404 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2495c3-993f-43de-b8bd-aa3873df2510 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:17:13.004234 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2495c3-993f-43de-b8bd-aa3873df2510 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:17:13.012787 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:17:13.037111 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555cc979-951a-417a-8af7-3f7c199a5096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:17:13.037744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cc979-951a-417a-8af7-3f7c199a5096 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:17:13.038029 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cc979-951a-417a-8af7-3f7c199a5096 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:17:13.038309 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cc979-951a-417a-8af7-3f7c199a5096 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:17:13.103949 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555cc979-951a-417a-8af7-3f7c199a5096 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:17:13.105440 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555cc979-951a-417a-8af7-3f7c199a5096 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:17:13.201073 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 595/1198] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:17:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 09:17:13.206964 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44adce-84c9-4ef6-8688-7a947e1dac85 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:17:13.238482 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:17:13.309740 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44adce-84c9-4ef6-8688-7a947e1dac85 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:17:13.342411 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab869a7-1c09-4003-884f-0ffe7397962e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:17:13.343251 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab869a7-1c09-4003-884f-0ffe7397962e None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:17:13.343561 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab869a7-1c09-4003-884f-0ffe7397962e None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:17:13.343834 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab869a7-1c09-4003-884f-0ffe7397962e None admin] PATH_INFO: `/v3/projects/fa2d98b9d5c2407a812d8f7116d4706c` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:17:13.345584 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab869a7-1c09-4003-884f-0ffe7397962e None admin] RBAC: Authorizing `identity:get_project(project_id=fa2d98b9d5c2407a812d8f7116d4706c)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:17:13.347009 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab869a7-1c09-4003-884f-0ffe7397962e None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:17:13.348742 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 604/1199] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Jun 27 09:17:13 2022] GET /identity/v3/projects/fa2d98b9d5c2407a812d8f7116d4706c => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:17:13.354824 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555cc979-951a-417a-8af7-3f7c199a5096 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:17:13.364745 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:17:13.449589 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555cc979-951a-417a-8af7-3f7c199a5096 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:17:13.482328 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def434b-a046-4930-8924-bc67628a42fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:17:13.482958 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def434b-a046-4930-8924-bc67628a42fb None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:17:13.483233 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def434b-a046-4930-8924-bc67628a42fb None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:17:13.483501 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def434b-a046-4930-8924-bc67628a42fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:17:13.484346 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def434b-a046-4930-8924-bc67628a42fb None admin] RBAC: Adding query filter params (role.id=91c77942515d45f1ad8189c9fddf4424, scope.project.id=fa2d98b9d5c2407a812d8f7116d4706c, user.id=528faf9559cd4b1dadc19738f3454ae2) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:17:13.484652 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def434b-a046-4930-8924-bc67628a42fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:17:13.486074 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def434b-a046-4930-8924-bc67628a42fb None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:17:13.491681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 596/1200] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Jun 27 09:17:13 2022] GET /identity/v3/role_assignments?user.id=528faf9559cd4b1dadc19738f3454ae2&scope.project.id=fa2d98b9d5c2407a812d8f7116d4706c&role.id=91c77942515d45f1ad8189c9fddf4424 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:17:23.338362 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=50 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:17:23.489239 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=64 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:27.008171 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a03990-169f-413b-9912-2a2a599d25c1 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:27.008787 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a03990-169f-413b-9912-2a2a599d25c1 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:27.008787 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a03990-169f-413b-9912-2a2a599d25c1 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:27.010107 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 605/1201] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:18:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:18:27.015488 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc3b7c-9369-414d-9b55-0777373c115b None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:27.015933 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc3b7c-9369-414d-9b55-0777373c115b None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:27.016030 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc3b7c-9369-414d-9b55-0777373c115b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:27.033524 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-62cc3b7c-9369-414d-9b55-0777373c115b None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:18:27.035014 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-62cc3b7c-9369-414d-9b55-0777373c115b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:18:27.102093 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 597/1202] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:18:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 09:18:27.126494 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a03990-169f-413b-9912-2a2a599d25c1 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:27.229708 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a03990-169f-413b-9912-2a2a599d25c1 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:27.264772 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c1d37-17da-44cc-92e1-97e276ad5e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:27.265462 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c1d37-17da-44cc-92e1-97e276ad5e51 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:27.265839 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c1d37-17da-44cc-92e1-97e276ad5e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:27.266128 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c1d37-17da-44cc-92e1-97e276ad5e51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:27.277948 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c1d37-17da-44cc-92e1-97e276ad5e51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:27.279391 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c1d37-17da-44cc-92e1-97e276ad5e51 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:27.296631 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-a40c1d37-17da-44cc-92e1-97e276ad5e51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:18:27.296631 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:18:27.296631 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:18:27.296631 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:18:27.296631 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:18:27.296631 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:18:27.296631 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:18:27.296631 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:18:27.296631 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:18:27.296631 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:18:27.296631 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:18:27.296631 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:18:27.296631 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:18:27.296631 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:18:27.296631 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:18:27.304142 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:18:27.304142 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:18:27.304142 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:18:27.304142 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:18:27.304142 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:18:27.304142 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:18:27.304142 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:18:27.304142 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:18:27.304142 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:18:27.304142 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:18:27.304142 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:18:27.304142 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:18:27.304142 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:18:27.304142 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:18:27.304142 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:18:27.304142 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:18:27.304142 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:18:27.305395 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:18:27.305395 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:18:27.305395 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:18:27.305395 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:18:27.305395 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 606/1203] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:18:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:18:27.305765 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc3b7c-9369-414d-9b55-0777373c115b None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:27.404753 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc3b7c-9369-414d-9b55-0777373c115b None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:27.434703 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:27.441297 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e6e1d-ba49-4507-bb90-5d6a47e78dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:27.442088 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e6e1d-ba49-4507-bb90-5d6a47e78dee None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:27.442464 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e6e1d-ba49-4507-bb90-5d6a47e78dee None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:27.442832 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e6e1d-ba49-4507-bb90-5d6a47e78dee None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:27.443691 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49e6e1d-ba49-4507-bb90-5d6a47e78dee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:18:27.444089 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49e6e1d-ba49-4507-bb90-5d6a47e78dee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:27.445651 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49e6e1d-ba49-4507-bb90-5d6a47e78dee None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:27.456782 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 598/1204] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:18:27.462562 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c1d37-17da-44cc-92e1-97e276ad5e51 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:27.515490 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:27.562193 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c1d37-17da-44cc-92e1-97e276ad5e51 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:27.594577 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df542903-05cb-4109-8400-fca13f9fa9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:27.595225 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df542903-05cb-4109-8400-fca13f9fa9f8 None admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:27.595503 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df542903-05cb-4109-8400-fca13f9fa9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:27.595774 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df542903-05cb-4109-8400-fca13f9fa9f8 None admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:27.596647 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df542903-05cb-4109-8400-fca13f9fa9f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:27.598069 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df542903-05cb-4109-8400-fca13f9fa9f8 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:27.740867 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 607/1205] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Jun 27 09:18:27 2022] POST /identity/v3/users => generated 251 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 09:18:29.805706 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb71642-f7e0-44bb-a2d7-a9d7d1a9b2f3 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:29.806303 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb71642-f7e0-44bb-a2d7-a9d7d1a9b2f3 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:29.806303 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb71642-f7e0-44bb-a2d7-a9d7d1a9b2f3 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:29.807650 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 599/1206] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:18:29.812728 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed464c3-aaa9-4e1c-82bc-f6e2749ebe4d None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:29.813221 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed464c3-aaa9-4e1c-82bc-f6e2749ebe4d None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:29.813323 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed464c3-aaa9-4e1c-82bc-f6e2749ebe4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:29.829752 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-3ed464c3-aaa9-4e1c-82bc-f6e2749ebe4d None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:18:29.830954 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-3ed464c3-aaa9-4e1c-82bc-f6e2749ebe4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:18:29.896102 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 608/1207] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:18:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 09:18:29.919562 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb71642-f7e0-44bb-a2d7-a9d7d1a9b2f3 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:30.019068 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb71642-f7e0-44bb-a2d7-a9d7d1a9b2f3 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:30.052828 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890cd883-f50d-4c7a-9740-829924ae114f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:30.053570 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cd883-f50d-4c7a-9740-829924ae114f None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:30.053853 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cd883-f50d-4c7a-9740-829924ae114f None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:30.054125 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cd883-f50d-4c7a-9740-829924ae114f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:30.064276 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890cd883-f50d-4c7a-9740-829924ae114f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:18:30.071837 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-890cd883-f50d-4c7a-9740-829924ae114f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 09:18:30.071837 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:18:30.071837 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:18:30.071837 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:18:30.071837 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:18:30.071837 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:18:30.071837 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:18:30.071837 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:18:30.071837 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:18:30.071837 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:18:30.071837 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:18:30.071837 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:18:30.071837 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:18:30.071837 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:18:30.071837 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:18:30.071837 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:18:30.073117 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:18:30.073117 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:18:30.073117 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:18:30.073117 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:18:30.073117 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:18:30.073117 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:18:30.073117 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:18:30.073117 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:18:30.073117 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:18:30.073117 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:18:30.073117 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:18:30.073117 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:18:30.073117 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:18:30.073117 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:18:30.073117 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:18:30.073117 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:18:30.074161 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:18:30.074161 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:18:30.074161 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:18:30.074161 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:18:30.074161 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:18:30.074161 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:18:30.074161 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:18:30.074161 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:18:30.074161 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:18:30.074161 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:18:30.074161 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 09:18:30.074161 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:18:30.074161 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 600/1208] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Jun 27 09:18:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:18:30.079103 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed464c3-aaa9-4e1c-82bc-f6e2749ebe4d None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:30.121799 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:30.179544 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed464c3-aaa9-4e1c-82bc-f6e2749ebe4d None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:30.212103 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33374ac-52fc-421a-ac3e-351a84436b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:30.212790 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33374ac-52fc-421a-ac3e-351a84436b51 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:30.213073 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33374ac-52fc-421a-ac3e-351a84436b51 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:30.213346 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33374ac-52fc-421a-ac3e-351a84436b51 None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:30.214081 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33374ac-52fc-421a-ac3e-351a84436b51 None admin] RBAC: Adding query filter params (name=service) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:18:30.214385 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33374ac-52fc-421a-ac3e-351a84436b51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:30.216428 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33374ac-52fc-421a-ac3e-351a84436b51 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:30.224929 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 609/1209] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Jun 27 09:18:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:18:30.230681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890cd883-f50d-4c7a-9740-829924ae114f None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:30.282340 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:30.331283 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890cd883-f50d-4c7a-9740-829924ae114f None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:30.363737 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ef015-1520-4135-8205-89adadb3a5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:30.364541 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ef015-1520-4135-8205-89adadb3a5c1 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:30.364843 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ef015-1520-4135-8205-89adadb3a5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:30.365115 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ef015-1520-4135-8205-89adadb3a5c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:30.375377 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8ef015-1520-4135-8205-89adadb3a5c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:30.376866 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8ef015-1520-4135-8205-89adadb3a5c1 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:30.394288 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-ca8ef015-1520-4135-8205-89adadb3a5c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:18:30.394288 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:18:30.394288 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:18:30.394288 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:18:30.394288 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:18:30.394288 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:18:30.394288 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:18:30.394288 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:18:30.394288 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:18:30.394288 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:18:30.394288 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:18:30.394288 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:18:30.394288 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:18:30.394288 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:18:30.394288 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:18:30.395443 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:18:30.395443 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:18:30.395443 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:18:30.395443 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:18:30.395443 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:18:30.395443 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:18:30.395443 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:18:30.395443 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:18:30.395443 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:18:30.395443 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:18:30.395443 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:18:30.395443 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:18:30.395443 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:18:30.395443 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:18:30.395443 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:18:30.395443 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:18:30.395443 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:18:30.396721 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:18:30.396721 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:18:30.396721 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:18:30.396721 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:18:30.396721 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 601/1210] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:18:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:18:30.401937 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33374ac-52fc-421a-ac3e-351a84436b51 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:30.498384 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:30.501205 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33374ac-52fc-421a-ac3e-351a84436b51 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:30.536670 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde1b24a-9604-46f5-b16e-b4495eb72010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:30.537318 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1b24a-9604-46f5-b16e-b4495eb72010 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:30.537594 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1b24a-9604-46f5-b16e-b4495eb72010 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:30.537863 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1b24a-9604-46f5-b16e-b4495eb72010 None admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:30.538573 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde1b24a-9604-46f5-b16e-b4495eb72010 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:18:30.538869 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde1b24a-9604-46f5-b16e-b4495eb72010 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:30.540245 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde1b24a-9604-46f5-b16e-b4495eb72010 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:30.551285 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 610/1211] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:18:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:18:30.557516 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ef015-1520-4135-8205-89adadb3a5c1 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:30.660159 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ef015-1520-4135-8205-89adadb3a5c1 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:30.661756 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:30.693466 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc0844-55a6-4ece-9edd-0b8f6205232e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:30.694250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc0844-55a6-4ece-9edd-0b8f6205232e None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:30.694528 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc0844-55a6-4ece-9edd-0b8f6205232e None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:30.694796 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc0844-55a6-4ece-9edd-0b8f6205232e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:30.702050 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dc0844-55a6-4ece-9edd-0b8f6205232e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:30.703521 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dc0844-55a6-4ece-9edd-0b8f6205232e None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:30.718713 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-06dc0844-55a6-4ece-9edd-0b8f6205232e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 27 09:18:30.718713 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:18:30.718713 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:18:30.718713 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:18:30.718713 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:18:30.718713 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:18:30.718713 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:18:30.718713 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:18:30.718713 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:18:30.718713 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:18:30.718713 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:18:30.718713 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:18:30.718713 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 09:18:30.718713 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 09:18:30.718713 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 09:18:30.718713 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 09:18:30.719776 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:18:30.719776 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:18:30.719776 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 09:18:30.719776 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:18:30.719776 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 09:18:30.719776 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:18:30.719776 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:18:30.719776 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:18:30.719776 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:18:30.719776 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:18:30.719776 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:18:30.719776 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:18:30.719776 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:18:30.719776 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:18:30.719776 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:18:30.719776 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:18:30.719776 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:18:30.719776 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:18:30.720889 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:18:30.720889 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:18:30.720889 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 09:18:30.720889 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 09:18:30.720889 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 09:18:30.720889 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 09:18:30.720889 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 09:18:30.720889 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 09:18:30.720889 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 27 09:18:30.720889 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:18:30.720889 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 602/1212] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:18:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:18:30.725873 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde1b24a-9604-46f5-b16e-b4495eb72010 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:30.827725 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde1b24a-9604-46f5-b16e-b4495eb72010 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:30.861200 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397637b-d79b-4cd6-8a1c-2b919bc7c022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:30.861853 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397637b-d79b-4cd6-8a1c-2b919bc7c022 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:30.862156 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397637b-d79b-4cd6-8a1c-2b919bc7c022 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:30.862427 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397637b-d79b-4cd6-8a1c-2b919bc7c022 None admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:30.863251 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2397637b-d79b-4cd6-8a1c-2b919bc7c022 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:18:30.863555 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2397637b-d79b-4cd6-8a1c-2b919bc7c022 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:30.865048 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2397637b-d79b-4cd6-8a1c-2b919bc7c022 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:30.881716 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 611/1213] 10.222.0.62 () {56 vars in 1143 bytes} [Mon Jun 27 09:18:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:18:30.887622 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc0844-55a6-4ece-9edd-0b8f6205232e None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:30.987694 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc0844-55a6-4ece-9edd-0b8f6205232e None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:31.020655 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed95c2-3e3b-407b-8289-ebbcdd25117b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:31.021548 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed95c2-3e3b-407b-8289-ebbcdd25117b None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:31.021830 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed95c2-3e3b-407b-8289-ebbcdd25117b None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:31.022106 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed95c2-3e3b-407b-8289-ebbcdd25117b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:31.052058 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:31.089235 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed95c2-3e3b-407b-8289-ebbcdd25117b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:31.090826 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed95c2-3e3b-407b-8289-ebbcdd25117b None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:31.189927 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 603/1214] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:18:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 09:18:31.196501 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397637b-d79b-4cd6-8a1c-2b919bc7c022 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:31.215621 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:31.294735 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397637b-d79b-4cd6-8a1c-2b919bc7c022 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:31.328950 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a34f4f-d303-4f3a-95e4-ac2a5f4e75b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:31.331580 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a34f4f-d303-4f3a-95e4-ac2a5f4e75b5 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:31.331580 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a34f4f-d303-4f3a-95e4-ac2a5f4e75b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:31.331580 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a34f4f-d303-4f3a-95e4-ac2a5f4e75b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:31.341279 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a34f4f-d303-4f3a-95e4-ac2a5f4e75b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:31.342776 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a34f4f-d303-4f3a-95e4-ac2a5f4e75b5 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:31.360079 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-c1a34f4f-d303-4f3a-95e4-ac2a5f4e75b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:18:31.360079 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:18:31.360079 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:18:31.360079 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:18:31.360079 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:18:31.360079 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:18:31.360079 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:18:31.360079 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:18:31.360079 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:18:31.360079 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:18:31.360079 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:18:31.360079 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:18:31.360079 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:18:31.360079 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:18:31.360079 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:18:31.366235 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:18:31.366235 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:18:31.366235 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:18:31.366235 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:18:31.366235 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:18:31.366235 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:18:31.366235 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:18:31.366235 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:18:31.366235 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:18:31.366235 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:18:31.366235 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:18:31.366235 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:18:31.366235 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:18:31.366235 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:18:31.366235 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:18:31.366235 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:18:31.366235 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:18:31.367390 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:18:31.367390 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:18:31.367390 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:18:31.367390 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:18:31.367390 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 612/1215] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:18:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:18:31.367738 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed95c2-3e3b-407b-8289-ebbcdd25117b None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:31.433542 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:31.473806 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed95c2-3e3b-407b-8289-ebbcdd25117b None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:31.507733 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c2a9c-3153-4983-862c-bfb5df868d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:31.508417 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c2a9c-3153-4983-862c-bfb5df868d3e None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:31.508697 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c2a9c-3153-4983-862c-bfb5df868d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:31.508966 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c2a9c-3153-4983-862c-bfb5df868d3e None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:31.509678 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29c2a9c-3153-4983-862c-bfb5df868d3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:18:31.510075 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29c2a9c-3153-4983-862c-bfb5df868d3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:31.511434 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29c2a9c-3153-4983-862c-bfb5df868d3e None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:31.524436 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 604/1216] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:18:31.530078 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a34f4f-d303-4f3a-95e4-ac2a5f4e75b5 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:31.599620 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:31.632532 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a34f4f-d303-4f3a-95e4-ac2a5f4e75b5 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:31.667316 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed88abf-59d3-456d-b91a-78c3058c744e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:31.668102 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed88abf-59d3-456d-b91a-78c3058c744e None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:31.668477 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed88abf-59d3-456d-b91a-78c3058c744e None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:31.668750 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed88abf-59d3-456d-b91a-78c3058c744e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:31.676052 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed88abf-59d3-456d-b91a-78c3058c744e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:31.677533 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed88abf-59d3-456d-b91a-78c3058c744e None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:31.691950 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-9ed88abf-59d3-456d-b91a-78c3058c744e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:18:31.691950 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:18:31.691950 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:18:31.691950 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:18:31.691950 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:18:31.691950 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:18:31.691950 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:18:31.691950 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:18:31.691950 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:18:31.691950 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:18:31.691950 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:18:31.691950 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:18:31.691950 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 09:18:31.691950 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 09:18:31.691950 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 09:18:31.693162 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 09:18:31.693162 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:18:31.693162 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:18:31.693162 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:18:31.693162 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:18:31.693162 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:18:31.693162 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:18:31.693162 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:18:31.693162 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:18:31.693162 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:18:31.693162 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:18:31.693162 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:18:31.693162 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:18:31.693162 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:18:31.693162 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:18:31.693162 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:18:31.693162 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:18:31.694435 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 09:18:31.694435 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 09:18:31.694435 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 09:18:31.694435 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 09:18:31.694435 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 09:18:31.694435 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 09:18:31.694435 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:18:31.694435 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:18:31.694435 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 613/1217] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:18:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:18:31.699033 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c2a9c-3153-4983-862c-bfb5df868d3e None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:31.797158 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c2a9c-3153-4983-862c-bfb5df868d3e None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:31.821669 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:31.833530 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8eab7f-b6bb-47ab-9c03-51302655feb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:31.834183 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8eab7f-b6bb-47ab-9c03-51302655feb3 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:31.834463 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8eab7f-b6bb-47ab-9c03-51302655feb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:31.834734 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8eab7f-b6bb-47ab-9c03-51302655feb3 None admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:31.835520 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8eab7f-b6bb-47ab-9c03-51302655feb3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:18:31.835823 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8eab7f-b6bb-47ab-9c03-51302655feb3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:31.837277 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8eab7f-b6bb-47ab-9c03-51302655feb3 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:31.848767 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 605/1218] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Jun 27 09:18:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:18:31.855182 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed88abf-59d3-456d-b91a-78c3058c744e None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:31.957384 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed88abf-59d3-456d-b91a-78c3058c744e None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:31.991523 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:31.997653 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2309f-65a1-4d80-a1fd-0e7156ad7dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:31.998316 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2309f-65a1-4d80-a1fd-0e7156ad7dec None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:31.998602 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2309f-65a1-4d80-a1fd-0e7156ad7dec None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:31.998941 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2309f-65a1-4d80-a1fd-0e7156ad7dec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:31.999794 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a2309f-65a1-4d80-a1fd-0e7156ad7dec None admin] RBAC: Adding query filter params (role.id=197a0da3099d45e4bcb9233039c21d8f, scope.project.id=4ba8e40538db4d89b93469b79322d20e, user.id=2bbaf738138b40b2a06bb63934f6608c) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:18:32.000105 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a2309f-65a1-4d80-a1fd-0e7156ad7dec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:32.001592 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a2309f-65a1-4d80-a1fd-0e7156ad7dec None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:32.008572 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 614/1219] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Jun 27 09:18:31 2022] GET /identity/v3/role_assignments?user.id=2bbaf738138b40b2a06bb63934f6608c&scope.project.id=4ba8e40538db4d89b93469b79322d20e&role.id=197a0da3099d45e4bcb9233039c21d8f => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:18:34.059398 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0747156-f4b3-4480-bddc-22b59af7e8af None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:34.059976 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0747156-f4b3-4480-bddc-22b59af7e8af None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:34.059976 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0747156-f4b3-4480-bddc-22b59af7e8af None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:34.061421 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 606/1220] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:18:34.067287 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a56853-260d-4136-bf30-ebbf26fbdd3d None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:34.067717 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a56853-260d-4136-bf30-ebbf26fbdd3d None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:34.067857 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a56853-260d-4136-bf30-ebbf26fbdd3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:34.084390 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-99a56853-260d-4136-bf30-ebbf26fbdd3d None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:18:34.085591 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-99a56853-260d-4136-bf30-ebbf26fbdd3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:18:34.153292 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 615/1221] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:18:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 09:18:34.176915 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0747156-f4b3-4480-bddc-22b59af7e8af None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:34.279032 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0747156-f4b3-4480-bddc-22b59af7e8af None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:34.315485 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323e5b1-e65a-4259-ab57-e356bf105f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:34.316275 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323e5b1-e65a-4259-ab57-e356bf105f08 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:34.316558 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323e5b1-e65a-4259-ab57-e356bf105f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:34.316831 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323e5b1-e65a-4259-ab57-e356bf105f08 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:34.326810 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3323e5b1-e65a-4259-ab57-e356bf105f08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:18:34.334627 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-3323e5b1-e65a-4259-ab57-e356bf105f08 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 09:18:34.334627 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:18:34.334627 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:18:34.334627 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:18:34.334627 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:18:34.334627 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:18:34.334627 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:18:34.334627 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:18:34.334627 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:18:34.334627 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:18:34.334627 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:18:34.334627 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:18:34.334627 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:18:34.334627 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:18:34.334627 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:18:34.334627 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:18:34.335739 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:18:34.335739 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:18:34.335739 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:18:34.335739 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:18:34.335739 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:18:34.335739 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:18:34.335739 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:18:34.335739 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:18:34.335739 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:18:34.335739 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:18:34.335739 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:18:34.335739 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:18:34.335739 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:18:34.335739 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:18:34.335739 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:18:34.335739 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:18:34.336825 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:18:34.336825 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:18:34.336825 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:18:34.336825 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:18:34.336825 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:18:34.336825 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:18:34.336825 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:18:34.336825 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:18:34.336825 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:18:34.336825 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:18:34.336825 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 09:18:34.336825 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:18:34.336825 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 607/1222] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Jun 27 09:18:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:18:34.342107 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a56853-260d-4136-bf30-ebbf26fbdd3d None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:34.440931 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a56853-260d-4136-bf30-ebbf26fbdd3d None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:34.463389 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:34.474333 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1703a671-5227-4ebc-892b-135f9404f9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:34.474987 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703a671-5227-4ebc-892b-135f9404f9c1 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:34.475265 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703a671-5227-4ebc-892b-135f9404f9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:34.475534 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703a671-5227-4ebc-892b-135f9404f9c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:34.476324 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1703a671-5227-4ebc-892b-135f9404f9c1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:18:34.478833 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1703a671-5227-4ebc-892b-135f9404f9c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:34.478833 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1703a671-5227-4ebc-892b-135f9404f9c1 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:34.485688 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 616/1223] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Jun 27 09:18:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:18:34.492034 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323e5b1-e65a-4259-ab57-e356bf105f08 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:34.536450 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:34.603359 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323e5b1-e65a-4259-ab57-e356bf105f08 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:34.635897 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c60648-292d-408e-9fdc-d4a75d4d4652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:34.641651 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c60648-292d-408e-9fdc-d4a75d4d4652 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:34.641651 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c60648-292d-408e-9fdc-d4a75d4d4652 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:34.641651 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c60648-292d-408e-9fdc-d4a75d4d4652 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:34.648478 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c60648-292d-408e-9fdc-d4a75d4d4652 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:34.649908 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c60648-292d-408e-9fdc-d4a75d4d4652 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:34.668801 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-f2c60648-292d-408e-9fdc-d4a75d4d4652 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:18:34.668801 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:18:34.668801 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:18:34.668801 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:18:34.668801 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:18:34.668801 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:18:34.668801 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:18:34.668801 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:18:34.668801 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:18:34.668801 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:18:34.668801 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:18:34.668801 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:18:34.668801 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:18:34.668801 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:18:34.668801 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:18:34.673407 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:18:34.673407 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:18:34.673407 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:18:34.673407 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:18:34.673407 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:18:34.673407 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:18:34.673407 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:18:34.673407 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:18:34.673407 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:18:34.673407 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:18:34.673407 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:18:34.673407 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:18:34.673407 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:18:34.673407 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:18:34.673407 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:18:34.673407 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:18:34.673407 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:18:34.675176 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:18:34.675176 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:18:34.675176 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:18:34.675176 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:18:34.675176 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 608/1224] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:18:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:18:34.676489 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1703a671-5227-4ebc-892b-135f9404f9c1 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:34.774746 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1703a671-5227-4ebc-892b-135f9404f9c1 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:34.807395 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93148441-4c9a-4649-9a6b-2f7e389bf21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:34.808044 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93148441-4c9a-4649-9a6b-2f7e389bf21a None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:34.808357 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93148441-4c9a-4649-9a6b-2f7e389bf21a None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:34.808633 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93148441-4c9a-4649-9a6b-2f7e389bf21a None admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:34.809350 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93148441-4c9a-4649-9a6b-2f7e389bf21a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:18:34.809654 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93148441-4c9a-4649-9a6b-2f7e389bf21a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:34.811006 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93148441-4c9a-4649-9a6b-2f7e389bf21a None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:34.822620 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 617/1225] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:18:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:18:34.828544 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c60648-292d-408e-9fdc-d4a75d4d4652 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:34.926224 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:34.932685 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c60648-292d-408e-9fdc-d4a75d4d4652 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:34.966098 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1ba07-ccc4-4c79-b397-d7c8281a0cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:34.966890 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1ba07-ccc4-4c79-b397-d7c8281a0cda None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:34.967167 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1ba07-ccc4-4c79-b397-d7c8281a0cda None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:34.967438 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1ba07-ccc4-4c79-b397-d7c8281a0cda None admin] PATH_INFO: `/v3/users/placement` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:34.975552 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c1ba07-ccc4-4c79-b397-d7c8281a0cda None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:34.977012 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c1ba07-ccc4-4c79-b397-d7c8281a0cda None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:34.991107 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-b6c1ba07-ccc4-4c79-b397-d7c8281a0cda None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 27 09:18:34.991107 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:18:34.991107 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:18:34.991107 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:18:34.991107 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:18:34.991107 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:18:34.991107 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:18:34.991107 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:18:34.991107 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:18:34.991107 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:18:34.991107 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:18:34.991107 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:18:34.991107 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 09:18:34.991107 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 09:18:34.991107 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 09:18:34.991107 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 09:18:34.992259 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:18:34.992259 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:18:34.992259 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 09:18:34.992259 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:18:34.992259 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 09:18:34.992259 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:18:34.992259 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:18:34.992259 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:18:34.992259 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:18:34.992259 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:18:34.992259 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:18:34.992259 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:18:34.992259 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:18:34.992259 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:18:34.992259 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:18:34.992259 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:18:34.992259 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:18:34.992259 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:18:34.993519 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:18:34.993519 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:18:34.993519 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 09:18:34.993519 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 09:18:34.993519 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 09:18:34.993519 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 09:18:34.993519 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 09:18:34.993519 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 09:18:34.993519 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 27 09:18:34.993519 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:18:34.993519 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 609/1226] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:18:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:18:34.998460 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93148441-4c9a-4649-9a6b-2f7e389bf21a None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:35.045744 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:35.098435 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93148441-4c9a-4649-9a6b-2f7e389bf21a None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:35.135368 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d8f90-1a43-4b26-b8b0-812d38060403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:35.136064 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d8f90-1a43-4b26-b8b0-812d38060403 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:35.136390 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d8f90-1a43-4b26-b8b0-812d38060403 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:35.136665 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d8f90-1a43-4b26-b8b0-812d38060403 None admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:35.137494 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d8f90-1a43-4b26-b8b0-812d38060403 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:18:35.137802 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d8f90-1a43-4b26-b8b0-812d38060403 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:35.139228 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d8f90-1a43-4b26-b8b0-812d38060403 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:35.157123 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 618/1227] 10.222.0.62 () {56 vars in 1143 bytes} [Mon Jun 27 09:18:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:18:35.162740 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1ba07-ccc4-4c79-b397-d7c8281a0cda None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:35.266400 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1ba07-ccc4-4c79-b397-d7c8281a0cda None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:35.301259 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5750bb-f8f1-47f2-8792-b979d8765ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:35.302050 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5750bb-f8f1-47f2-8792-b979d8765ea2 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:35.302331 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5750bb-f8f1-47f2-8792-b979d8765ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:35.302607 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5750bb-f8f1-47f2-8792-b979d8765ea2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:35.313418 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5750bb-f8f1-47f2-8792-b979d8765ea2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:35.314868 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5750bb-f8f1-47f2-8792-b979d8765ea2 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:35.332722 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-4b5750bb-f8f1-47f2-8792-b979d8765ea2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:18:35.332722 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:18:35.332722 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:18:35.332722 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:18:35.332722 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:18:35.332722 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:18:35.332722 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:18:35.332722 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:18:35.332722 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:18:35.332722 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:18:35.332722 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:18:35.332722 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:18:35.332722 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:18:35.332722 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:18:35.332722 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:18:35.333809 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:18:35.333809 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:18:35.333809 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:18:35.333809 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:18:35.333809 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:18:35.333809 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:18:35.333809 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:18:35.333809 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:18:35.333809 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:18:35.333809 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:18:35.333809 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:18:35.333809 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:18:35.333809 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:18:35.333809 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:18:35.333809 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:18:35.333809 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:18:35.333809 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:18:35.334743 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:18:35.334743 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:18:35.334743 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:18:35.334743 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:18:35.334743 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 610/1228] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:18:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:18:35.339881 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d8f90-1a43-4b26-b8b0-812d38060403 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:35.439133 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d8f90-1a43-4b26-b8b0-812d38060403 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:35.442286 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:35.473605 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62cea74-6e60-475d-aab7-6ed5b3e72b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:35.474260 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62cea74-6e60-475d-aab7-6ed5b3e72b7f None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:35.474541 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62cea74-6e60-475d-aab7-6ed5b3e72b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:35.474817 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62cea74-6e60-475d-aab7-6ed5b3e72b7f None admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:35.475532 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62cea74-6e60-475d-aab7-6ed5b3e72b7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:18:35.475838 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62cea74-6e60-475d-aab7-6ed5b3e72b7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:35.477241 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62cea74-6e60-475d-aab7-6ed5b3e72b7f None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:35.488712 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 619/1229] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:18:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:18:35.494586 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5750bb-f8f1-47f2-8792-b979d8765ea2 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:35.505226 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:35.593901 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5750bb-f8f1-47f2-8792-b979d8765ea2 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:35.629510 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c57125b-3d91-4666-b385-bf0f49ec3bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:35.630306 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57125b-3d91-4666-b385-bf0f49ec3bf4 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:35.630589 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57125b-3d91-4666-b385-bf0f49ec3bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:35.630865 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57125b-3d91-4666-b385-bf0f49ec3bf4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:35.638044 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c57125b-3d91-4666-b385-bf0f49ec3bf4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:35.639494 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c57125b-3d91-4666-b385-bf0f49ec3bf4 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:35.654725 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-0c57125b-3d91-4666-b385-bf0f49ec3bf4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:18:35.654725 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:18:35.654725 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:18:35.654725 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:18:35.654725 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:18:35.654725 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:18:35.654725 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:18:35.654725 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:18:35.654725 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:18:35.654725 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:18:35.654725 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:18:35.654725 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:18:35.654725 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 09:18:35.654725 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 09:18:35.654725 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 09:18:35.655857 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 09:18:35.655857 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:18:35.655857 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:18:35.655857 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:18:35.655857 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:18:35.655857 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:18:35.655857 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:18:35.655857 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:18:35.655857 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:18:35.655857 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:18:35.655857 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:18:35.655857 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:18:35.655857 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:18:35.655857 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:18:35.655857 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:18:35.655857 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:18:35.655857 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:18:35.656824 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 09:18:35.656824 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 09:18:35.656824 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 09:18:35.656824 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 09:18:35.656824 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 09:18:35.656824 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 09:18:35.656824 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:18:35.656824 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:18:35.656824 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 611/1230] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:18:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:18:35.661723 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62cea74-6e60-475d-aab7-6ed5b3e72b7f None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:35.762053 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62cea74-6e60-475d-aab7-6ed5b3e72b7f None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:35.795600 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04eac8-d549-4f89-b7f6-07718f1f199f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:35.796266 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04eac8-d549-4f89-b7f6-07718f1f199f None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:35.796552 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04eac8-d549-4f89-b7f6-07718f1f199f None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:35.796835 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04eac8-d549-4f89-b7f6-07718f1f199f None admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:35.797617 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f04eac8-d549-4f89-b7f6-07718f1f199f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:18:35.797928 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f04eac8-d549-4f89-b7f6-07718f1f199f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:35.800041 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f04eac8-d549-4f89-b7f6-07718f1f199f None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:35.811908 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 620/1231] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Jun 27 09:18:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:18:35.817966 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c57125b-3d91-4666-b385-bf0f49ec3bf4 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:35.883219 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:35.917510 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c57125b-3d91-4666-b385-bf0f49ec3bf4 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:35.951104 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12aebea-3c5a-4faf-9b3c-e1f0551afd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:35.951985 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12aebea-3c5a-4faf-9b3c-e1f0551afd1f None admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:35.952293 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12aebea-3c5a-4faf-9b3c-e1f0551afd1f None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:35.952569 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12aebea-3c5a-4faf-9b3c-e1f0551afd1f None admin] PATH_INFO: `/v3/projects/4ba8e40538db4d89b93469b79322d20e/users/2bbaf738138b40b2a06bb63934f6608c/roles/197a0da3099d45e4bcb9233039c21d8f` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:35.966679 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12aebea-3c5a-4faf-9b3c-e1f0551afd1f None admin] RBAC: Authorizing `identity:create_grant(project_id=4ba8e40538db4d89b93469b79322d20e, user_id=2bbaf738138b40b2a06bb63934f6608c, role_id=197a0da3099d45e4bcb9233039c21d8f)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:35.968112 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12aebea-3c5a-4faf-9b3c-e1f0551afd1f None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:36.094938 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 612/1232] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Jun 27 09:18:35 2022] PUT /identity/v3/projects/4ba8e40538db4d89b93469b79322d20e/users/2bbaf738138b40b2a06bb63934f6608c/roles/197a0da3099d45e4bcb9233039c21d8f => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:18:38.137214 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18e387-ec9f-4278-a0d6-49e503b1a7db None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:38.137742 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18e387-ec9f-4278-a0d6-49e503b1a7db None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:38.137742 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18e387-ec9f-4278-a0d6-49e503b1a7db None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:38.139123 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 621/1233] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:18:38.144982 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de8341-8505-4b81-a813-b62abe606072 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:38.145373 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de8341-8505-4b81-a813-b62abe606072 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:38.145903 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de8341-8505-4b81-a813-b62abe606072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:38.162622 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-85de8341-8505-4b81-a813-b62abe606072 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:18:38.163816 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-85de8341-8505-4b81-a813-b62abe606072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:18:38.231474 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 613/1234] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:18:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 09:18:38.255848 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18e387-ec9f-4278-a0d6-49e503b1a7db None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:38.281639 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:38.355456 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18e387-ec9f-4278-a0d6-49e503b1a7db None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:38.390014 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051ae96-8460-40a9-bc7d-570cbc9484c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:38.390719 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051ae96-8460-40a9-bc7d-570cbc9484c4 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:38.390991 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051ae96-8460-40a9-bc7d-570cbc9484c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:38.391262 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051ae96-8460-40a9-bc7d-570cbc9484c4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:38.401717 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b051ae96-8460-40a9-bc7d-570cbc9484c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:18:38.409349 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-b051ae96-8460-40a9-bc7d-570cbc9484c4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 09:18:38.409349 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:18:38.409349 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:18:38.409349 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:18:38.409349 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:18:38.409349 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:18:38.409349 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:18:38.409349 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:18:38.409349 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:18:38.409349 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:18:38.409349 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:18:38.409349 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:18:38.409349 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:18:38.409349 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:18:38.409349 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:18:38.409349 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:18:38.410477 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:18:38.410477 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:18:38.410477 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:18:38.410477 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:18:38.410477 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:18:38.410477 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:18:38.410477 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:18:38.410477 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:18:38.410477 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:18:38.410477 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:18:38.410477 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:18:38.410477 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:18:38.410477 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:18:38.410477 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:18:38.410477 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:18:38.410477 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:18:38.411666 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:18:38.411666 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:18:38.411666 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:18:38.411666 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:18:38.411666 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:18:38.411666 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:18:38.411666 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:18:38.411666 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:18:38.411666 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:18:38.411666 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:18:38.411666 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 09:18:38.411666 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:18:38.411666 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 622/1235] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Jun 27 09:18:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:18:38.416755 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de8341-8505-4b81-a813-b62abe606072 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:38.462673 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:38.513956 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de8341-8505-4b81-a813-b62abe606072 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:38.547304 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83729849-e3f3-4327-a122-4abcc9b63c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:38.547980 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83729849-e3f3-4327-a122-4abcc9b63c80 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:38.548286 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83729849-e3f3-4327-a122-4abcc9b63c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:38.548559 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83729849-e3f3-4327-a122-4abcc9b63c80 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:38.549846 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83729849-e3f3-4327-a122-4abcc9b63c80 None admin] RBAC: Adding query filter params (name=service) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:18:38.550156 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83729849-e3f3-4327-a122-4abcc9b63c80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:38.551515 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83729849-e3f3-4327-a122-4abcc9b63c80 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:38.559560 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 614/1236] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Jun 27 09:18:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:18:38.566073 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051ae96-8460-40a9-bc7d-570cbc9484c4 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:38.660102 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:38.676026 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051ae96-8460-40a9-bc7d-570cbc9484c4 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:38.710770 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8e0d34-b827-4560-b84d-f1de4c15df57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:38.711555 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e0d34-b827-4560-b84d-f1de4c15df57 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:38.711838 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e0d34-b827-4560-b84d-f1de4c15df57 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:38.712116 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e0d34-b827-4560-b84d-f1de4c15df57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:38.722756 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8e0d34-b827-4560-b84d-f1de4c15df57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:38.724301 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8e0d34-b827-4560-b84d-f1de4c15df57 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:38.742437 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-1d8e0d34-b827-4560-b84d-f1de4c15df57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:18:38.742437 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:18:38.742437 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:18:38.742437 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:18:38.742437 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:18:38.742437 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:18:38.742437 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:18:38.742437 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:18:38.742437 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:18:38.742437 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:18:38.742437 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:18:38.742437 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:18:38.742437 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:18:38.742437 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:18:38.742437 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:18:38.743341 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:18:38.743341 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:18:38.743341 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:18:38.743341 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:18:38.743341 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:18:38.743341 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:18:38.743341 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:18:38.743341 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:18:38.743341 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:18:38.743341 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:18:38.743341 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:18:38.743341 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:18:38.743341 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:18:38.743341 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:18:38.743341 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:18:38.743341 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:18:38.743341 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:18:38.744440 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:18:38.744440 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:18:38.744440 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:18:38.744440 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:18:38.744440 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 623/1237] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:18:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:18:38.749420 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83729849-e3f3-4327-a122-4abcc9b63c80 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:38.848673 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83729849-e3f3-4327-a122-4abcc9b63c80 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:38.857650 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:38.881764 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f61e36-9c18-4465-9bb8-9e8756787228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:38.882406 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f61e36-9c18-4465-9bb8-9e8756787228 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:38.882682 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f61e36-9c18-4465-9bb8-9e8756787228 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:38.882951 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f61e36-9c18-4465-9bb8-9e8756787228 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:38.883658 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f61e36-9c18-4465-9bb8-9e8756787228 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:18:38.883960 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f61e36-9c18-4465-9bb8-9e8756787228 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:38.885404 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f61e36-9c18-4465-9bb8-9e8756787228 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:38.896976 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 615/1238] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:18:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:18:38.902728 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8e0d34-b827-4560-b84d-f1de4c15df57 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:39.002008 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8e0d34-b827-4560-b84d-f1de4c15df57 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:39.036147 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3035ec0-4ca4-4107-82b1-0ca240de016c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:39.036971 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3035ec0-4ca4-4107-82b1-0ca240de016c None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:39.037255 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3035ec0-4ca4-4107-82b1-0ca240de016c None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:39.037569 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3035ec0-4ca4-4107-82b1-0ca240de016c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:39.040292 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:39.044674 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3035ec0-4ca4-4107-82b1-0ca240de016c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:39.046126 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3035ec0-4ca4-4107-82b1-0ca240de016c None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:39.062581 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-a3035ec0-4ca4-4107-82b1-0ca240de016c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 27 09:18:39.062581 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:18:39.062581 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:18:39.062581 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:18:39.062581 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:18:39.062581 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:18:39.062581 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:18:39.062581 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:18:39.062581 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:18:39.062581 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:18:39.062581 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:18:39.062581 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:18:39.062581 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 09:18:39.062581 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 09:18:39.062581 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 09:18:39.062581 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 09:18:39.067436 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:18:39.067436 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:18:39.067436 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 09:18:39.067436 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:18:39.067436 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 09:18:39.067436 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:18:39.067436 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:18:39.067436 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:18:39.067436 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:18:39.067436 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:18:39.067436 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:18:39.067436 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:18:39.067436 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:18:39.067436 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:18:39.067436 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:18:39.067436 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:18:39.067436 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:18:39.067436 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:18:39.068649 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:18:39.068649 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:18:39.068649 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 09:18:39.068649 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 09:18:39.068649 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 09:18:39.068649 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 09:18:39.068649 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 09:18:39.068649 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 09:18:39.068649 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 27 09:18:39.068649 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:18:39.068649 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 624/1239] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:18:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:18:39.069762 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f61e36-9c18-4465-9bb8-9e8756787228 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:39.171349 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f61e36-9c18-4465-9bb8-9e8756787228 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:39.204679 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490c797-32bf-4119-96c6-b97ce4e6cc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:39.205334 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490c797-32bf-4119-96c6-b97ce4e6cc3b None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:39.206111 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490c797-32bf-4119-96c6-b97ce4e6cc3b None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:39.206387 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490c797-32bf-4119-96c6-b97ce4e6cc3b None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:39.207218 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8490c797-32bf-4119-96c6-b97ce4e6cc3b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:18:39.207525 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8490c797-32bf-4119-96c6-b97ce4e6cc3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:39.208967 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8490c797-32bf-4119-96c6-b97ce4e6cc3b None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:39.226587 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 616/1240] 10.222.0.62 () {56 vars in 1143 bytes} [Mon Jun 27 09:18:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:18:39.232374 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3035ec0-4ca4-4107-82b1-0ca240de016c None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:39.335732 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3035ec0-4ca4-4107-82b1-0ca240de016c None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:39.372558 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdad9d8-25fd-4ec0-873e-04b025769e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:39.381200 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdad9d8-25fd-4ec0-873e-04b025769e0b None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:39.381200 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdad9d8-25fd-4ec0-873e-04b025769e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:39.381200 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdad9d8-25fd-4ec0-873e-04b025769e0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:39.434922 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:39.441830 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdad9d8-25fd-4ec0-873e-04b025769e0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:39.443321 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdad9d8-25fd-4ec0-873e-04b025769e0b None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:39.537111 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 625/1241] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:18:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 09:18:39.543007 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490c797-32bf-4119-96c6-b97ce4e6cc3b None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:39.572275 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:39.646897 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490c797-32bf-4119-96c6-b97ce4e6cc3b None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:39.681750 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c30f145-a1c3-49c2-a403-0af20c050d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:39.682535 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30f145-a1c3-49c2-a403-0af20c050d20 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:39.682817 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30f145-a1c3-49c2-a403-0af20c050d20 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:39.683090 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30f145-a1c3-49c2-a403-0af20c050d20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:39.694210 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c30f145-a1c3-49c2-a403-0af20c050d20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:39.695662 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c30f145-a1c3-49c2-a403-0af20c050d20 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:39.714470 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-6c30f145-a1c3-49c2-a403-0af20c050d20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:18:39.714470 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:18:39.714470 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:18:39.714470 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:18:39.714470 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:18:39.714470 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:18:39.714470 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:18:39.714470 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:18:39.714470 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:18:39.714470 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:18:39.714470 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:18:39.714470 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:18:39.714470 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:18:39.714470 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:18:39.714470 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:18:39.715595 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:18:39.715595 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:18:39.715595 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:18:39.715595 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:18:39.715595 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:18:39.715595 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:18:39.715595 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:18:39.715595 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:18:39.715595 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:18:39.715595 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:18:39.715595 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:18:39.715595 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:18:39.715595 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:18:39.715595 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:18:39.715595 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:18:39.715595 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:18:39.715595 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:18:39.716597 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:18:39.716597 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:18:39.716597 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:18:39.716597 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:18:39.716597 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 617/1242] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:18:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:18:39.721462 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdad9d8-25fd-4ec0-873e-04b025769e0b None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:39.816648 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:39.822273 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdad9d8-25fd-4ec0-873e-04b025769e0b None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:39.855620 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb8467-cb3f-4c85-ae58-c2c306b1ad7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:39.856345 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb8467-cb3f-4c85-ae58-c2c306b1ad7d None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:39.856626 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb8467-cb3f-4c85-ae58-c2c306b1ad7d None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:39.856897 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb8467-cb3f-4c85-ae58-c2c306b1ad7d None admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:39.857607 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeb8467-cb3f-4c85-ae58-c2c306b1ad7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:18:39.857917 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeb8467-cb3f-4c85-ae58-c2c306b1ad7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:39.859265 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeb8467-cb3f-4c85-ae58-c2c306b1ad7d None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:39.870658 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 626/1243] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:18:39.876763 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c30f145-a1c3-49c2-a403-0af20c050d20 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:39.958410 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:39.983316 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c30f145-a1c3-49c2-a403-0af20c050d20 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:40.022012 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23fb4aa-9502-4b98-8043-e05ab01360b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:40.022789 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23fb4aa-9502-4b98-8043-e05ab01360b3 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:40.023063 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23fb4aa-9502-4b98-8043-e05ab01360b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:40.023331 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23fb4aa-9502-4b98-8043-e05ab01360b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:40.030399 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23fb4aa-9502-4b98-8043-e05ab01360b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:40.031816 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23fb4aa-9502-4b98-8043-e05ab01360b3 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:40.045138 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-b23fb4aa-9502-4b98-8043-e05ab01360b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:18:40.045138 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:18:40.045138 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:18:40.045138 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:18:40.045138 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:18:40.045138 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:18:40.045138 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:18:40.045138 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:18:40.045138 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:18:40.045138 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:18:40.045138 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:18:40.045138 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:18:40.045138 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 09:18:40.045138 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 09:18:40.045138 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 09:18:40.046646 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 09:18:40.046646 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:18:40.046646 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:18:40.046646 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:18:40.046646 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:18:40.046646 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:18:40.046646 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:18:40.046646 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:18:40.046646 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:18:40.046646 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:18:40.046646 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:18:40.046646 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:18:40.046646 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:18:40.046646 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:18:40.046646 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:18:40.046646 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:18:40.046646 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:18:40.047712 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 09:18:40.047712 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 09:18:40.047712 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 09:18:40.047712 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 09:18:40.047712 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 09:18:40.047712 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 09:18:40.047712 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:18:40.047712 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:18:40.047712 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 618/1244] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:18:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:18:40.052776 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb8467-cb3f-4c85-ae58-c2c306b1ad7d None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:40.154545 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb8467-cb3f-4c85-ae58-c2c306b1ad7d None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:40.188126 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e6238-3781-43e8-9c4d-d52d3c3831a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:40.188815 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e6238-3781-43e8-9c4d-d52d3c3831a2 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:40.189098 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e6238-3781-43e8-9c4d-d52d3c3831a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:40.189373 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e6238-3781-43e8-9c4d-d52d3c3831a2 None admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:40.190749 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e6238-3781-43e8-9c4d-d52d3c3831a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:18:40.191055 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e6238-3781-43e8-9c4d-d52d3c3831a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:40.192523 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e6238-3781-43e8-9c4d-d52d3c3831a2 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:40.204688 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 627/1245] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Jun 27 09:18:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:18:40.210986 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23fb4aa-9502-4b98-8043-e05ab01360b3 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:40.319987 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23fb4aa-9502-4b98-8043-e05ab01360b3 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:40.357173 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2aa1ee-cf9f-47c8-b7a7-3e1bc1a89a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:40.357831 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2aa1ee-cf9f-47c8-b7a7-3e1bc1a89a8a None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:40.358115 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2aa1ee-cf9f-47c8-b7a7-3e1bc1a89a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:40.358446 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2aa1ee-cf9f-47c8-b7a7-3e1bc1a89a8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:40.359370 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2aa1ee-cf9f-47c8-b7a7-3e1bc1a89a8a None admin] RBAC: Adding query filter params (role.id=197a0da3099d45e4bcb9233039c21d8f, scope.project.id=4ba8e40538db4d89b93469b79322d20e, user.id=2bbaf738138b40b2a06bb63934f6608c) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:18:40.359681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2aa1ee-cf9f-47c8-b7a7-3e1bc1a89a8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:40.361143 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2aa1ee-cf9f-47c8-b7a7-3e1bc1a89a8a None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:40.367722 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 619/1246] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Jun 27 09:18:40 2022] GET /identity/v3/role_assignments?user.id=2bbaf738138b40b2a06bb63934f6608c&scope.project.id=4ba8e40538db4d89b93469b79322d20e&role.id=197a0da3099d45e4bcb9233039c21d8f => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:18:42.444825 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712ef14-0e25-4a84-a689-ace844607383 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:42.445377 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712ef14-0e25-4a84-a689-ace844607383 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:42.445377 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712ef14-0e25-4a84-a689-ace844607383 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:42.446648 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 628/1247] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:18:42.452051 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c665d-a79d-4a66-834b-d4be1a687865 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:42.452504 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c665d-a79d-4a66-834b-d4be1a687865 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:42.452643 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c665d-a79d-4a66-834b-d4be1a687865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:42.458400 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:42.470870 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-696c665d-a79d-4a66-834b-d4be1a687865 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:18:42.476034 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-696c665d-a79d-4a66-834b-d4be1a687865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:18:42.541489 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 620/1248] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:18:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 09:18:42.565475 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712ef14-0e25-4a84-a689-ace844607383 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:42.584077 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:42.671444 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712ef14-0e25-4a84-a689-ace844607383 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:42.709229 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd820cf7-5170-4277-bb5a-177fc68ece9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:42.709907 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd820cf7-5170-4277-bb5a-177fc68ece9f None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:42.710183 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd820cf7-5170-4277-bb5a-177fc68ece9f None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:42.710451 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd820cf7-5170-4277-bb5a-177fc68ece9f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:42.720592 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd820cf7-5170-4277-bb5a-177fc68ece9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:18:42.728160 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-fd820cf7-5170-4277-bb5a-177fc68ece9f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:18:42.728160 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:18:42.728160 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:18:42.728160 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:18:42.728160 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:18:42.728160 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:18:42.728160 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:18:42.728160 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:18:42.728160 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:18:42.728160 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:18:42.728160 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:18:42.728160 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:18:42.728160 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:18:42.728160 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:18:42.728160 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:18:42.728160 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:18:42.729325 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:18:42.729325 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:18:42.729325 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:18:42.729325 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:18:42.729325 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:18:42.729325 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:18:42.729325 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:18:42.729325 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:18:42.729325 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:18:42.729325 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:18:42.729325 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:18:42.729325 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:18:42.729325 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:18:42.729325 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:18:42.729325 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:18:42.729325 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:18:42.730554 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:18:42.730554 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:18:42.730554 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:18:42.730554 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:18:42.730554 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:18:42.730554 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:18:42.730554 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:18:42.730554 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:18:42.730554 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:18:42.730554 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:18:42.730554 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:18:42.730554 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:18:42.730554 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 629/1249] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Jun 27 09:18:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:18:42.735682 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c665d-a79d-4a66-834b-d4be1a687865 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:42.836624 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c665d-a79d-4a66-834b-d4be1a687865 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:42.866164 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:42.871247 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f28882-9246-43c5-97dc-dfdc1c35bc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:42.871910 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f28882-9246-43c5-97dc-dfdc1c35bc06 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:42.872188 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f28882-9246-43c5-97dc-dfdc1c35bc06 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:42.872489 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f28882-9246-43c5-97dc-dfdc1c35bc06 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:42.873235 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f28882-9246-43c5-97dc-dfdc1c35bc06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:18:42.873535 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f28882-9246-43c5-97dc-dfdc1c35bc06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:42.874895 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f28882-9246-43c5-97dc-dfdc1c35bc06 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:42.883154 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 621/1250] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:18:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:18:42.888938 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd820cf7-5170-4277-bb5a-177fc68ece9f None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:42.966763 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:42.990471 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd820cf7-5170-4277-bb5a-177fc68ece9f None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:43.024815 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0f884-94b4-4d12-9d4c-1ed2084c9960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:43.025599 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0f884-94b4-4d12-9d4c-1ed2084c9960 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:43.025877 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0f884-94b4-4d12-9d4c-1ed2084c9960 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:43.026148 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0f884-94b4-4d12-9d4c-1ed2084c9960 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:43.037324 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d0f884-94b4-4d12-9d4c-1ed2084c9960 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:43.038778 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d0f884-94b4-4d12-9d4c-1ed2084c9960 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:43.055561 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-51d0f884-94b4-4d12-9d4c-1ed2084c9960 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:18:43.055561 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:18:43.055561 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:18:43.055561 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:18:43.055561 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:18:43.055561 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:18:43.055561 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:18:43.055561 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:18:43.055561 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:18:43.055561 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:18:43.055561 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:18:43.055561 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:18:43.055561 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:18:43.055561 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:18:43.055561 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:18:43.056810 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:18:43.056810 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:18:43.056810 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:18:43.056810 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:18:43.056810 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:18:43.056810 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:18:43.056810 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:18:43.056810 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:18:43.056810 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:18:43.056810 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:18:43.056810 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:18:43.056810 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:18:43.056810 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:18:43.056810 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:18:43.056810 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:18:43.056810 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:18:43.056810 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:18:43.057955 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:18:43.057955 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:18:43.057955 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:18:43.057955 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:18:43.057955 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 630/1251] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:18:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:18:43.062756 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f28882-9246-43c5-97dc-dfdc1c35bc06 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:43.164851 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f28882-9246-43c5-97dc-dfdc1c35bc06 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:43.203136 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d3867-005e-44ce-848c-0ed1eeb3f5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:43.203793 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d3867-005e-44ce-848c-0ed1eeb3f5ad None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:43.204078 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d3867-005e-44ce-848c-0ed1eeb3f5ad None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:43.204388 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d3867-005e-44ce-848c-0ed1eeb3f5ad None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:43.205106 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d3867-005e-44ce-848c-0ed1eeb3f5ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:18:43.206028 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d3867-005e-44ce-848c-0ed1eeb3f5ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:43.207403 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d3867-005e-44ce-848c-0ed1eeb3f5ad None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:43.219578 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 622/1252] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:18:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:18:43.224921 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0f884-94b4-4d12-9d4c-1ed2084c9960 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:43.325237 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0f884-94b4-4d12-9d4c-1ed2084c9960 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:43.351514 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:43.359299 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f8a32-b465-4b6f-9dc6-4ed7f0ec0cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:43.360098 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f8a32-b465-4b6f-9dc6-4ed7f0ec0cd0 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:43.360411 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f8a32-b465-4b6f-9dc6-4ed7f0ec0cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:43.360691 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f8a32-b465-4b6f-9dc6-4ed7f0ec0cd0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:43.368189 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f8a32-b465-4b6f-9dc6-4ed7f0ec0cd0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:43.369657 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f8a32-b465-4b6f-9dc6-4ed7f0ec0cd0 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:43.384218 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-343f8a32-b465-4b6f-9dc6-4ed7f0ec0cd0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 27 09:18:43.384218 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:18:43.384218 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:18:43.384218 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:18:43.384218 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:18:43.384218 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:18:43.384218 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:18:43.384218 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:18:43.384218 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:18:43.384218 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:18:43.384218 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:18:43.384218 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:18:43.384218 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 09:18:43.384218 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 09:18:43.384218 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 09:18:43.384218 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 09:18:43.385602 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:18:43.385602 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:18:43.385602 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 09:18:43.385602 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:18:43.385602 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 09:18:43.385602 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:18:43.385602 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:18:43.385602 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:18:43.385602 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:18:43.385602 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:18:43.385602 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:18:43.385602 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:18:43.385602 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:18:43.385602 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:18:43.385602 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:18:43.385602 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:18:43.385602 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:18:43.385602 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:18:43.387503 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:18:43.387503 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:18:43.387503 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 09:18:43.387503 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 09:18:43.387503 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 09:18:43.387503 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 09:18:43.387503 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 09:18:43.387503 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 09:18:43.387503 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 27 09:18:43.387503 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:18:43.387503 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 631/1253] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:18:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:18:43.391307 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d3867-005e-44ce-848c-0ed1eeb3f5ad None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:43.449701 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:43.492978 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d3867-005e-44ce-848c-0ed1eeb3f5ad None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:43.528811 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac7eb1-2dc5-49a3-a703-f5f63842fca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:43.529467 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac7eb1-2dc5-49a3-a703-f5f63842fca7 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:43.529748 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac7eb1-2dc5-49a3-a703-f5f63842fca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:43.530017 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac7eb1-2dc5-49a3-a703-f5f63842fca7 None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:43.530958 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ac7eb1-2dc5-49a3-a703-f5f63842fca7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:18:43.531275 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ac7eb1-2dc5-49a3-a703-f5f63842fca7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:43.532722 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ac7eb1-2dc5-49a3-a703-f5f63842fca7 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:43.550244 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 623/1254] 10.222.0.62 () {56 vars in 1143 bytes} [Mon Jun 27 09:18:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:18:43.556011 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f8a32-b465-4b6f-9dc6-4ed7f0ec0cd0 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:43.654946 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f8a32-b465-4b6f-9dc6-4ed7f0ec0cd0 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:43.688999 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b26f6-029c-4e1f-9284-075372bb4444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:43.690186 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b26f6-029c-4e1f-9284-075372bb4444 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:43.690484 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b26f6-029c-4e1f-9284-075372bb4444 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:43.690755 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b26f6-029c-4e1f-9284-075372bb4444 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:43.745072 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:43.757523 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b26f6-029c-4e1f-9284-075372bb4444 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:43.759007 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b26f6-029c-4e1f-9284-075372bb4444 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:43.853729 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 632/1255] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:18:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 09:18:43.859545 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac7eb1-2dc5-49a3-a703-f5f63842fca7 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:43.959403 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac7eb1-2dc5-49a3-a703-f5f63842fca7 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:43.972650 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:43.993384 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3389161-4d13-40db-b65d-f28042070155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:43.994162 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3389161-4d13-40db-b65d-f28042070155 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:43.994439 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3389161-4d13-40db-b65d-f28042070155 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:43.994704 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3389161-4d13-40db-b65d-f28042070155 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:44.005556 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3389161-4d13-40db-b65d-f28042070155 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:44.005725 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3389161-4d13-40db-b65d-f28042070155 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:44.022685 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-b3389161-4d13-40db-b65d-f28042070155 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:18:44.022685 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:18:44.022685 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:18:44.022685 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:18:44.022685 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:18:44.022685 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:18:44.022685 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:18:44.022685 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:18:44.022685 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:18:44.022685 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:18:44.022685 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:18:44.022685 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:18:44.022685 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:18:44.022685 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:18:44.022685 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:18:44.023569 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:18:44.023569 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:18:44.023569 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:18:44.023569 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:18:44.023569 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:18:44.023569 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:18:44.023569 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:18:44.023569 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:18:44.023569 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:18:44.023569 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:18:44.023569 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:18:44.023569 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:18:44.023569 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:18:44.023569 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:18:44.023569 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:18:44.023569 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:18:44.023569 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:18:44.027110 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:18:44.027110 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:18:44.027110 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:18:44.027110 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:18:44.027110 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 624/1256] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:18:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:18:44.029539 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b26f6-029c-4e1f-9284-075372bb4444 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:44.118829 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:44.130796 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b26f6-029c-4e1f-9284-075372bb4444 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:44.165216 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe20ef2-d90e-429c-8ebd-a948c1e8d6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:44.165865 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe20ef2-d90e-429c-8ebd-a948c1e8d6dd None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:44.166144 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe20ef2-d90e-429c-8ebd-a948c1e8d6dd None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:44.166414 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe20ef2-d90e-429c-8ebd-a948c1e8d6dd None admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:44.167121 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe20ef2-d90e-429c-8ebd-a948c1e8d6dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:18:44.167421 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe20ef2-d90e-429c-8ebd-a948c1e8d6dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:44.168820 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe20ef2-d90e-429c-8ebd-a948c1e8d6dd None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:44.180380 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 633/1257] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:18:44.186138 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3389161-4d13-40db-b65d-f28042070155 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:44.285435 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3389161-4d13-40db-b65d-f28042070155 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:44.318864 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88b36c-f340-4fd7-a73d-bda7d970d207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:44.319652 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88b36c-f340-4fd7-a73d-bda7d970d207 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:44.319938 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88b36c-f340-4fd7-a73d-bda7d970d207 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:44.320229 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88b36c-f340-4fd7-a73d-bda7d970d207 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:44.326921 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88b36c-f340-4fd7-a73d-bda7d970d207 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:44.328389 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88b36c-f340-4fd7-a73d-bda7d970d207 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:44.342612 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-3a88b36c-f340-4fd7-a73d-bda7d970d207 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:18:44.342612 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:18:44.342612 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:18:44.342612 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:18:44.342612 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:18:44.342612 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:18:44.342612 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:18:44.342612 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:18:44.342612 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:18:44.342612 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:18:44.342612 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:18:44.342612 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:18:44.342612 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 09:18:44.342612 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 09:18:44.342612 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 09:18:44.343732 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 09:18:44.343732 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:18:44.343732 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:18:44.343732 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:18:44.343732 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:18:44.343732 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:18:44.343732 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:18:44.343732 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:18:44.343732 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:18:44.343732 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:18:44.343732 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:18:44.343732 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:18:44.343732 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:18:44.343732 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:18:44.343732 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:18:44.343732 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:18:44.343732 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:18:44.344996 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 09:18:44.344996 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 09:18:44.344996 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 09:18:44.344996 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 09:18:44.344996 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 09:18:44.344996 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 09:18:44.344996 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:18:44.344996 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:18:44.344996 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 625/1258] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:18:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:18:44.350427 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe20ef2-d90e-429c-8ebd-a948c1e8d6dd None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:44.448858 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe20ef2-d90e-429c-8ebd-a948c1e8d6dd None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:44.482847 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e7004-7022-4c10-bd04-3f052f7405a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:44.483501 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e7004-7022-4c10-bd04-3f052f7405a2 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:44.483785 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e7004-7022-4c10-bd04-3f052f7405a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:44.484063 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e7004-7022-4c10-bd04-3f052f7405a2 None admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:44.484869 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e7004-7022-4c10-bd04-3f052f7405a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:18:44.485178 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e7004-7022-4c10-bd04-3f052f7405a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:44.486603 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e7004-7022-4c10-bd04-3f052f7405a2 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:44.498543 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 634/1259] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Jun 27 09:18:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:18:44.504846 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88b36c-f340-4fd7-a73d-bda7d970d207 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:44.531192 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:44.604417 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88b36c-f340-4fd7-a73d-bda7d970d207 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:44.638991 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a146cae-e395-4b23-9748-801c644e6365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:44.639636 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a146cae-e395-4b23-9748-801c644e6365 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:44.639916 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a146cae-e395-4b23-9748-801c644e6365 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:44.640189 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a146cae-e395-4b23-9748-801c644e6365 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:44.641034 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a146cae-e395-4b23-9748-801c644e6365 None admin] RBAC: Adding query filter params (role.id=91c77942515d45f1ad8189c9fddf4424, scope.project.id=4ba8e40538db4d89b93469b79322d20e, user.id=2bbaf738138b40b2a06bb63934f6608c) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:18:44.641343 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a146cae-e395-4b23-9748-801c644e6365 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:44.642760 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a146cae-e395-4b23-9748-801c644e6365 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:44.653895 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 626/1260] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Jun 27 09:18:44 2022] GET /identity/v3/role_assignments?user.id=2bbaf738138b40b2a06bb63934f6608c&scope.project.id=4ba8e40538db4d89b93469b79322d20e&role.id=91c77942515d45f1ad8189c9fddf4424 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:18:46.649668 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11aca21-3af4-4cc2-b893-20a58c6dde98 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:46.650204 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11aca21-3af4-4cc2-b893-20a58c6dde98 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:46.650204 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11aca21-3af4-4cc2-b893-20a58c6dde98 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:46.651568 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 635/1261] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:18:46.657004 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58f1df-dab6-47c3-a5c8-a421fc1632a7 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:46.657449 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58f1df-dab6-47c3-a5c8-a421fc1632a7 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:46.657542 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58f1df-dab6-47c3-a5c8-a421fc1632a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:46.680287 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-bb58f1df-dab6-47c3-a5c8-a421fc1632a7 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:18:46.681540 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-bb58f1df-dab6-47c3-a5c8-a421fc1632a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:18:46.747879 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 627/1262] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:18:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 09:18:46.771527 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11aca21-3af4-4cc2-b893-20a58c6dde98 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:46.782270 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:46.872144 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11aca21-3af4-4cc2-b893-20a58c6dde98 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:46.906519 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23d6a0-1fe7-455f-a4fc-fd5efd8acbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:46.907234 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23d6a0-1fe7-455f-a4fc-fd5efd8acbe9 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:46.907520 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23d6a0-1fe7-455f-a4fc-fd5efd8acbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:46.907797 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23d6a0-1fe7-455f-a4fc-fd5efd8acbe9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:46.919146 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23d6a0-1fe7-455f-a4fc-fd5efd8acbe9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:18:46.927361 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-7e23d6a0-1fe7-455f-a4fc-fd5efd8acbe9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:18:46.927361 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:18:46.927361 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:18:46.927361 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:18:46.927361 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:18:46.927361 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:18:46.927361 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:18:46.927361 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:18:46.927361 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:18:46.927361 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:18:46.927361 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:18:46.927361 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:18:46.927361 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:18:46.927361 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:18:46.927361 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:18:46.927361 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:18:46.928576 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:18:46.928576 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:18:46.928576 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:18:46.928576 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:18:46.928576 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:18:46.928576 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:18:46.928576 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:18:46.928576 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:18:46.928576 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:18:46.928576 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:18:46.928576 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:18:46.928576 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:18:46.928576 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:18:46.928576 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:18:46.928576 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:18:46.928576 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:18:46.929436 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:18:46.929436 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:18:46.929436 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:18:46.929436 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:18:46.929436 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:18:46.929436 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:18:46.929436 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:18:46.929436 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:18:46.929436 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:18:46.929436 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:18:46.929436 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:18:46.929436 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:18:46.929436 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 636/1263] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Jun 27 09:18:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:18:46.934775 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58f1df-dab6-47c3-a5c8-a421fc1632a7 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:46.953126 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:47.033294 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58f1df-dab6-47c3-a5c8-a421fc1632a7 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:47.067897 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc5397-8772-4c0f-a677-7d6404f2b590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:47.068594 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc5397-8772-4c0f-a677-7d6404f2b590 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:47.068884 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc5397-8772-4c0f-a677-7d6404f2b590 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:47.069162 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc5397-8772-4c0f-a677-7d6404f2b590 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:47.069904 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc5397-8772-4c0f-a677-7d6404f2b590 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:18:47.070213 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc5397-8772-4c0f-a677-7d6404f2b590 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:47.071576 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc5397-8772-4c0f-a677-7d6404f2b590 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:47.080422 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 628/1264] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:18:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:18:47.086109 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23d6a0-1fe7-455f-a4fc-fd5efd8acbe9 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:47.154884 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:47.192226 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23d6a0-1fe7-455f-a4fc-fd5efd8acbe9 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:47.224495 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd43bdf-b5b3-41b5-b689-4d01b8b9c0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:47.225272 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd43bdf-b5b3-41b5-b689-4d01b8b9c0f8 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:47.225593 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd43bdf-b5b3-41b5-b689-4d01b8b9c0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:47.225866 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd43bdf-b5b3-41b5-b689-4d01b8b9c0f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:47.236658 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd43bdf-b5b3-41b5-b689-4d01b8b9c0f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:47.238734 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd43bdf-b5b3-41b5-b689-4d01b8b9c0f8 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:47.256032 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-2dd43bdf-b5b3-41b5-b689-4d01b8b9c0f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:18:47.256032 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:18:47.256032 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:18:47.256032 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:18:47.256032 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:18:47.256032 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:18:47.256032 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:18:47.256032 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:18:47.256032 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:18:47.256032 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:18:47.256032 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:18:47.256032 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:18:47.256032 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:18:47.256032 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:18:47.256032 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:18:47.260438 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:18:47.260438 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:18:47.260438 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:18:47.260438 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:18:47.260438 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:18:47.260438 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:18:47.260438 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:18:47.260438 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:18:47.260438 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:18:47.260438 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:18:47.260438 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:18:47.260438 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:18:47.260438 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:18:47.260438 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:18:47.260438 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:18:47.260438 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:18:47.260438 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:18:47.261352 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:18:47.261352 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:18:47.261352 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:18:47.261352 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:18:47.261352 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 637/1265] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:18:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 09:18:47.263663 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc5397-8772-4c0f-a677-7d6404f2b590 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:47.346300 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:47.365278 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc5397-8772-4c0f-a677-7d6404f2b590 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:47.398411 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dda6bf-9952-477d-b3f6-1819d2d51af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:47.399067 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dda6bf-9952-477d-b3f6-1819d2d51af1 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:47.399350 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dda6bf-9952-477d-b3f6-1819d2d51af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:47.399627 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dda6bf-9952-477d-b3f6-1819d2d51af1 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:47.400376 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dda6bf-9952-477d-b3f6-1819d2d51af1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:18:47.400693 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dda6bf-9952-477d-b3f6-1819d2d51af1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:47.402063 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dda6bf-9952-477d-b3f6-1819d2d51af1 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:47.413722 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 629/1266] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:18:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:18:47.419519 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd43bdf-b5b3-41b5-b689-4d01b8b9c0f8 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:47.517776 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd43bdf-b5b3-41b5-b689-4d01b8b9c0f8 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:47.537864 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:47.551059 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff801d-ae92-460b-aa3a-4340e6ae9378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:47.551844 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff801d-ae92-460b-aa3a-4340e6ae9378 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:47.552124 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff801d-ae92-460b-aa3a-4340e6ae9378 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:47.552440 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff801d-ae92-460b-aa3a-4340e6ae9378 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:47.560914 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ff801d-ae92-460b-aa3a-4340e6ae9378 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:47.562357 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ff801d-ae92-460b-aa3a-4340e6ae9378 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:47.576298 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-06ff801d-ae92-460b-aa3a-4340e6ae9378 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 27 09:18:47.576298 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:18:47.576298 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:18:47.576298 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:18:47.576298 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:18:47.576298 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:18:47.576298 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:18:47.576298 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:18:47.576298 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:18:47.576298 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:18:47.576298 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:18:47.576298 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:18:47.576298 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 09:18:47.576298 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 09:18:47.576298 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 09:18:47.576298 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 09:18:47.577468 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:18:47.577468 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:18:47.577468 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 09:18:47.577468 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:18:47.577468 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 09:18:47.577468 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:18:47.577468 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:18:47.577468 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:18:47.577468 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:18:47.577468 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:18:47.577468 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:18:47.577468 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:18:47.577468 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:18:47.577468 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:18:47.577468 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:18:47.577468 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:18:47.577468 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:18:47.577468 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:18:47.578566 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:18:47.578566 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:18:47.578566 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 09:18:47.578566 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 09:18:47.578566 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 09:18:47.578566 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 09:18:47.578566 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 09:18:47.578566 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 09:18:47.578566 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 27 09:18:47.578566 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:18:47.578566 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 638/1267] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:18:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:18:47.584264 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dda6bf-9952-477d-b3f6-1819d2d51af1 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:47.684275 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dda6bf-9952-477d-b3f6-1819d2d51af1 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:47.718471 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55626be-1e25-46b9-8580-d263107ad998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:47.719218 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55626be-1e25-46b9-8580-d263107ad998 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:47.719502 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55626be-1e25-46b9-8580-d263107ad998 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:47.719779 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55626be-1e25-46b9-8580-d263107ad998 None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:47.720639 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55626be-1e25-46b9-8580-d263107ad998 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:18:47.720952 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55626be-1e25-46b9-8580-d263107ad998 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:47.722484 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55626be-1e25-46b9-8580-d263107ad998 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:47.731713 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:47.741050 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 630/1268] 10.222.0.62 () {56 vars in 1143 bytes} [Mon Jun 27 09:18:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:18:47.747793 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff801d-ae92-460b-aa3a-4340e6ae9378 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:47.855881 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff801d-ae92-460b-aa3a-4340e6ae9378 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:47.889051 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f44f8e-f291-4f3f-aa7f-e2e87dc0aa81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:47.889836 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f44f8e-f291-4f3f-aa7f-e2e87dc0aa81 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:47.890126 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f44f8e-f291-4f3f-aa7f-e2e87dc0aa81 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:47.890392 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f44f8e-f291-4f3f-aa7f-e2e87dc0aa81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:47.901701 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f44f8e-f291-4f3f-aa7f-e2e87dc0aa81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:47.903161 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f44f8e-f291-4f3f-aa7f-e2e87dc0aa81 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:47.919872 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-e2f44f8e-f291-4f3f-aa7f-e2e87dc0aa81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:18:47.919872 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:18:47.919872 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:18:47.919872 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:18:47.919872 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:18:47.919872 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:18:47.919872 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:18:47.919872 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:18:47.919872 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:18:47.919872 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:18:47.919872 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:18:47.919872 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:18:47.919872 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:18:47.919872 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:18:47.919872 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:18:47.920958 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:18:47.920958 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:18:47.920958 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:18:47.920958 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:18:47.920958 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:18:47.920958 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:18:47.920958 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:18:47.920958 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:18:47.920958 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:18:47.920958 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:18:47.920958 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:18:47.920958 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:18:47.920958 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:18:47.920958 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:18:47.920958 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:18:47.920958 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:18:47.920958 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:18:47.921915 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:18:47.921915 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:18:47.921915 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:18:47.921915 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:18:47.921915 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 639/1269] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:18:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:18:47.926916 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55626be-1e25-46b9-8580-d263107ad998 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:48.026347 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55626be-1e25-46b9-8580-d263107ad998 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:48.060348 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a096a-1643-4eed-829a-f9e1dc073e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:48.061006 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a096a-1643-4eed-829a-f9e1dc073e11 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:48.061291 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a096a-1643-4eed-829a-f9e1dc073e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:48.061567 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a096a-1643-4eed-829a-f9e1dc073e11 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:48.062283 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a096a-1643-4eed-829a-f9e1dc073e11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:18:48.062593 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a096a-1643-4eed-829a-f9e1dc073e11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:48.064073 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a096a-1643-4eed-829a-f9e1dc073e11 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:48.075820 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 631/1270] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:18:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:18:48.081739 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f44f8e-f291-4f3f-aa7f-e2e87dc0aa81 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:48.117967 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:48.188853 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f44f8e-f291-4f3f-aa7f-e2e87dc0aa81 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:48.222993 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4a7fc-5f81-4e3a-8d12-ce35143ffb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:48.223774 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4a7fc-5f81-4e3a-8d12-ce35143ffb2a None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:48.224055 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4a7fc-5f81-4e3a-8d12-ce35143ffb2a None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:48.224357 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4a7fc-5f81-4e3a-8d12-ce35143ffb2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:48.230835 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb4a7fc-5f81-4e3a-8d12-ce35143ffb2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:48.232374 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb4a7fc-5f81-4e3a-8d12-ce35143ffb2a None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:48.247581 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-ccb4a7fc-5f81-4e3a-8d12-ce35143ffb2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:18:48.247581 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:18:48.247581 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:18:48.247581 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:18:48.247581 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:18:48.247581 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:18:48.247581 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:18:48.247581 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:18:48.247581 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:18:48.247581 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:18:48.247581 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:18:48.247581 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:18:48.247581 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 09:18:48.247581 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 09:18:48.247581 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 09:18:48.248877 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 09:18:48.248877 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:18:48.248877 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:18:48.248877 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:18:48.248877 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:18:48.248877 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:18:48.248877 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:18:48.248877 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:18:48.248877 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:18:48.248877 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:18:48.248877 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:18:48.248877 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:18:48.248877 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:18:48.248877 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:18:48.248877 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:18:48.248877 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:18:48.248877 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:18:48.250180 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 09:18:48.250180 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 09:18:48.250180 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 09:18:48.250180 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 09:18:48.250180 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 09:18:48.250180 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 09:18:48.250180 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:18:48.250180 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:18:48.250180 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 640/1271] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:18:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:18:48.255311 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a096a-1643-4eed-829a-f9e1dc073e11 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:48.313465 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:48.359588 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a096a-1643-4eed-829a-f9e1dc073e11 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:48.392485 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d76b988-ff09-4aa7-bf22-978402178c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:48.393086 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76b988-ff09-4aa7-bf22-978402178c5a None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:48.394109 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76b988-ff09-4aa7-bf22-978402178c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:48.394501 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76b988-ff09-4aa7-bf22-978402178c5a None admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:48.396038 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d76b988-ff09-4aa7-bf22-978402178c5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:18:48.396374 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d76b988-ff09-4aa7-bf22-978402178c5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:48.397815 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d76b988-ff09-4aa7-bf22-978402178c5a None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:48.411257 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 632/1272] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Jun 27 09:18:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:18:48.417304 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4a7fc-5f81-4e3a-8d12-ce35143ffb2a None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:48.525640 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:48.537170 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4a7fc-5f81-4e3a-8d12-ce35143ffb2a None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:48.573321 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c3e48-e756-44de-9d2d-342088b80dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:48.574844 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c3e48-e756-44de-9d2d-342088b80dd7 None admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:48.575358 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c3e48-e756-44de-9d2d-342088b80dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:48.575819 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c3e48-e756-44de-9d2d-342088b80dd7 None admin] PATH_INFO: `/v3/projects/4ba8e40538db4d89b93469b79322d20e/users/2bbaf738138b40b2a06bb63934f6608c/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:48.577771 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4c3e48-e756-44de-9d2d-342088b80dd7 None admin] RBAC: Authorizing `identity:create_grant(project_id=4ba8e40538db4d89b93469b79322d20e, user_id=2bbaf738138b40b2a06bb63934f6608c, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:48.579217 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4c3e48-e756-44de-9d2d-342088b80dd7 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:48.696112 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 641/1273] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Jun 27 09:18:48 2022] PUT /identity/v3/projects/4ba8e40538db4d89b93469b79322d20e/users/2bbaf738138b40b2a06bb63934f6608c/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:18:50.789957 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcfbfc3-3885-49f0-8cf9-68d5acbce2fa None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:50.790531 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcfbfc3-3885-49f0-8cf9-68d5acbce2fa None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:50.790531 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcfbfc3-3885-49f0-8cf9-68d5acbce2fa None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:50.791893 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 633/1274] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:18:50.797171 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a2fe7-a010-434f-b70d-30e3d1714b28 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:50.797594 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a2fe7-a010-434f-b70d-30e3d1714b28 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:50.797724 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a2fe7-a010-434f-b70d-30e3d1714b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:50.814750 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-352a2fe7-a010-434f-b70d-30e3d1714b28 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:18:50.815987 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-352a2fe7-a010-434f-b70d-30e3d1714b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:18:50.885426 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 642/1275] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:18:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 09:18:50.910348 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcfbfc3-3885-49f0-8cf9-68d5acbce2fa None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:51.012908 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcfbfc3-3885-49f0-8cf9-68d5acbce2fa None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:51.031483 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:51.048652 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a2781-0b1e-4536-b639-9f4cacf89053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:51.049371 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a2781-0b1e-4536-b639-9f4cacf89053 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:51.050205 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a2781-0b1e-4536-b639-9f4cacf89053 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:51.050474 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a2781-0b1e-4536-b639-9f4cacf89053 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:51.064034 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399a2781-0b1e-4536-b639-9f4cacf89053 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 09:18:51.071969 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-399a2781-0b1e-4536-b639-9f4cacf89053 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:18:51.071969 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:18:51.071969 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:18:51.071969 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:18:51.071969 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:18:51.071969 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:18:51.071969 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:18:51.071969 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:18:51.071969 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:18:51.071969 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:18:51.071969 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:18:51.071969 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:18:51.071969 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 09:18:51.071969 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 09:18:51.071969 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 09:18:51.071969 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 09:18:51.073266 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 09:18:51.073266 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 09:18:51.073266 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 09:18:51.073266 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 09:18:51.073266 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:18:51.073266 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:18:51.073266 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:18:51.073266 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:18:51.073266 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:18:51.073266 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:18:51.073266 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:18:51.073266 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:18:51.073266 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:18:51.073266 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:18:51.073266 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:18:51.073266 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:18:51.074213 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:18:51.074213 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:18:51.074213 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:18:51.074213 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:18:51.074213 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 09:18:51.074213 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 09:18:51.074213 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 09:18:51.074213 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 09:18:51.074213 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 09:18:51.074213 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 09:18:51.074213 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 09:18:51.074213 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:18:51.074213 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 634/1276] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Jun 27 09:18:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:18:51.079697 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a2fe7-a010-434f-b70d-30e3d1714b28 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:51.167175 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:51.184596 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a2fe7-a010-434f-b70d-30e3d1714b28 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:51.217318 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9155961-0f5c-4694-b4e5-39662bedd28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:51.217972 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9155961-0f5c-4694-b4e5-39662bedd28a None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:51.218251 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9155961-0f5c-4694-b4e5-39662bedd28a None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:51.218522 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9155961-0f5c-4694-b4e5-39662bedd28a None admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:51.219252 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9155961-0f5c-4694-b4e5-39662bedd28a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:18:51.219552 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9155961-0f5c-4694-b4e5-39662bedd28a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:51.220929 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9155961-0f5c-4694-b4e5-39662bedd28a None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:51.229398 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 643/1277] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Jun 27 09:18:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:18:51.235109 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a2781-0b1e-4536-b639-9f4cacf89053 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:51.336793 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a2781-0b1e-4536-b639-9f4cacf89053 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:51.371489 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea70ac3-e98e-41ca-80bb-f3e770ad70f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:51.372305 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea70ac3-e98e-41ca-80bb-f3e770ad70f8 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:51.372585 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea70ac3-e98e-41ca-80bb-f3e770ad70f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:51.372858 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea70ac3-e98e-41ca-80bb-f3e770ad70f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:51.383289 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea70ac3-e98e-41ca-80bb-f3e770ad70f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:51.384765 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea70ac3-e98e-41ca-80bb-f3e770ad70f8 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:51.402558 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-0ea70ac3-e98e-41ca-80bb-f3e770ad70f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:18:51.402558 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:18:51.402558 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:18:51.402558 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:18:51.402558 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:18:51.402558 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:18:51.402558 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:18:51.402558 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:18:51.402558 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:18:51.402558 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:18:51.402558 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:18:51.402558 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:18:51.402558 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:18:51.402558 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:18:51.402558 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:18:51.404299 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:18:51.404299 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:18:51.404299 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:18:51.404299 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:18:51.404299 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:18:51.404299 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:18:51.404299 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:18:51.404299 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:18:51.404299 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:18:51.404299 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:18:51.404299 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:18:51.404299 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:18:51.404299 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:18:51.404299 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:18:51.404299 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:18:51.404299 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:18:51.404299 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:18:51.405303 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:18:51.405303 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:18:51.405303 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:18:51.405303 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:18:51.405303 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 635/1278] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:18:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:18:51.410254 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9155961-0f5c-4694-b4e5-39662bedd28a None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:51.510261 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9155961-0f5c-4694-b4e5-39662bedd28a None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:51.543768 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577d6ba-b5b6-4993-822b-a400a10e5677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:51.544461 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577d6ba-b5b6-4993-822b-a400a10e5677 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:51.544741 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577d6ba-b5b6-4993-822b-a400a10e5677 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:51.545013 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577d6ba-b5b6-4993-822b-a400a10e5677 None admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:51.545719 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0577d6ba-b5b6-4993-822b-a400a10e5677 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:18:51.546025 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0577d6ba-b5b6-4993-822b-a400a10e5677 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:51.547429 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0577d6ba-b5b6-4993-822b-a400a10e5677 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:51.558835 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 644/1279] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:18:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:18:51.564497 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea70ac3-e98e-41ca-80bb-f3e770ad70f8 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:51.595658 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:51.664185 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea70ac3-e98e-41ca-80bb-f3e770ad70f8 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:51.698919 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8917e6-b265-490f-b72f-ca7cd9924e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:51.699713 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8917e6-b265-490f-b72f-ca7cd9924e2c None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:51.699996 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8917e6-b265-490f-b72f-ca7cd9924e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:51.700298 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8917e6-b265-490f-b72f-ca7cd9924e2c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:51.707927 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8917e6-b265-490f-b72f-ca7cd9924e2c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:51.709399 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8917e6-b265-490f-b72f-ca7cd9924e2c None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:51.723939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-ce8917e6-b265-490f-b72f-ca7cd9924e2c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 27 09:18:51.723939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:18:51.723939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:18:51.723939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:18:51.723939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:18:51.723939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:18:51.723939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:18:51.723939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:18:51.723939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:18:51.723939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:18:51.723939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:18:51.723939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:18:51.723939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 09:18:51.723939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 09:18:51.723939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 09:18:51.723939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 09:18:51.725089 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:18:51.725089 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:18:51.725089 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 09:18:51.725089 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:18:51.725089 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 09:18:51.725089 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 09:18:51.725089 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:18:51.725089 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:18:51.725089 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:18:51.725089 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:18:51.725089 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:18:51.725089 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:18:51.725089 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:18:51.725089 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:18:51.725089 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:18:51.725089 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:18:51.725089 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:18:51.725089 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:18:51.726212 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:18:51.726212 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:18:51.726212 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 09:18:51.726212 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 09:18:51.726212 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 09:18:51.726212 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 09:18:51.726212 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 09:18:51.726212 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 09:18:51.726212 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 27 09:18:51.726212 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:18:51.726212 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 636/1280] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:18:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:18:51.731329 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577d6ba-b5b6-4993-822b-a400a10e5677 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:51.735212 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:51.829874 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577d6ba-b5b6-4993-822b-a400a10e5677 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:51.863198 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84be4e-fb41-4baf-911d-c4316960ffe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:51.863834 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84be4e-fb41-4baf-911d-c4316960ffe4 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:51.864120 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84be4e-fb41-4baf-911d-c4316960ffe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:51.864427 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84be4e-fb41-4baf-911d-c4316960ffe4 None admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:51.865253 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b84be4e-fb41-4baf-911d-c4316960ffe4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:18:51.865563 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b84be4e-fb41-4baf-911d-c4316960ffe4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:51.867025 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b84be4e-fb41-4baf-911d-c4316960ffe4 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:51.885342 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 645/1281] 10.222.0.62 () {56 vars in 1143 bytes} [Mon Jun 27 09:18:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:18:51.891243 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8917e6-b265-490f-b72f-ca7cd9924e2c None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:51.979084 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:51.988864 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8917e6-b265-490f-b72f-ca7cd9924e2c None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:52.023129 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346dbdbd-3688-4ce9-a3dd-9cf43ebab97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:52.024002 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346dbdbd-3688-4ce9-a3dd-9cf43ebab97d None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:52.024411 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346dbdbd-3688-4ce9-a3dd-9cf43ebab97d None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:52.024691 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346dbdbd-3688-4ce9-a3dd-9cf43ebab97d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:52.092046 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346dbdbd-3688-4ce9-a3dd-9cf43ebab97d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:52.093538 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346dbdbd-3688-4ce9-a3dd-9cf43ebab97d None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:52.183204 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:52.192842 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 637/1282] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Jun 27 09:18:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 09:18:52.198697 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84be4e-fb41-4baf-911d-c4316960ffe4 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:52.260684 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:52.298824 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84be4e-fb41-4baf-911d-c4316960ffe4 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:52.332818 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc1330-e8f6-4dfc-ad0f-8968e938f08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:52.333630 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc1330-e8f6-4dfc-ad0f-8968e938f08c None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:52.333917 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc1330-e8f6-4dfc-ad0f-8968e938f08c None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:52.334195 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc1330-e8f6-4dfc-ad0f-8968e938f08c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:52.344721 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dc1330-e8f6-4dfc-ad0f-8968e938f08c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:52.346814 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dc1330-e8f6-4dfc-ad0f-8968e938f08c None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:52.364586 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-79dc1330-e8f6-4dfc-ad0f-8968e938f08c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:18:52.364586 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:18:52.364586 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:18:52.364586 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:18:52.364586 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:18:52.364586 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:18:52.364586 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:18:52.364586 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:18:52.364586 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:18:52.364586 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:18:52.364586 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:18:52.364586 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:18:52.364586 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 09:18:52.364586 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 09:18:52.364586 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 09:18:52.365848 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 09:18:52.365848 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:18:52.365848 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:18:52.365848 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:18:52.365848 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:18:52.365848 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:18:52.365848 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:18:52.365848 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:18:52.365848 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:18:52.365848 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:18:52.365848 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:18:52.365848 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:18:52.365848 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:18:52.365848 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:18:52.365848 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:18:52.365848 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:18:52.365848 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:18:52.368134 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 09:18:52.368134 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 09:18:52.368134 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 09:18:52.368134 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:18:52.368134 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 646/1283] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:18:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:18:52.371872 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346dbdbd-3688-4ce9-a3dd-9cf43ebab97d None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:52.473851 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346dbdbd-3688-4ce9-a3dd-9cf43ebab97d None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:52.508534 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a04ff-97f4-46d8-ac37-b7e747bbe71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:52.509211 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a04ff-97f4-46d8-ac37-b7e747bbe71c None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:52.509472 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a04ff-97f4-46d8-ac37-b7e747bbe71c None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:52.509746 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a04ff-97f4-46d8-ac37-b7e747bbe71c None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:52.510455 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a04ff-97f4-46d8-ac37-b7e747bbe71c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:18:52.510759 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a04ff-97f4-46d8-ac37-b7e747bbe71c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:52.512121 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a04ff-97f4-46d8-ac37-b7e747bbe71c None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:52.523433 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 638/1284] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Jun 27 09:18:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:18:52.529049 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc1330-e8f6-4dfc-ad0f-8968e938f08c None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:52.630255 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc1330-e8f6-4dfc-ad0f-8968e938f08c None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:52.644774 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:52.666388 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf14ddd-745f-4ab4-8e95-d7a8c172f6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:52.667183 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf14ddd-745f-4ab4-8e95-d7a8c172f6f8 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:52.667459 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf14ddd-745f-4ab4-8e95-d7a8c172f6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:52.667735 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf14ddd-745f-4ab4-8e95-d7a8c172f6f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:52.675030 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf14ddd-745f-4ab4-8e95-d7a8c172f6f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:52.676540 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf14ddd-745f-4ab4-8e95-d7a8c172f6f8 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:52.689964 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application [None req-abf14ddd-745f-4ab4-8e95-d7a8c172f6f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:18:52.689964 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:18:52.689964 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:18:52.689964 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:18:52.689964 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:18:52.689964 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:18:52.689964 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:18:52.689964 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:18:52.689964 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:18:52.689964 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:18:52.689964 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:18:52.689964 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:18:52.689964 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 09:18:52.689964 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 09:18:52.689964 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 09:18:52.691081 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 09:18:52.691081 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:18:52.691081 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:18:52.691081 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:18:52.691081 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:18:52.691081 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:18:52.691081 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:18:52.691081 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:18:52.691081 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application with Lock( Jun 27 09:18:52.691081 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:18:52.691081 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:18:52.691081 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:18:52.691081 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:18:52.691081 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:18:52.691081 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:18:52.691081 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:18:52.691081 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:18:52.692185 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 09:18:52.692185 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 09:18:52.692185 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 09:18:52.692185 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 09:18:52.692185 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 09:18:52.692185 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 09:18:52.692185 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 09:18:52.692185 dv-cinder-847730-1-smb devstack@keystone.service[80306]: ERROR keystone.server.flask.application Jun 27 09:18:52.692185 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 647/1285] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Jun 27 09:18:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:18:52.697270 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a04ff-97f4-46d8-ac37-b7e747bbe71c None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:52.759781 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:52.808853 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a04ff-97f4-46d8-ac37-b7e747bbe71c None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:52.841232 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6304b-406c-4c64-85f3-9485a38aa78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:52.841884 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6304b-406c-4c64-85f3-9485a38aa78e None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:52.842169 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6304b-406c-4c64-85f3-9485a38aa78e None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:52.842444 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6304b-406c-4c64-85f3-9485a38aa78e None admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:52.843219 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e6304b-406c-4c64-85f3-9485a38aa78e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:18:52.843528 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e6304b-406c-4c64-85f3-9485a38aa78e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:52.844986 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e6304b-406c-4c64-85f3-9485a38aa78e None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:52.857219 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 639/1286] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Jun 27 09:18:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:18:52.863430 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf14ddd-745f-4ab4-8e95-d7a8c172f6f8 None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:52.964379 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf14ddd-745f-4ab4-8e95-d7a8c172f6f8 None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:52.997360 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45bb4f4-3cd3-4686-8000-4af2b1b59fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:52.998008 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bb4f4-3cd3-4686-8000-4af2b1b59fba None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:52.998288 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bb4f4-3cd3-4686-8000-4af2b1b59fba None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:52.998563 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bb4f4-3cd3-4686-8000-4af2b1b59fba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:52.999386 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45bb4f4-3cd3-4686-8000-4af2b1b59fba None admin] RBAC: Adding query filter params (role.id=91c77942515d45f1ad8189c9fddf4424, scope.project.id=4ba8e40538db4d89b93469b79322d20e, user.id=2bbaf738138b40b2a06bb63934f6608c) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:18:52.999698 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45bb4f4-3cd3-4686-8000-4af2b1b59fba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:53.001170 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45bb4f4-3cd3-4686-8000-4af2b1b59fba None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:53.007469 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 648/1287] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Jun 27 09:18:52 2022] GET /identity/v3/role_assignments?user.id=2bbaf738138b40b2a06bb63934f6608c&scope.project.id=4ba8e40538db4d89b93469b79322d20e&role.id=91c77942515d45f1ad8189c9fddf4424 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:18:55.076052 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf41cd0-fbcc-47ab-92b4-07d7207b0563 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:55.076666 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf41cd0-fbcc-47ab-92b4-07d7207b0563 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:55.076666 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf41cd0-fbcc-47ab-92b4-07d7207b0563 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:55.078024 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 640/1288] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:18:55.083305 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db0277-f931-4e87-b7eb-aaeb34a783c0 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:55.083696 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db0277-f931-4e87-b7eb-aaeb34a783c0 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:55.083958 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db0277-f931-4e87-b7eb-aaeb34a783c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:55.100778 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-03db0277-f931-4e87-b7eb-aaeb34a783c0 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:18:55.102001 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-03db0277-f931-4e87-b7eb-aaeb34a783c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:18:55.133226 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:55.172021 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 649/1289] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:18:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 09:18:55.199948 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf41cd0-fbcc-47ab-92b4-07d7207b0563 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:55.306565 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf41cd0-fbcc-47ab-92b4-07d7207b0563 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:55.317547 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:55.346875 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13206d77-3e34-4647-b6d4-5525a5f3d14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:55.346875 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13206d77-3e34-4647-b6d4-5525a5f3d14d None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:55.346875 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13206d77-3e34-4647-b6d4-5525a5f3d14d None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:55.346875 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13206d77-3e34-4647-b6d4-5525a5f3d14d None admin] PATH_INFO: `/v3/services/placement` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:55.347294 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13206d77-3e34-4647-b6d4-5525a5f3d14d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:55.347294 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13206d77-3e34-4647-b6d4-5525a5f3d14d None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:55.356953 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-13206d77-3e34-4647-b6d4-5525a5f3d14d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 27 09:18:55.356953 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:18:55.356953 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 09:18:55.356953 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 09:18:55.356953 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 09:18:55.356953 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 09:18:55.356953 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 09:18:55.356953 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 09:18:55.356953 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 27 09:18:55.356953 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:18:55.356953 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 09:18:55.356953 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:18:55.356953 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:18:55.356953 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:18:55.356953 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:18:55.356953 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:18:55.356953 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:18:55.358202 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:18:55.358202 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:18:55.358202 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:18:55.358202 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:18:55.358202 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:18:55.358202 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:18:55.358202 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 09:18:55.358202 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 09:18:55.358202 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 09:18:55.358202 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 09:18:55.358202 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:18:55.358202 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:18:55.358202 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:18:55.358202 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:18:55.358202 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:18:55.358202 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:18:55.359280 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:18:55.359280 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:18:55.359280 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:18:55.359280 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:18:55.359280 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:18:55.359280 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:18:55.359280 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:18:55.359280 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:18:55.359280 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:18:55.359280 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:18:55.359280 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 09:18:55.359280 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 09:18:55.359280 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 27 09:18:55.359280 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:18:55.359280 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 641/1290] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Jun 27 09:18:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:18:55.364935 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db0277-f931-4e87-b7eb-aaeb34a783c0 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:55.463911 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db0277-f931-4e87-b7eb-aaeb34a783c0 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:55.505129 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86ba67-d19c-4489-9b76-822475b5b7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:55.505784 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86ba67-d19c-4489-9b76-822475b5b7e1 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:55.506060 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86ba67-d19c-4489-9b76-822475b5b7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:55.506327 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86ba67-d19c-4489-9b76-822475b5b7e1 None admin] PATH_INFO: `/v3/services` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:55.507032 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d86ba67-d19c-4489-9b76-822475b5b7e1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:18:55.507335 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d86ba67-d19c-4489-9b76-822475b5b7e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:55.508739 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d86ba67-d19c-4489-9b76-822475b5b7e1 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:55.513756 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 650/1291] 10.222.0.62 () {56 vars in 1116 bytes} [Mon Jun 27 09:18:55 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:18:55.519890 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13206d77-3e34-4647-b6d4-5525a5f3d14d None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:55.646758 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13206d77-3e34-4647-b6d4-5525a5f3d14d None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:55.681600 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804e544-c9e1-4196-9171-66495521af6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:55.682493 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804e544-c9e1-4196-9171-66495521af6f None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:55.682794 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804e544-c9e1-4196-9171-66495521af6f None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:55.683071 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804e544-c9e1-4196-9171-66495521af6f None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:55.683770 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c804e544-c9e1-4196-9171-66495521af6f None admin] RBAC: Adding query filter params (type=placement) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:18:55.684075 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c804e544-c9e1-4196-9171-66495521af6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:55.685460 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c804e544-c9e1-4196-9171-66495521af6f None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:55.694389 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 642/1292] 10.222.0.62 () {56 vars in 1116 bytes} [Mon Jun 27 09:18:55 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:18:57.755496 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4dbce-a516-430c-a5f4-c2ab5c325e6c None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:57.756078 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4dbce-a516-430c-a5f4-c2ab5c325e6c None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:57.756078 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4dbce-a516-430c-a5f4-c2ab5c325e6c None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:57.757442 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 651/1293] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:18:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:18:57.762508 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631503c-27ca-4350-be6e-2507a8a2ea54 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:57.762957 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631503c-27ca-4350-be6e-2507a8a2ea54 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:57.763064 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631503c-27ca-4350-be6e-2507a8a2ea54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:57.781467 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-6631503c-27ca-4350-be6e-2507a8a2ea54 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:18:57.782662 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-6631503c-27ca-4350-be6e-2507a8a2ea54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:18:57.813010 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:57.849764 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 643/1294] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:18:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 09:18:57.873084 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f4dbce-a516-430c-a5f4-c2ab5c325e6c None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:18:57.904289 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:18:57.972639 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f4dbce-a516-430c-a5f4-c2ab5c325e6c None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:18:58.006661 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bee978-25c6-4e01-bd5c-8ba29cbde77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:18:58.007249 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bee978-25c6-4e01-bd5c-8ba29cbde77c None admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:18:58.007537 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bee978-25c6-4e01-bd5c-8ba29cbde77c None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:18:58.007807 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bee978-25c6-4e01-bd5c-8ba29cbde77c None admin] PATH_INFO: `/v3/services` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:18:58.008546 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bee978-25c6-4e01-bd5c-8ba29cbde77c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:18:58.009895 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bee978-25c6-4e01-bd5c-8ba29cbde77c None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:18:58.099268 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 652/1295] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Jun 27 09:18:57 2022] POST /identity/v3/services => generated 246 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:19:00.133588 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0a1b5-6273-43c0-97e0-a626b3dd04ee None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:19:00.134123 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0a1b5-6273-43c0-97e0-a626b3dd04ee None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:19:00.134123 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0a1b5-6273-43c0-97e0-a626b3dd04ee None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:19:00.135530 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 644/1296] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:19:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:19:00.140964 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814a93f-8af8-4771-b282-a1a3b06577bf None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:19:00.141405 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814a93f-8af8-4771-b282-a1a3b06577bf None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:19:00.141503 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814a93f-8af8-4771-b282-a1a3b06577bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:19:00.159527 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-5814a93f-8af8-4771-b282-a1a3b06577bf None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:19:00.160771 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-5814a93f-8af8-4771-b282-a1a3b06577bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:19:00.231914 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 653/1297] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:19:00 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 09:19:00.254985 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee0a1b5-6273-43c0-97e0-a626b3dd04ee None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:19:00.361011 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee0a1b5-6273-43c0-97e0-a626b3dd04ee None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:19:00.395042 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfaaadb-245a-4048-b72d-4c2078644539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:19:00.395753 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfaaadb-245a-4048-b72d-4c2078644539 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:19:00.396024 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfaaadb-245a-4048-b72d-4c2078644539 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:19:00.396328 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfaaadb-245a-4048-b72d-4c2078644539 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:19:00.396981 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfaaadb-245a-4048-b72d-4c2078644539 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:19:00.398358 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfaaadb-245a-4048-b72d-4c2078644539 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:19:00.410783 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-0cfaaadb-245a-4048-b72d-4c2078644539 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 27 09:19:00.410783 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:19:00.410783 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 09:19:00.410783 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 09:19:00.410783 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 09:19:00.410783 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 09:19:00.410783 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 09:19:00.410783 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 09:19:00.410783 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 27 09:19:00.410783 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:19:00.410783 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 09:19:00.410783 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:19:00.410783 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:19:00.410783 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:19:00.410783 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:19:00.410783 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:19:00.410783 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:19:00.411941 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:19:00.411941 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:19:00.411941 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:19:00.411941 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:19:00.411941 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:19:00.411941 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:19:00.411941 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 09:19:00.411941 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 09:19:00.411941 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 09:19:00.411941 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 09:19:00.411941 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:19:00.411941 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:19:00.411941 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:19:00.411941 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:19:00.411941 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:19:00.411941 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:19:00.412931 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:19:00.412931 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:19:00.412931 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:19:00.412931 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:19:00.412931 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:19:00.412931 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:19:00.412931 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:19:00.412931 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:19:00.412931 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:19:00.412931 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:19:00.412931 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 09:19:00.412931 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 09:19:00.412931 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 27 09:19:00.412931 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:19:00.412931 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 645/1298] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Jun 27 09:19:00 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:19:00.419030 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5814a93f-8af8-4771-b282-a1a3b06577bf None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:19:00.437295 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:19:00.518474 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5814a93f-8af8-4771-b282-a1a3b06577bf None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:19:00.551703 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f792483-8095-4a48-baa8-8e7397f8693f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:19:00.552392 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f792483-8095-4a48-baa8-8e7397f8693f None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:19:00.552673 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f792483-8095-4a48-baa8-8e7397f8693f None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:19:00.552946 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f792483-8095-4a48-baa8-8e7397f8693f None admin] PATH_INFO: `/v3/services` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:19:00.553653 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f792483-8095-4a48-baa8-8e7397f8693f None admin] RBAC: Adding query filter params (name=placement) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:19:00.553961 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f792483-8095-4a48-baa8-8e7397f8693f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:19:00.555325 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f792483-8095-4a48-baa8-8e7397f8693f None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:19:00.560555 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 654/1299] 10.222.0.62 () {56 vars in 1116 bytes} [Mon Jun 27 09:19:00 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:19:00.567221 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfaaadb-245a-4048-b72d-4c2078644539 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:19:00.599964 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:19:00.669108 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfaaadb-245a-4048-b72d-4c2078644539 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:19:00.702321 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a6a69-8cad-484d-bd06-34225062773a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:19:00.702971 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a6a69-8cad-484d-bd06-34225062773a None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:19:00.703252 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a6a69-8cad-484d-bd06-34225062773a None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:19:00.703526 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a6a69-8cad-484d-bd06-34225062773a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:19:00.704339 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a6a69-8cad-484d-bd06-34225062773a None admin] RBAC: Adding query filter params (interface=public, service_id=e94ba34842964b2e8372a79f0d6e21fb, region_id=RegionOne) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:19:00.704653 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a6a69-8cad-484d-bd06-34225062773a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:19:00.706580 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a6a69-8cad-484d-bd06-34225062773a None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:19:00.711602 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 646/1300] 10.222.0.62 () {56 vars in 1251 bytes} [Mon Jun 27 09:19:00 2022] GET /identity/v3/endpoints?service_id=e94ba34842964b2e8372a79f0d6e21fb&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:19:00.717363 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f792483-8095-4a48-baa8-8e7397f8693f None admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:19:00.805175 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:19:00.824500 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f792483-8095-4a48-baa8-8e7397f8693f None admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:19:00.857689 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a05a8-8797-4c20-a6da-7a8ca368ade2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:19:00.858337 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a05a8-8797-4c20-a6da-7a8ca368ade2 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:19:00.858616 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a05a8-8797-4c20-a6da-7a8ca368ade2 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:19:00.858886 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a05a8-8797-4c20-a6da-7a8ca368ade2 None admin] PATH_INFO: `/v3/services` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:19:00.859586 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373a05a8-8797-4c20-a6da-7a8ca368ade2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:19:00.860969 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373a05a8-8797-4c20-a6da-7a8ca368ade2 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:19:00.868125 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 655/1301] 10.222.0.62 () {56 vars in 1087 bytes} [Mon Jun 27 09:19:00 2022] GET /identity/v3/services => generated 2191 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:19:02.891403 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eded283-4815-4960-a54b-2d9b8e5e8034 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:19:02.891959 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eded283-4815-4960-a54b-2d9b8e5e8034 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:19:02.891959 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eded283-4815-4960-a54b-2d9b8e5e8034 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:19:02.894006 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 647/1302] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:19:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:19:02.899525 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faace14b-1235-4513-bba7-ebab1f43e9c1 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:19:02.899966 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faace14b-1235-4513-bba7-ebab1f43e9c1 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:19:02.900093 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faace14b-1235-4513-bba7-ebab1f43e9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:19:02.916618 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-faace14b-1235-4513-bba7-ebab1f43e9c1 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:19:02.917794 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-faace14b-1235-4513-bba7-ebab1f43e9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:19:02.983956 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 656/1303] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:19:02 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 09:19:03.007296 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eded283-4815-4960-a54b-2d9b8e5e8034 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:19:03.101005 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:19:03.107986 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eded283-4815-4960-a54b-2d9b8e5e8034 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:19:03.144479 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc4e8b5-0d0b-46de-8f75-894580304d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:19:03.145006 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4e8b5-0d0b-46de-8f75-894580304d48 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:19:03.145120 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4e8b5-0d0b-46de-8f75-894580304d48 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:19:03.145398 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4e8b5-0d0b-46de-8f75-894580304d48 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:19:03.146047 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc4e8b5-0d0b-46de-8f75-894580304d48 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:19:03.147408 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc4e8b5-0d0b-46de-8f75-894580304d48 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:19:03.159320 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-6cc4e8b5-0d0b-46de-8f75-894580304d48 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 27 09:19:03.159320 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:19:03.159320 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 09:19:03.159320 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 09:19:03.159320 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 09:19:03.159320 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 09:19:03.159320 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 09:19:03.159320 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 09:19:03.159320 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 27 09:19:03.159320 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:19:03.159320 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 09:19:03.159320 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:19:03.159320 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 09:19:03.159320 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 09:19:03.159320 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 09:19:03.159320 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 09:19:03.159320 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 09:19:03.160502 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 09:19:03.160502 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 09:19:03.160502 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 09:19:03.160502 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 09:19:03.160502 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 09:19:03.160502 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 09:19:03.160502 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 09:19:03.160502 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 09:19:03.160502 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 09:19:03.160502 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 09:19:03.160502 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 09:19:03.160502 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 09:19:03.160502 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 09:19:03.160502 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 09:19:03.160502 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 09:19:03.160502 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 09:19:03.161395 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 09:19:03.161395 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jun 27 09:19:03.161395 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 09:19:03.161395 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jun 27 09:19:03.161395 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 09:19:03.161395 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 09:19:03.161395 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 09:19:03.161395 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jun 27 09:19:03.161395 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 09:19:03.161395 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jun 27 09:19:03.161395 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 09:19:03.161395 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 09:19:03.161395 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 27 09:19:03.161395 dv-cinder-847730-1-smb devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jun 27 09:19:03.161395 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 648/1304] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Jun 27 09:19:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 09:19:03.166602 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faace14b-1235-4513-bba7-ebab1f43e9c1 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:19:03.241927 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:19:03.264332 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faace14b-1235-4513-bba7-ebab1f43e9c1 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:19:03.297251 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d5be1-4ef9-4662-847f-ce5d6e92cbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:19:03.297912 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d5be1-4ef9-4662-847f-ce5d6e92cbc5 None admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:19:03.298193 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d5be1-4ef9-4662-847f-ce5d6e92cbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:19:03.298471 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d5be1-4ef9-4662-847f-ce5d6e92cbc5 None admin] PATH_INFO: `/v3/services` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:19:03.299686 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d5be1-4ef9-4662-847f-ce5d6e92cbc5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:19:03.299992 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d5be1-4ef9-4662-847f-ce5d6e92cbc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:19:03.301434 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d5be1-4ef9-4662-847f-ce5d6e92cbc5 None admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:19:03.306542 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 657/1305] 10.222.0.62 () {56 vars in 1116 bytes} [Mon Jun 27 09:19:03 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:19:03.312261 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc4e8b5-0d0b-46de-8f75-894580304d48 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:19:03.416021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc4e8b5-0d0b-46de-8f75-894580304d48 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:19:03.450280 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b0143-19b9-46a0-ac5b-128295e649a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:19:03.450928 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b0143-19b9-46a0-ac5b-128295e649a1 None admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:19:03.451204 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b0143-19b9-46a0-ac5b-128295e649a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:19:03.451472 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b0143-19b9-46a0-ac5b-128295e649a1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:19:03.452226 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7b0143-19b9-46a0-ac5b-128295e649a1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:19:03.453586 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7b0143-19b9-46a0-ac5b-128295e649a1 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:19:03.540092 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 649/1306] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Jun 27 09:19:03 2022] POST /identity/v3/endpoints => generated 331 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:19:13.325646 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=30 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:19:13.535242 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:25:47.183170 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844464c-242c-419c-9845-4729160fff65 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:25:47.183170 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844464c-242c-419c-9845-4729160fff65 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:25:47.183170 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844464c-242c-419c-9845-4729160fff65 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:25:47.185572 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151e88f-6b0a-4947-bddd-e4df5a472c53 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:25:47.185975 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151e88f-6b0a-4947-bddd-e4df5a472c53 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:25:47.186130 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151e88f-6b0a-4947-bddd-e4df5a472c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:25:47.189523 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 658/1307] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:25:47 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:25:47.291352 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-f151e88f-6b0a-4947-bddd-e4df5a472c53 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:25:47.292911 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-f151e88f-6b0a-4947-bddd-e4df5a472c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:25:47.484761 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 650/1308] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:25:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:25:47.533054 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec88f9-9753-4eee-9754-5135f51c4570 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:25:47.533332 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec88f9-9753-4eee-9754-5135f51c4570 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:25:47.533802 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec88f9-9753-4eee-9754-5135f51c4570 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:25:47.535221 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 659/1309] 10.222.0.62 () {54 vars in 964 bytes} [Mon Jun 27 09:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:25:47.542092 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75dfa5d-bb46-4560-8c50-45f08bfb6754 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:25:47.542457 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75dfa5d-bb46-4560-8c50-45f08bfb6754 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:25:47.542800 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75dfa5d-bb46-4560-8c50-45f08bfb6754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:25:47.626902 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-d75dfa5d-bb46-4560-8c50-45f08bfb6754 None None] MFA Rules not processed for user `097b991d67164cda94cc5aa24397f414`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:25:47.628115 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-d75dfa5d-bb46-4560-8c50-45f08bfb6754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:25:47.652444 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:25:47.719442 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 651/1310] 10.222.0.62 () {58 vars in 1061 bytes} [Mon Jun 27 09:25:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:25:47.731539 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec88f9-9753-4eee-9754-5135f51c4570 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:25:47.733487 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-73ec88f9-9753-4eee-9754-5135f51c4570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:25:47.855622 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec88f9-9753-4eee-9754-5135f51c4570 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:25:47.934796 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c257379f-9568-4412-9a4f-d7cd625fcb3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:25:47.935363 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257379f-9568-4412-9a4f-d7cd625fcb3f service neutron] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:25:47.935646 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257379f-9568-4412-9a4f-d7cd625fcb3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:25:47.935921 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257379f-9568-4412-9a4f-d7cd625fcb3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:25:47.937605 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-c257379f-9568-4412-9a4f-d7cd625fcb3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:25:47.994280 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:25:48.056560 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c257379f-9568-4412-9a4f-d7cd625fcb3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:25:48.058035 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c257379f-9568-4412-9a4f-d7cd625fcb3f service neutron] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:25:48.085542 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 660/1311] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:25:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:25:50.471007 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695522c-f2e5-4457-bb72-ff318088be49 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:25:50.471529 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695522c-f2e5-4457-bb72-ff318088be49 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:25:50.471529 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695522c-f2e5-4457-bb72-ff318088be49 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:25:50.476942 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 652/1312] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:25:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:25:50.484518 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0976a-bd03-4d13-a2bc-c0b44792903b None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:25:50.485369 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0976a-bd03-4d13-a2bc-c0b44792903b None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:25:50.485648 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0976a-bd03-4d13-a2bc-c0b44792903b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:25:50.569531 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-30e0976a-bd03-4d13-a2bc-c0b44792903b None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:25:50.571020 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-30e0976a-bd03-4d13-a2bc-c0b44792903b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:25:50.690958 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 661/1313] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:25:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:25:50.744937 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216fe904-6478-4694-b12f-70b6c48a17f9 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:25:50.745363 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216fe904-6478-4694-b12f-70b6c48a17f9 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:25:50.745703 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216fe904-6478-4694-b12f-70b6c48a17f9 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:25:50.747186 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 653/1314] 10.222.0.62 () {54 vars in 964 bytes} [Mon Jun 27 09:25:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:25:50.753934 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7b0e0-7890-4ac7-9572-fc0e863bbdb8 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:25:50.754241 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7b0e0-7890-4ac7-9572-fc0e863bbdb8 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:25:50.754529 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7b0e0-7890-4ac7-9572-fc0e863bbdb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:25:50.767444 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:25:50.835044 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-f6e7b0e0-7890-4ac7-9572-fc0e863bbdb8 None None] MFA Rules not processed for user `097b991d67164cda94cc5aa24397f414`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:25:50.836276 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-f6e7b0e0-7890-4ac7-9572-fc0e863bbdb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:25:50.911134 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 662/1315] 10.222.0.62 () {58 vars in 1061 bytes} [Mon Jun 27 09:25:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:25:50.920705 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216fe904-6478-4694-b12f-70b6c48a17f9 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:25:50.922309 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-216fe904-6478-4694-b12f-70b6c48a17f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:25:51.030223 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216fe904-6478-4694-b12f-70b6c48a17f9 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:25:51.104867 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:25:51.107649 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a40ee3-6fc6-45f9-a998-5b24da5f947d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:25:51.108348 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a40ee3-6fc6-45f9-a998-5b24da5f947d service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:25:51.108628 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a40ee3-6fc6-45f9-a998-5b24da5f947d service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:25:51.108897 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a40ee3-6fc6-45f9-a998-5b24da5f947d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:25:51.110555 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-46a40ee3-6fc6-45f9-a998-5b24da5f947d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:25:51.220333 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a40ee3-6fc6-45f9-a998-5b24da5f947d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:25:51.221778 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a40ee3-6fc6-45f9-a998-5b24da5f947d service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:25:51.239368 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 654/1316] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:25:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:25:54.060387 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d287068-68a9-41a2-801e-338042d64370 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:25:54.060956 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d287068-68a9-41a2-801e-338042d64370 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:25:54.060956 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d287068-68a9-41a2-801e-338042d64370 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:25:54.062313 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 663/1317] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:25:54.067552 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd18679-1ed3-4699-bf2a-2a01b91c2873 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:25:54.067958 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd18679-1ed3-4699-bf2a-2a01b91c2873 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:25:54.068169 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd18679-1ed3-4699-bf2a-2a01b91c2873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:25:54.134170 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-1cd18679-1ed3-4699-bf2a-2a01b91c2873 None None] MFA Rules not processed for user `bc89b2dd30b74b7998bc9496e8f9bdfb`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:25:54.135384 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-1cd18679-1ed3-4699-bf2a-2a01b91c2873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:25:54.187684 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:25:54.232749 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 655/1318] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:25:54 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:25:54.272264 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d287068-68a9-41a2-801e-338042d64370 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:25:54.273909 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-4d287068-68a9-41a2-801e-338042d64370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:25:54.381759 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d287068-68a9-41a2-801e-338042d64370 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:25:54.384819 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:25:54.457809 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f42e730-c0d2-4fc0-bb19-d14baec2cb32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:25:54.458444 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42e730-c0d2-4fc0-bb19-d14baec2cb32 service neutron] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:25:54.458721 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42e730-c0d2-4fc0-bb19-d14baec2cb32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:25:54.458990 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42e730-c0d2-4fc0-bb19-d14baec2cb32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:25:54.461335 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-7f42e730-c0d2-4fc0-bb19-d14baec2cb32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:25:54.564431 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f42e730-c0d2-4fc0-bb19-d14baec2cb32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:25:54.565852 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f42e730-c0d2-4fc0-bb19-d14baec2cb32 service neutron] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:25:54.584859 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 664/1319] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:25:54 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:25:57.460754 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e49a9-7de5-467d-8a92-f19191251dd0 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:25:57.461318 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e49a9-7de5-467d-8a92-f19191251dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:25:57.461318 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e49a9-7de5-467d-8a92-f19191251dd0 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:25:57.462690 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 656/1320] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:25:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:25:57.467945 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16a885-8d79-45b4-9251-fd825fa56173 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:25:57.468395 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16a885-8d79-45b4-9251-fd825fa56173 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:25:57.468506 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16a885-8d79-45b4-9251-fd825fa56173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:25:57.506933 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:25:57.532636 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-cd16a885-8d79-45b4-9251-fd825fa56173 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:25:57.533948 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-cd16a885-8d79-45b4-9251-fd825fa56173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:25:57.629539 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 665/1321] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:25:57 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:25:57.669181 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e49a9-7de5-467d-8a92-f19191251dd0 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:25:57.670721 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-f61e49a9-7de5-467d-8a92-f19191251dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:25:57.773008 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e49a9-7de5-467d-8a92-f19191251dd0 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:25:57.846326 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dbbf7a-4680-444e-9dfe-4939eafd66a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:25:57.846968 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbbf7a-4680-444e-9dfe-4939eafd66a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:25:57.847249 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbbf7a-4680-444e-9dfe-4939eafd66a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:25:57.847536 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbbf7a-4680-444e-9dfe-4939eafd66a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:25:57.849190 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-b7dbbf7a-4680-444e-9dfe-4939eafd66a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:25:57.856570 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:25:57.957935 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dbbf7a-4680-444e-9dfe-4939eafd66a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:25:57.959357 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dbbf7a-4680-444e-9dfe-4939eafd66a2 service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:25:57.977538 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 657/1322] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:25:57 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:26:01.312661 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ec51e-2317-4a86-9e4a-b5b2041ffcdd None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:01.313234 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ec51e-2317-4a86-9e4a-b5b2041ffcdd None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:01.313234 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ec51e-2317-4a86-9e4a-b5b2041ffcdd None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:01.314562 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 666/1323] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:26:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:26:01.319854 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c172f-256d-4aa1-9d41-ec9e57a01a6e None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:01.320290 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c172f-256d-4aa1-9d41-ec9e57a01a6e None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:01.320551 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c172f-256d-4aa1-9d41-ec9e57a01a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:01.387461 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-ee0c172f-256d-4aa1-9d41-ec9e57a01a6e None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:26:01.388719 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-ee0c172f-256d-4aa1-9d41-ec9e57a01a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:26:01.448451 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:26:01.492842 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 658/1324] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:26:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:26:01.530569 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ec51e-2317-4a86-9e4a-b5b2041ffcdd None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:26:01.533348 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-a11ec51e-2317-4a86-9e4a-b5b2041ffcdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:26:01.648414 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ec51e-2317-4a86-9e4a-b5b2041ffcdd None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:26:01.661471 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:26:01.725234 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd68de-8af2-41f8-949d-8c422492821a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:26:01.725880 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd68de-8af2-41f8-949d-8c422492821a service neutron] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:01.726159 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd68de-8af2-41f8-949d-8c422492821a service neutron] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:01.726430 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd68de-8af2-41f8-949d-8c422492821a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:01.728076 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-94dd68de-8af2-41f8-949d-8c422492821a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:26:01.838512 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd68de-8af2-41f8-949d-8c422492821a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:26:01.839991 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd68de-8af2-41f8-949d-8c422492821a service neutron] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:26:01.858672 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 667/1325] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:26:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:26:04.002802 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491236e-f4cb-468f-8e15-ac996db9d8ec None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:04.003331 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491236e-f4cb-468f-8e15-ac996db9d8ec None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:04.003331 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491236e-f4cb-468f-8e15-ac996db9d8ec None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:04.004768 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 659/1326] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:26:04.010484 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6aab5-04b6-4099-ab01-5752bcb01eee None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:04.010942 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6aab5-04b6-4099-ab01-5752bcb01eee None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:04.011037 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6aab5-04b6-4099-ab01-5752bcb01eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:04.059040 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:26:04.076967 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-56e6aab5-04b6-4099-ab01-5752bcb01eee None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:26:04.078201 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-56e6aab5-04b6-4099-ab01-5752bcb01eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:26:04.176926 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 668/1327] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:26:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:26:04.213027 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491236e-f4cb-468f-8e15-ac996db9d8ec None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:26:04.214542 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-2491236e-f4cb-468f-8e15-ac996db9d8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:26:04.323281 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491236e-f4cb-468f-8e15-ac996db9d8ec None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:26:04.404988 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b529ec-07b2-4402-9981-fce0509cdcb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:26:04.405650 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b529ec-07b2-4402-9981-fce0509cdcb3 service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:04.405934 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b529ec-07b2-4402-9981-fce0509cdcb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:04.406213 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b529ec-07b2-4402-9981-fce0509cdcb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:04.407979 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-55b529ec-07b2-4402-9981-fce0509cdcb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:26:04.427081 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:26:04.524121 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b529ec-07b2-4402-9981-fce0509cdcb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:26:04.525576 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b529ec-07b2-4402-9981-fce0509cdcb3 service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:26:04.545137 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 660/1328] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:26:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:26:06.642982 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f4f46-854a-4ee3-98db-8b7462fc9328 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:06.643515 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f4f46-854a-4ee3-98db-8b7462fc9328 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:06.643633 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f4f46-854a-4ee3-98db-8b7462fc9328 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:06.644959 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 669/1329] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:26:06.650867 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2dc3df-8973-4f47-b604-38bd79898ab1 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:06.651306 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2dc3df-8973-4f47-b604-38bd79898ab1 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:06.651544 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2dc3df-8973-4f47-b604-38bd79898ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:06.720760 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-ac2dc3df-8973-4f47-b604-38bd79898ab1 None None] MFA Rules not processed for user `bc89b2dd30b74b7998bc9496e8f9bdfb`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:26:06.721909 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-ac2dc3df-8973-4f47-b604-38bd79898ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:26:06.788789 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:26:06.822963 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 661/1330] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:26:06 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:26:06.860084 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f4f46-854a-4ee3-98db-8b7462fc9328 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:26:06.861712 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-807f4f46-854a-4ee3-98db-8b7462fc9328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:26:06.967206 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f4f46-854a-4ee3-98db-8b7462fc9328 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:26:06.987588 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:26:07.045710 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b7392-1b4c-44e2-a8cf-4fe047bba854 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:26:07.046491 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b7392-1b4c-44e2-a8cf-4fe047bba854 service neutron] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:07.046835 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b7392-1b4c-44e2-a8cf-4fe047bba854 service neutron] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:07.047113 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b7392-1b4c-44e2-a8cf-4fe047bba854 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:07.048859 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-349b7392-1b4c-44e2-a8cf-4fe047bba854 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:26:07.170522 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349b7392-1b4c-44e2-a8cf-4fe047bba854 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:26:07.171960 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349b7392-1b4c-44e2-a8cf-4fe047bba854 service neutron] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:26:07.192013 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 670/1331] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:26:06 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:26:09.681705 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96125e55-2383-4c1c-9cb6-285b91981079 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:09.682377 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96125e55-2383-4c1c-9cb6-285b91981079 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:09.682377 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96125e55-2383-4c1c-9cb6-285b91981079 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:09.683628 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 662/1332] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:26:09.688952 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16569ad0-2a97-41b1-9f63-d4643af90d80 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:09.689399 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16569ad0-2a97-41b1-9f63-d4643af90d80 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:09.689511 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16569ad0-2a97-41b1-9f63-d4643af90d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:09.751088 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:26:09.754089 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-16569ad0-2a97-41b1-9f63-d4643af90d80 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:26:09.755311 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-16569ad0-2a97-41b1-9f63-d4643af90d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:26:09.853136 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 671/1333] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:26:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:26:09.889427 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96125e55-2383-4c1c-9cb6-285b91981079 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:26:09.890946 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-96125e55-2383-4c1c-9cb6-285b91981079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:26:09.993584 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96125e55-2383-4c1c-9cb6-285b91981079 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:26:10.066739 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1da515c-220a-49e0-8c8b-6e224409fa5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:26:10.067381 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da515c-220a-49e0-8c8b-6e224409fa5b service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:10.067669 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da515c-220a-49e0-8c8b-6e224409fa5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:10.068497 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da515c-220a-49e0-8c8b-6e224409fa5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:10.070165 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-b1da515c-220a-49e0-8c8b-6e224409fa5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:26:10.096622 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:26:10.182203 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1da515c-220a-49e0-8c8b-6e224409fa5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:26:10.183645 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1da515c-220a-49e0-8c8b-6e224409fa5b service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:26:10.201986 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 663/1334] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:26:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:26:12.263389 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c269d-a4cc-48e4-88cc-6deb53324f88 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:12.263967 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c269d-a4cc-48e4-88cc-6deb53324f88 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:12.263967 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c269d-a4cc-48e4-88cc-6deb53324f88 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:12.265371 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 672/1335] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:26:12.270946 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa0ab1-03c3-4a09-9cc6-63d89fd110c0 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:12.271393 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa0ab1-03c3-4a09-9cc6-63d89fd110c0 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:12.271509 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa0ab1-03c3-4a09-9cc6-63d89fd110c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:12.335454 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-c4aa0ab1-03c3-4a09-9cc6-63d89fd110c0 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:26:12.336680 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-c4aa0ab1-03c3-4a09-9cc6-63d89fd110c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:26:12.411848 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:26:12.436428 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 664/1336] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:26:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:26:12.477601 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c269d-a4cc-48e4-88cc-6deb53324f88 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:26:12.479145 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-861c269d-a4cc-48e4-88cc-6deb53324f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:26:12.589391 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c269d-a4cc-48e4-88cc-6deb53324f88 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:26:12.618001 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:26:12.662854 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71243593-1361-483c-859e-ed937dfcb8d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:26:12.663403 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71243593-1361-483c-859e-ed937dfcb8d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:12.663678 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71243593-1361-483c-859e-ed937dfcb8d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:12.663943 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71243593-1361-483c-859e-ed937dfcb8d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:12.665620 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-71243593-1361-483c-859e-ed937dfcb8d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:26:12.773072 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71243593-1361-483c-859e-ed937dfcb8d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:26:12.774503 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71243593-1361-483c-859e-ed937dfcb8d7 service neutron] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:26:12.793250 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 673/1337] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:26:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:26:15.357213 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce7e49-4a2e-429d-ba7a-b04e287d3a4a None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:15.357745 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce7e49-4a2e-429d-ba7a-b04e287d3a4a None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:15.357745 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce7e49-4a2e-429d-ba7a-b04e287d3a4a None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:15.359041 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 665/1338] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:26:15.364287 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda04e93-5298-4515-85b0-0523a41cd06d None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:15.364766 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda04e93-5298-4515-85b0-0523a41cd06d None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:15.364878 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda04e93-5298-4515-85b0-0523a41cd06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:15.430478 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-cda04e93-5298-4515-85b0-0523a41cd06d None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:26:15.431676 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-cda04e93-5298-4515-85b0-0523a41cd06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:26:15.439887 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:26:15.532412 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 674/1339] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:26:15 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 09:26:15.568668 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce7e49-4a2e-429d-ba7a-b04e287d3a4a None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:26:15.570254 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-a0ce7e49-4a2e-429d-ba7a-b04e287d3a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:26:15.674975 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce7e49-4a2e-429d-ba7a-b04e287d3a4a None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:26:15.747722 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e95ad-70eb-45ff-9c55-07a16551d088 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:26:15.748403 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e95ad-70eb-45ff-9c55-07a16551d088 service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:15.748691 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e95ad-70eb-45ff-9c55-07a16551d088 service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:15.748967 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e95ad-70eb-45ff-9c55-07a16551d088 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:15.750626 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-577e95ad-70eb-45ff-9c55-07a16551d088 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:26:15.787162 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:26:15.859568 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e95ad-70eb-45ff-9c55-07a16551d088 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:26:15.861043 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e95ad-70eb-45ff-9c55-07a16551d088 service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:26:15.879709 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 666/1340] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:26:15 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:26:20.204921 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94fddf8-4d39-4223-9c00-d395f2dbcccc None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:20.205396 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94fddf8-4d39-4223-9c00-d395f2dbcccc None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:20.205510 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94fddf8-4d39-4223-9c00-d395f2dbcccc None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:20.206897 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 675/1341] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:26:20.212336 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1787c4-3103-463d-8c45-2ac585f478be None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:20.212856 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1787c4-3103-463d-8c45-2ac585f478be None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:20.213120 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1787c4-3103-463d-8c45-2ac585f478be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:20.295564 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-bf1787c4-3103-463d-8c45-2ac585f478be None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:26:20.298240 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-bf1787c4-3103-463d-8c45-2ac585f478be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:26:20.404873 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:26:20.422751 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 667/1342] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:26:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:26:20.462209 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94fddf8-4d39-4223-9c00-d395f2dbcccc None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:26:20.464410 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-e94fddf8-4d39-4223-9c00-d395f2dbcccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:26:20.561341 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94fddf8-4d39-4223-9c00-d395f2dbcccc None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:26:20.564945 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb639dbd-b3ae-4b27-9257-a3235d18715e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:26:20.565575 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb639dbd-b3ae-4b27-9257-a3235d18715e service neutron] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:20.565857 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb639dbd-b3ae-4b27-9257-a3235d18715e service neutron] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:20.566130 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb639dbd-b3ae-4b27-9257-a3235d18715e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:20.575116 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb639dbd-b3ae-4b27-9257-a3235d18715e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:26:20.576593 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb639dbd-b3ae-4b27-9257-a3235d18715e service neutron] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:26:20.586593 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 676/1343] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:26:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:26:23.580527 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9827d-d496-4436-914b-c56e57659173 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:23.580947 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9827d-d496-4436-914b-c56e57659173 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:23.581134 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9827d-d496-4436-914b-c56e57659173 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:23.582479 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 668/1344] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:26:23.588546 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ca267-ea81-489d-b67a-184370fcce2d None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:23.589004 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ca267-ea81-489d-b67a-184370fcce2d None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:23.589189 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ca267-ea81-489d-b67a-184370fcce2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:23.620145 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-9f5ca267-ea81-489d-b67a-184370fcce2d None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:26:23.621400 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-9f5ca267-ea81-489d-b67a-184370fcce2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:26:23.650475 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:26:23.702089 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 677/1345] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:26:23 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:26:23.740373 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e9827d-d496-4436-914b-c56e57659173 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:26:23.751057 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e9827d-d496-4436-914b-c56e57659173 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:26:23.754594 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d6368e-314f-455c-be71-d24ef98106b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:26:23.755763 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6368e-314f-455c-be71-d24ef98106b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:23.756043 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6368e-314f-455c-be71-d24ef98106b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:23.756356 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6368e-314f-455c-be71-d24ef98106b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:23.765772 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d6368e-314f-455c-be71-d24ef98106b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:26:23.767206 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d6368e-314f-455c-be71-d24ef98106b0 service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:26:23.777977 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 669/1346] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:26:23 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:26:28.096153 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a009cc-3879-4cd1-b8d0-683bd1710c93 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:28.096657 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a009cc-3879-4cd1-b8d0-683bd1710c93 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:28.096779 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a009cc-3879-4cd1-b8d0-683bd1710c93 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:28.098107 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 678/1347] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:26:28.104374 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e4a0c-a959-447f-aef4-3637c98dc962 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:28.107675 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e4a0c-a959-447f-aef4-3637c98dc962 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:28.107675 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e4a0c-a959-447f-aef4-3637c98dc962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:28.124431 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-764e4a0c-a959-447f-aef4-3637c98dc962 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:26:28.125632 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-764e4a0c-a959-447f-aef4-3637c98dc962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:26:28.134767 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 670/1348] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:26:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:26:28.172428 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a009cc-3879-4cd1-b8d0-683bd1710c93 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:26:28.184117 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a009cc-3879-4cd1-b8d0-683bd1710c93 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:26:28.188242 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43181f46-d03f-4ed8-bdf3-150e6cb5027f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:26:28.189461 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43181f46-d03f-4ed8-bdf3-150e6cb5027f service neutron] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:28.189746 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43181f46-d03f-4ed8-bdf3-150e6cb5027f service neutron] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:28.190022 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43181f46-d03f-4ed8-bdf3-150e6cb5027f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:28.202981 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43181f46-d03f-4ed8-bdf3-150e6cb5027f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:26:28.202981 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43181f46-d03f-4ed8-bdf3-150e6cb5027f service neutron] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:26:28.211907 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 679/1349] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:26:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:26:33.373922 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85137eb4-c761-4257-9413-d1d895dae266 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:33.374476 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85137eb4-c761-4257-9413-d1d895dae266 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:33.374476 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85137eb4-c761-4257-9413-d1d895dae266 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:33.383169 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 671/1350] 10.222.0.62 () {54 vars in 921 bytes} [Mon Jun 27 09:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:26:33.393524 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3895e15-2692-4bfb-ac0b-9c0ad0352027 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:33.394219 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3895e15-2692-4bfb-ac0b-9c0ad0352027 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:33.394219 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3895e15-2692-4bfb-ac0b-9c0ad0352027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:33.495302 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-a3895e15-2692-4bfb-ac0b-9c0ad0352027 None None] MFA Rules not processed for user `2bbaf738138b40b2a06bb63934f6608c`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:26:33.496478 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-a3895e15-2692-4bfb-ac0b-9c0ad0352027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:26:33.583402 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 680/1351] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Jun 27 09:26:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:26:37.953652 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfe235-39e9-43c2-b691-5e4eb2b230fd None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:37.954240 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfe235-39e9-43c2-b691-5e4eb2b230fd None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:37.954376 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfe235-39e9-43c2-b691-5e4eb2b230fd None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:37.955865 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 672/1352] 10.222.0.62 () {54 vars in 921 bytes} [Mon Jun 27 09:26:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:26:37.961608 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882978b-08ca-4207-86db-94a8f6e8f0db None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:37.962049 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882978b-08ca-4207-86db-94a8f6e8f0db None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:37.962171 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882978b-08ca-4207-86db-94a8f6e8f0db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:37.983474 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-4882978b-08ca-4207-86db-94a8f6e8f0db None None] MFA Rules not processed for user `2bbaf738138b40b2a06bb63934f6608c`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:26:37.984726 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-4882978b-08ca-4207-86db-94a8f6e8f0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:26:37.995813 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 681/1353] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Jun 27 09:26:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:26:38.118134 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=13 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:26:39.619871 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7256e89-d551-4719-aeb3-2cd2c4c9df09 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:39.620548 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7256e89-d551-4719-aeb3-2cd2c4c9df09 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:39.620548 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7256e89-d551-4719-aeb3-2cd2c4c9df09 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:39.621827 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 673/1354] 10.222.0.62 () {54 vars in 921 bytes} [Mon Jun 27 09:26:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:26:39.626847 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274cc6b3-52ac-4504-9267-be6ee8e6851a None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:39.627285 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274cc6b3-52ac-4504-9267-be6ee8e6851a None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:39.627534 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274cc6b3-52ac-4504-9267-be6ee8e6851a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:39.646592 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-274cc6b3-52ac-4504-9267-be6ee8e6851a None None] MFA Rules not processed for user `2bbaf738138b40b2a06bb63934f6608c`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:26:39.647777 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-274cc6b3-52ac-4504-9267-be6ee8e6851a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:26:39.656608 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 682/1355] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Jun 27 09:26:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:26:43.228269 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a57e7-0ed1-4ccd-8f08-82eccc18121b None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:43.229315 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a57e7-0ed1-4ccd-8f08-82eccc18121b None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:43.229600 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a57e7-0ed1-4ccd-8f08-82eccc18121b None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:43.231222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 674/1356] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:26:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:26:43.238107 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f80ff3-fdfb-49c1-aff9-0133fd62d6ad None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:43.239077 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f80ff3-fdfb-49c1-aff9-0133fd62d6ad None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:43.239706 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f80ff3-fdfb-49c1-aff9-0133fd62d6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:43.263779 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-88f80ff3-fdfb-49c1-aff9-0133fd62d6ad None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:26:43.265813 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-88f80ff3-fdfb-49c1-aff9-0133fd62d6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:26:43.276167 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 683/1357] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:26:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:26:43.334892 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d38001-df6d-431d-b837-9bf0c40bfe42 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:43.335480 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d38001-df6d-431d-b837-9bf0c40bfe42 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:43.335986 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d38001-df6d-431d-b837-9bf0c40bfe42 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:43.337864 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 675/1358] 10.222.0.62 () {54 vars in 961 bytes} [Mon Jun 27 09:26:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:26:43.345605 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53679c61-5b2b-4491-bc4f-0b37740be776 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:43.345919 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53679c61-5b2b-4491-bc4f-0b37740be776 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:43.346194 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53679c61-5b2b-4491-bc4f-0b37740be776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:43.397342 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:26:43.406255 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-53679c61-5b2b-4491-bc4f-0b37740be776 None None] MFA Rules not processed for user `2c1434a85b30411c9c59cc50c3980cd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:26:43.407628 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-53679c61-5b2b-4491-bc4f-0b37740be776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:26:43.497166 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 684/1359] 10.222.0.62 () {58 vars in 1058 bytes} [Mon Jun 27 09:26:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:26:43.505584 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d38001-df6d-431d-b837-9bf0c40bfe42 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:26:43.523118 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d38001-df6d-431d-b837-9bf0c40bfe42 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:26:43.529332 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf1cc8-0a89-47fb-b7c9-b2b45f3febd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:26:43.530169 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf1cc8-0a89-47fb-b7c9-b2b45f3febd5 service nova] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:43.530603 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf1cc8-0a89-47fb-b7c9-b2b45f3febd5 service nova] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:43.531038 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf1cc8-0a89-47fb-b7c9-b2b45f3febd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:43.542044 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbf1cc8-0a89-47fb-b7c9-b2b45f3febd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:26:43.543886 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbf1cc8-0a89-47fb-b7c9-b2b45f3febd5 service nova] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:26:43.556431 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 676/1360] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:26:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 09:26:45.823831 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ef7d9-10c3-4311-9d0b-ccb46fb185e1 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:45.824394 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ef7d9-10c3-4311-9d0b-ccb46fb185e1 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:45.824394 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ef7d9-10c3-4311-9d0b-ccb46fb185e1 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:45.825958 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 685/1361] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:26:45.831108 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45b54b-8ab6-4035-b824-3c45d5166097 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:45.831633 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45b54b-8ab6-4035-b824-3c45d5166097 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:45.831633 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45b54b-8ab6-4035-b824-3c45d5166097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:45.850897 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-4a45b54b-8ab6-4035-b824-3c45d5166097 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:26:45.852099 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-4a45b54b-8ab6-4035-b824-3c45d5166097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:26:45.860507 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 677/1362] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:26:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:26:45.904800 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ef7d9-10c3-4311-9d0b-ccb46fb185e1 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:26:45.920315 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ef7d9-10c3-4311-9d0b-ccb46fb185e1 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:26:45.925805 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691d3b4-c770-4a65-9d1b-7f3fc9ac6be9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:26:45.926544 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691d3b4-c770-4a65-9d1b-7f3fc9ac6be9 service nova] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:45.926912 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691d3b4-c770-4a65-9d1b-7f3fc9ac6be9 service nova] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:45.927256 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691d3b4-c770-4a65-9d1b-7f3fc9ac6be9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:45.935884 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3691d3b4-c770-4a65-9d1b-7f3fc9ac6be9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:26:45.937594 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3691d3b4-c770-4a65-9d1b-7f3fc9ac6be9 service nova] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:26:45.947626 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 686/1363] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:26:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:26:48.456059 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b961b78-8d80-4957-886e-bd79b4bf889a None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:48.456699 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b961b78-8d80-4957-886e-bd79b4bf889a None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:48.456699 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b961b78-8d80-4957-886e-bd79b4bf889a None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:48.458012 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 678/1364] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:26:48.463569 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0312ac-e147-4454-905f-051352f3008a None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:48.464006 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0312ac-e147-4454-905f-051352f3008a None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:48.464116 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0312ac-e147-4454-905f-051352f3008a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:48.482691 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-7e0312ac-e147-4454-905f-051352f3008a None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:26:48.483883 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-7e0312ac-e147-4454-905f-051352f3008a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:26:48.493789 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 687/1365] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:26:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:26:48.547409 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2408eba-3441-435d-aee0-f77a8bb6e453 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:48.547699 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2408eba-3441-435d-aee0-f77a8bb6e453 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:48.547977 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2408eba-3441-435d-aee0-f77a8bb6e453 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:48.549404 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 679/1366] 10.222.0.62 () {54 vars in 961 bytes} [Mon Jun 27 09:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:26:48.555383 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ff227-330d-4065-9ea1-78116413516a None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:48.556327 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ff227-330d-4065-9ea1-78116413516a None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:48.556327 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ff227-330d-4065-9ea1-78116413516a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:48.575100 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-c32ff227-330d-4065-9ea1-78116413516a None None] MFA Rules not processed for user `2c1434a85b30411c9c59cc50c3980cd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:26:48.576336 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-c32ff227-330d-4065-9ea1-78116413516a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:26:48.585877 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 688/1367] 10.222.0.62 () {58 vars in 1058 bytes} [Mon Jun 27 09:26:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:26:48.593690 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2408eba-3441-435d-aee0-f77a8bb6e453 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:26:48.608389 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2408eba-3441-435d-aee0-f77a8bb6e453 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:26:48.614332 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a24c409-8ee7-4ea3-9e5f-5c861d34e665 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:26:48.615022 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24c409-8ee7-4ea3-9e5f-5c861d34e665 service nova] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:48.615363 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24c409-8ee7-4ea3-9e5f-5c861d34e665 service nova] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:48.615695 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24c409-8ee7-4ea3-9e5f-5c861d34e665 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:48.624222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a24c409-8ee7-4ea3-9e5f-5c861d34e665 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:26:48.625787 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a24c409-8ee7-4ea3-9e5f-5c861d34e665 service nova] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:26:48.635731 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 680/1368] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:26:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:26:50.950713 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0cdaec-9757-4fc5-8a8d-f1d0cb856853 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:50.951270 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0cdaec-9757-4fc5-8a8d-f1d0cb856853 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:50.951270 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0cdaec-9757-4fc5-8a8d-f1d0cb856853 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:50.952847 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 689/1369] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:26:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:26:50.958415 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac1281-ce08-4dd5-83d9-4adae0d2a112 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:50.959267 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac1281-ce08-4dd5-83d9-4adae0d2a112 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:50.959546 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac1281-ce08-4dd5-83d9-4adae0d2a112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:50.977241 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-42ac1281-ce08-4dd5-83d9-4adae0d2a112 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:26:50.978430 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-42ac1281-ce08-4dd5-83d9-4adae0d2a112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:26:50.986399 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 681/1370] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:26:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:26:51.031081 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0cdaec-9757-4fc5-8a8d-f1d0cb856853 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:26:51.045993 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0cdaec-9757-4fc5-8a8d-f1d0cb856853 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:26:51.052397 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb0e50-8c3b-4c12-8179-a7b0595cd606 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:26:51.053039 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb0e50-8c3b-4c12-8179-a7b0595cd606 service nova] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:51.053321 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb0e50-8c3b-4c12-8179-a7b0595cd606 service nova] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:51.053593 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb0e50-8c3b-4c12-8179-a7b0595cd606 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:51.063187 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beb0e50-8c3b-4c12-8179-a7b0595cd606 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:26:51.065456 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beb0e50-8c3b-4c12-8179-a7b0595cd606 service nova] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:26:51.076126 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 690/1371] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:26:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:26:51.575299 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e1baf-953d-4df8-9dbb-0f1d18fae639 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:51.575541 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e1baf-953d-4df8-9dbb-0f1d18fae639 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:51.575813 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e1baf-953d-4df8-9dbb-0f1d18fae639 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:51.577324 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 682/1372] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:26:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:26:51.582946 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5e4ef-dc2b-4902-bd54-e28b48572372 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:51.583225 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5e4ef-dc2b-4902-bd54-e28b48572372 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:51.583504 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5e4ef-dc2b-4902-bd54-e28b48572372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:51.603028 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-0ba5e4ef-dc2b-4902-bd54-e28b48572372 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:26:51.604362 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-0ba5e4ef-dc2b-4902-bd54-e28b48572372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:26:51.612811 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 691/1373] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:26:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:26:51.955222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296b780-b767-4bf3-9378-385f04e89e44 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:51.955222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296b780-b767-4bf3-9378-385f04e89e44 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:51.955222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296b780-b767-4bf3-9378-385f04e89e44 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:51.957675 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 683/1374] 10.222.0.62 () {54 vars in 963 bytes} [Mon Jun 27 09:26:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:26:51.963114 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4dfc6-04b2-4db2-8b0e-2d2dc1da3143 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:51.963592 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4dfc6-04b2-4db2-8b0e-2d2dc1da3143 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:51.963688 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4dfc6-04b2-4db2-8b0e-2d2dc1da3143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:52.014253 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-5af4dfc6-04b2-4db2-8b0e-2d2dc1da3143 None None] MFA Rules not processed for user `333bceb4a90749df97595b7f38bf7ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:26:52.015462 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-5af4dfc6-04b2-4db2-8b0e-2d2dc1da3143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:26:52.078726 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 692/1375] 10.222.0.62 () {58 vars in 1060 bytes} [Mon Jun 27 09:26:51 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:26:52.087450 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296b780-b767-4bf3-9378-385f04e89e44 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:26:52.099381 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296b780-b767-4bf3-9378-385f04e89e44 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:26:52.105563 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934722ea-16b9-4c12-8383-0986d05fdf33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:26:52.105563 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934722ea-16b9-4c12-8383-0986d05fdf33 service cinder] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:52.105805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934722ea-16b9-4c12-8383-0986d05fdf33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:52.106093 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934722ea-16b9-4c12-8383-0986d05fdf33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:52.119618 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934722ea-16b9-4c12-8383-0986d05fdf33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:26:52.121141 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934722ea-16b9-4c12-8383-0986d05fdf33 service cinder] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:26:52.131333 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 684/1376] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:26:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 09:26:53.401494 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0099e8-34ec-4dcc-9208-a8c7f0a9d8d7 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:53.402034 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0099e8-34ec-4dcc-9208-a8c7f0a9d8d7 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:53.402034 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0099e8-34ec-4dcc-9208-a8c7f0a9d8d7 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:53.404388 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 693/1377] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:26:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:26:53.409734 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871630d5-6a56-48f3-bfc2-157cc8146e64 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:53.410798 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871630d5-6a56-48f3-bfc2-157cc8146e64 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:53.410905 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871630d5-6a56-48f3-bfc2-157cc8146e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:53.428565 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-871630d5-6a56-48f3-bfc2-157cc8146e64 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:26:53.429774 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-871630d5-6a56-48f3-bfc2-157cc8146e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:26:53.437673 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 685/1378] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:26:53.482952 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0099e8-34ec-4dcc-9208-a8c7f0a9d8d7 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:26:53.497802 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0099e8-34ec-4dcc-9208-a8c7f0a9d8d7 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:26:53.503299 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab8174-7001-44c1-bbd5-1a3524679a50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:26:53.503964 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab8174-7001-44c1-bbd5-1a3524679a50 service nova] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:53.504277 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab8174-7001-44c1-bbd5-1a3524679a50 service nova] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:53.504559 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab8174-7001-44c1-bbd5-1a3524679a50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:53.513279 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab8174-7001-44c1-bbd5-1a3524679a50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:26:53.514859 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab8174-7001-44c1-bbd5-1a3524679a50 service nova] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:26:53.518884 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:26:53.525725 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 694/1379] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:26:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:26:55.787915 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f33b2-0527-4bcd-bbdc-b624d96d7c38 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:55.788484 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f33b2-0527-4bcd-bbdc-b624d96d7c38 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:55.788484 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f33b2-0527-4bcd-bbdc-b624d96d7c38 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:55.790091 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 686/1380] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:26:55.795242 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a145e95-2a15-45a5-b2b3-4a5395a1b300 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:55.796068 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a145e95-2a15-45a5-b2b3-4a5395a1b300 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:55.796511 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a145e95-2a15-45a5-b2b3-4a5395a1b300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:55.821376 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-9a145e95-2a15-45a5-b2b3-4a5395a1b300 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:26:55.823663 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-9a145e95-2a15-45a5-b2b3-4a5395a1b300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:26:55.839753 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 695/1381] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:26:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:26:55.887021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f33b2-0527-4bcd-bbdc-b624d96d7c38 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:26:55.903822 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f33b2-0527-4bcd-bbdc-b624d96d7c38 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:26:55.909523 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5339b2-d4b4-4aff-aecf-b79cf50b4e60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:26:55.910303 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5339b2-d4b4-4aff-aecf-b79cf50b4e60 service nova] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:55.910582 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5339b2-d4b4-4aff-aecf-b79cf50b4e60 service nova] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:55.910854 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5339b2-d4b4-4aff-aecf-b79cf50b4e60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:55.919044 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5339b2-d4b4-4aff-aecf-b79cf50b4e60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:26:55.920652 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5339b2-d4b4-4aff-aecf-b79cf50b4e60 service nova] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:26:55.930751 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 687/1382] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:26:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:26:58.242601 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8800c-7d42-420b-a4a9-0ac59968c3e5 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:58.247585 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8800c-7d42-420b-a4a9-0ac59968c3e5 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:58.247585 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8800c-7d42-420b-a4a9-0ac59968c3e5 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:58.247585 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 696/1383] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:26:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:26:58.249805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473cb04-c98d-40d0-9d71-f55bdc6d5a7a None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:58.250203 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473cb04-c98d-40d0-9d71-f55bdc6d5a7a None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:58.250360 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473cb04-c98d-40d0-9d71-f55bdc6d5a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:58.269049 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-d473cb04-c98d-40d0-9d71-f55bdc6d5a7a None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:26:58.270889 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-d473cb04-c98d-40d0-9d71-f55bdc6d5a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:26:58.278790 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 688/1384] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:26:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:26:58.320392 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e8800c-7d42-420b-a4a9-0ac59968c3e5 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:26:58.334893 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e8800c-7d42-420b-a4a9-0ac59968c3e5 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:26:58.340798 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec11e0f-7735-48be-9a41-45f6d2749a04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:26:58.341446 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec11e0f-7735-48be-9a41-45f6d2749a04 service nova] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:26:58.341731 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec11e0f-7735-48be-9a41-45f6d2749a04 service nova] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:26:58.342008 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec11e0f-7735-48be-9a41-45f6d2749a04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:26:58.351889 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec11e0f-7735-48be-9a41-45f6d2749a04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:26:58.353554 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec11e0f-7735-48be-9a41-45f6d2749a04 service nova] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:26:58.364770 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 697/1385] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:26:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:27:00.520713 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa0b51-69cd-43dc-a627-cb33294ee42d None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:00.521384 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa0b51-69cd-43dc-a627-cb33294ee42d None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:00.521384 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa0b51-69cd-43dc-a627-cb33294ee42d None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:00.522563 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 689/1386] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 09:27:00.528021 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59458c9e-496b-48fe-83e2-74afe9f7aa69 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:00.528526 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59458c9e-496b-48fe-83e2-74afe9f7aa69 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:00.528611 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59458c9e-496b-48fe-83e2-74afe9f7aa69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:00.547111 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-59458c9e-496b-48fe-83e2-74afe9f7aa69 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:27:00.548354 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-59458c9e-496b-48fe-83e2-74afe9f7aa69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:27:00.556770 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 698/1387] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:27:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 09:27:00.603963 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa0b51-69cd-43dc-a627-cb33294ee42d None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:27:00.618857 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa0b51-69cd-43dc-a627-cb33294ee42d None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:27:00.624262 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb777f86-f18f-497e-ba30-d1b5b513de51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:27:00.624891 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb777f86-f18f-497e-ba30-d1b5b513de51 service nova] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:00.625170 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb777f86-f18f-497e-ba30-d1b5b513de51 service nova] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:00.625445 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb777f86-f18f-497e-ba30-d1b5b513de51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:00.634408 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb777f86-f18f-497e-ba30-d1b5b513de51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:27:00.635983 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb777f86-f18f-497e-ba30-d1b5b513de51 service nova] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:27:00.645576 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 690/1388] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:27:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:27:02.928243 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273caaa-1ff9-4219-b161-edc19bc1848d None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:02.928913 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273caaa-1ff9-4219-b161-edc19bc1848d None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:02.928913 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273caaa-1ff9-4219-b161-edc19bc1848d None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:02.930206 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 699/1389] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:27:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:27:02.935774 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2af08-2371-43bd-92a3-147f7e428086 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:02.936265 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2af08-2371-43bd-92a3-147f7e428086 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:02.936361 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2af08-2371-43bd-92a3-147f7e428086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:02.954851 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-e0f2af08-2371-43bd-92a3-147f7e428086 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:27:02.956062 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-e0f2af08-2371-43bd-92a3-147f7e428086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:27:02.964165 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 691/1390] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:27:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:27:03.011216 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273caaa-1ff9-4219-b161-edc19bc1848d None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:27:03.029819 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273caaa-1ff9-4219-b161-edc19bc1848d None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:27:03.037655 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea5dda-3d48-4329-baa7-7cd4e43814aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:27:03.038526 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea5dda-3d48-4329-baa7-7cd4e43814aa service nova] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:03.038813 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea5dda-3d48-4329-baa7-7cd4e43814aa service nova] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:03.039087 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea5dda-3d48-4329-baa7-7cd4e43814aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:03.055656 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea5dda-3d48-4329-baa7-7cd4e43814aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:27:03.057399 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea5dda-3d48-4329-baa7-7cd4e43814aa service nova] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:27:03.068889 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 700/1391] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:27:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:27:05.357875 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e12101-c7f8-424d-a807-ce42d6313b13 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:05.358511 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e12101-c7f8-424d-a807-ce42d6313b13 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:05.358511 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e12101-c7f8-424d-a807-ce42d6313b13 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:05.359700 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 692/1392] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:27:05.365572 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9bdda-2efe-4c1a-a5c9-144fb400b8a4 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:05.366031 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9bdda-2efe-4c1a-a5c9-144fb400b8a4 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:05.366125 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9bdda-2efe-4c1a-a5c9-144fb400b8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:05.385419 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-68a9bdda-2efe-4c1a-a5c9-144fb400b8a4 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:27:05.386695 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-68a9bdda-2efe-4c1a-a5c9-144fb400b8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:27:05.395929 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 701/1393] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:27:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:27:05.442195 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e12101-c7f8-424d-a807-ce42d6313b13 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:27:05.457689 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e12101-c7f8-424d-a807-ce42d6313b13 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:27:05.464901 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc49086-99ff-4c7c-9701-5592b2574afe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:27:05.465775 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc49086-99ff-4c7c-9701-5592b2574afe service nova] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:05.466120 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc49086-99ff-4c7c-9701-5592b2574afe service nova] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:05.466476 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc49086-99ff-4c7c-9701-5592b2574afe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:05.476608 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc49086-99ff-4c7c-9701-5592b2574afe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:27:05.478190 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc49086-99ff-4c7c-9701-5592b2574afe service nova] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:27:05.488032 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 693/1394] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:27:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:27:07.653276 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82951e-aecb-46f6-8860-641a74ae1b9d None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:07.653885 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82951e-aecb-46f6-8860-641a74ae1b9d None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:07.653885 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82951e-aecb-46f6-8860-641a74ae1b9d None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:07.655277 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 702/1395] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:27:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:27:07.660717 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824dfd7e-fbf3-40c3-91a7-3eb263875073 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:07.661186 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824dfd7e-fbf3-40c3-91a7-3eb263875073 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:07.661458 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824dfd7e-fbf3-40c3-91a7-3eb263875073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:07.679705 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-824dfd7e-fbf3-40c3-91a7-3eb263875073 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:27:07.680946 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-824dfd7e-fbf3-40c3-91a7-3eb263875073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:27:07.689223 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 694/1396] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:27:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:27:07.704734 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc1ec7-1301-4347-acc3-2a64c1d10a14 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:07.705025 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc1ec7-1301-4347-acc3-2a64c1d10a14 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:07.705305 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc1ec7-1301-4347-acc3-2a64c1d10a14 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:07.706985 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 703/1397] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:27:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:27:07.713613 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a82e68-a5e6-40a8-9297-30c83b6ea4a0 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:07.713908 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a82e68-a5e6-40a8-9297-30c83b6ea4a0 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:07.714205 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a82e68-a5e6-40a8-9297-30c83b6ea4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:07.732601 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-86a82e68-a5e6-40a8-9297-30c83b6ea4a0 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:27:07.733789 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-86a82e68-a5e6-40a8-9297-30c83b6ea4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:27:07.742772 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 695/1398] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:27:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:27:07.748875 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568e421-6231-4a14-b77a-bf06a7803811 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:07.749307 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568e421-6231-4a14-b77a-bf06a7803811 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:07.749562 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568e421-6231-4a14-b77a-bf06a7803811 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:07.751007 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 704/1399] 10.222.0.62 () {54 vars in 962 bytes} [Mon Jun 27 09:27:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:27:07.757011 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4b648-c098-4be3-86c5-b7d869fb47d8 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:07.757302 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4b648-c098-4be3-86c5-b7d869fb47d8 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:07.757603 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4b648-c098-4be3-86c5-b7d869fb47d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:07.787490 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568e421-6231-4a14-b77a-bf06a7803811 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:27:07.802411 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568e421-6231-4a14-b77a-bf06a7803811 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:27:07.807413 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-bed4b648-c098-4be3-86c5-b7d869fb47d8 None None] MFA Rules not processed for user `e6f97b803a28453c8b78fd8380ac64ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:27:07.808652 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-bed4b648-c098-4be3-86c5-b7d869fb47d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:27:07.809424 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e3d56-3029-4a3d-9a90-3dbe20b559b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:27:07.810088 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e3d56-3029-4a3d-9a90-3dbe20b559b0 service nova] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:07.810375 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e3d56-3029-4a3d-9a90-3dbe20b559b0 service nova] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:07.810734 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e3d56-3029-4a3d-9a90-3dbe20b559b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:07.820870 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176e3d56-3029-4a3d-9a90-3dbe20b559b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:27:07.822423 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176e3d56-3029-4a3d-9a90-3dbe20b559b0 service nova] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:27:07.832155 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 705/1400] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:27:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 09:27:07.871245 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 696/1401] 10.222.0.62 () {58 vars in 1059 bytes} [Mon Jun 27 09:27:07 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:27:07.879513 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e3d56-3029-4a3d-9a90-3dbe20b559b0 service nova] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:27:07.888912 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e3d56-3029-4a3d-9a90-3dbe20b559b0 service nova] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:27:07.892863 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c0ee2-7e6f-4d02-8759-e2130a5addf3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6f97b803a28453c8b78fd8380ac64ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:27:07.893498 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c0ee2-7e6f-4d02-8759-e2130a5addf3 service glance] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:07.893827 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c0ee2-7e6f-4d02-8759-e2130a5addf3 service glance] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:07.894110 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c0ee2-7e6f-4d02-8759-e2130a5addf3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:07.903349 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c0ee2-7e6f-4d02-8759-e2130a5addf3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:27:07.904749 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c0ee2-7e6f-4d02-8759-e2130a5addf3 service glance] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:27:07.914906 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 706/1402] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:27:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 09:27:08.846895 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e321644-abd9-4301-8579-ea8a6b87019f None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:08.847382 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e321644-abd9-4301-8579-ea8a6b87019f None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:08.847488 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e321644-abd9-4301-8579-ea8a6b87019f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:08.852681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=96 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:27:08.897935 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-5e321644-abd9-4301-8579-ea8a6b87019f None None] MFA Rules not processed for user `8f5d1f2327914f9fb070c6212582b6dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:27:08.899054 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-5e321644-abd9-4301-8579-ea8a6b87019f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:27:08.964630 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 697/1403] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Jun 27 09:27:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:27:09.005646 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce1092-1fef-4dc4-9e3e-3ad8e36dc9fe None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:09.006398 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce1092-1fef-4dc4-9e3e-3ad8e36dc9fe None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:09.006576 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce1092-1fef-4dc4-9e3e-3ad8e36dc9fe None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:09.008071 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 707/1404] 10.222.0.62 () {54 vars in 942 bytes} [Mon Jun 27 09:27:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:27:09.014465 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ae699-e475-4dff-aa31-d91e38dba42b None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:09.014757 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ae699-e475-4dff-aa31-d91e38dba42b None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:09.015032 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ae699-e475-4dff-aa31-d91e38dba42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:09.065187 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-719ae699-e475-4dff-aa31-d91e38dba42b None None] MFA Rules not processed for user `f5477b14dae24fd3a644c9cbd6ff85ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:27:09.067042 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-719ae699-e475-4dff-aa31-d91e38dba42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:27:09.151712 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 698/1405] 10.222.0.62 () {58 vars in 1039 bytes} [Mon Jun 27 09:27:09 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 09:27:09.161025 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce1092-1fef-4dc4-9e3e-3ad8e36dc9fe None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:27:09.174562 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce1092-1fef-4dc4-9e3e-3ad8e36dc9fe None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:27:09.180044 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1466f2b-2894-49f6-9326-c84c8c1ac95a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5477b14dae24fd3a644c9cbd6ff85ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:27:09.180709 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1466f2b-2894-49f6-9326-c84c8c1ac95a service swift] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:09.180990 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1466f2b-2894-49f6-9326-c84c8c1ac95a service swift] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:09.181263 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1466f2b-2894-49f6-9326-c84c8c1ac95a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:09.189574 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1466f2b-2894-49f6-9326-c84c8c1ac95a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:27:09.191863 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1466f2b-2894-49f6-9326-c84c8c1ac95a service swift] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:27:09.207300 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 708/1406] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Jun 27 09:27:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 09:27:10.031250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146317c-9264-4b85-adbf-a18bcb44da69 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:10.031835 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146317c-9264-4b85-adbf-a18bcb44da69 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:10.031835 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146317c-9264-4b85-adbf-a18bcb44da69 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:10.033214 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 699/1407] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:27:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:27:10.039634 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bd227-a8f5-4220-adbf-132821a5b16d None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:10.040698 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bd227-a8f5-4220-adbf-132821a5b16d None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:10.041096 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bd227-a8f5-4220-adbf-132821a5b16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:10.059832 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-b31bd227-a8f5-4220-adbf-132821a5b16d None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:27:10.061258 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-b31bd227-a8f5-4220-adbf-132821a5b16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:27:10.069449 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 709/1408] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:27:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 09:27:10.115560 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146317c-9264-4b85-adbf-a18bcb44da69 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:27:10.130781 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146317c-9264-4b85-adbf-a18bcb44da69 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:27:10.137896 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e9996f-55d7-415d-87b1-80241144078f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:27:10.138545 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e9996f-55d7-415d-87b1-80241144078f service nova] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:10.138824 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e9996f-55d7-415d-87b1-80241144078f service nova] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:10.139094 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e9996f-55d7-415d-87b1-80241144078f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:10.149400 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e9996f-55d7-415d-87b1-80241144078f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:27:10.151002 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e9996f-55d7-415d-87b1-80241144078f service nova] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:27:10.162650 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 700/1409] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:27:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:27:20.054797 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=43 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:27:20.156513 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=89 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:27:32.654137 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c04af2-6e52-40b7-8ba3-9413844defcd None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:32.654688 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c04af2-6e52-40b7-8ba3-9413844defcd None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:32.654688 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c04af2-6e52-40b7-8ba3-9413844defcd None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:32.656071 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 710/1410] 10.222.0.62 () {54 vars in 918 bytes} [Mon Jun 27 09:27:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:27:32.661384 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8e678-0c1b-47e7-b400-982c8d850a7e None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:32.661947 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8e678-0c1b-47e7-b400-982c8d850a7e None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:32.661947 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8e678-0c1b-47e7-b400-982c8d850a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:32.680609 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-c9c8e678-0c1b-47e7-b400-982c8d850a7e None None] MFA Rules not processed for user `2bbaf738138b40b2a06bb63934f6608c`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:27:32.681859 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-c9c8e678-0c1b-47e7-b400-982c8d850a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:27:32.691293 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 701/1411] 10.222.0.62 () {58 vars in 1015 bytes} [Mon Jun 27 09:27:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:27:32.706570 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0b21d-79e5-40bc-98aa-5f1aadb34d62 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:32.706861 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0b21d-79e5-40bc-98aa-5f1aadb34d62 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:32.707141 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0b21d-79e5-40bc-98aa-5f1aadb34d62 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:32.708932 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 711/1412] 10.222.0.62 () {54 vars in 918 bytes} [Mon Jun 27 09:27:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:27:32.714344 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ba3ee-2de0-4abb-9919-fd5fad780714 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:32.714631 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ba3ee-2de0-4abb-9919-fd5fad780714 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:32.714929 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ba3ee-2de0-4abb-9919-fd5fad780714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:32.733372 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-871ba3ee-2de0-4abb-9919-fd5fad780714 None None] MFA Rules not processed for user `2c1434a85b30411c9c59cc50c3980cd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:27:32.734579 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-871ba3ee-2de0-4abb-9919-fd5fad780714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:27:32.744349 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 702/1413] 10.222.0.62 () {58 vars in 1015 bytes} [Mon Jun 27 09:27:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:27:35.231618 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9ff68-f03c-42f1-84d7-87d9f4b71fe1 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:35.232153 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9ff68-f03c-42f1-84d7-87d9f4b71fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:35.232153 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9ff68-f03c-42f1-84d7-87d9f4b71fe1 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:35.233640 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 712/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 09:27:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:27:35.239219 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086e2cb-78b6-4a0a-ad5d-4e80469f0638 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:35.239689 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086e2cb-78b6-4a0a-ad5d-4e80469f0638 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:35.239830 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086e2cb-78b6-4a0a-ad5d-4e80469f0638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:35.262782 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-8086e2cb-78b6-4a0a-ad5d-4e80469f0638 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:27:35.269446 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-8086e2cb-78b6-4a0a-ad5d-4e80469f0638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:27:35.272549 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 703/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 09:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:27:35.316090 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b9ff68-f03c-42f1-84d7-87d9f4b71fe1 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:27:35.330393 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b9ff68-f03c-42f1-84d7-87d9f4b71fe1 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:27:35.335785 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba410ef-8f3e-4f77-9271-188405c87173 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:27:35.340895 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba410ef-8f3e-4f77-9271-188405c87173 service nova] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:35.340895 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba410ef-8f3e-4f77-9271-188405c87173 service nova] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:35.340895 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba410ef-8f3e-4f77-9271-188405c87173 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:35.345296 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba410ef-8f3e-4f77-9271-188405c87173 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:27:35.346886 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba410ef-8f3e-4f77-9271-188405c87173 service nova] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:27:35.358183 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 713/1416] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:27:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:27:36.311274 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52c01a-d333-428c-ba8c-de708f612d29 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:36.311819 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52c01a-d333-428c-ba8c-de708f612d29 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:36.311819 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52c01a-d333-428c-ba8c-de708f612d29 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:36.313263 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 704/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 09:27:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:27:36.320360 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559c4f8-e3f0-4b47-ac12-df991167115c None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:36.320834 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559c4f8-e3f0-4b47-ac12-df991167115c None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:36.320936 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559c4f8-e3f0-4b47-ac12-df991167115c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:36.342014 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-f559c4f8-e3f0-4b47-ac12-df991167115c None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:27:36.343219 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-f559c4f8-e3f0-4b47-ac12-df991167115c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:27:36.351782 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 714/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 09:27:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:27:36.503079 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe52c01a-d333-428c-ba8c-de708f612d29 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:27:36.517314 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe52c01a-d333-428c-ba8c-de708f612d29 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:27:36.523300 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db7f64-fd20-4154-8439-c62aa6a77455 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:27:36.523932 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db7f64-fd20-4154-8439-c62aa6a77455 service nova] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:36.524266 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db7f64-fd20-4154-8439-c62aa6a77455 service nova] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:36.524514 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db7f64-fd20-4154-8439-c62aa6a77455 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:36.533222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29db7f64-fd20-4154-8439-c62aa6a77455 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:27:36.534824 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29db7f64-fd20-4154-8439-c62aa6a77455 service nova] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:27:36.544690 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 705/1419] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:27:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:27:37.452153 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bf9b0-73a5-4da9-b0d2-da31bef27c84 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:37.452731 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bf9b0-73a5-4da9-b0d2-da31bef27c84 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:37.452731 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bf9b0-73a5-4da9-b0d2-da31bef27c84 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:37.454296 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 715/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 09:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:27:37.459142 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4521f1c-80bc-417a-a0f5-2a930e88ae0f None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:37.459552 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4521f1c-80bc-417a-a0f5-2a930e88ae0f None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:37.459689 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4521f1c-80bc-417a-a0f5-2a930e88ae0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:37.478113 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-a4521f1c-80bc-417a-a0f5-2a930e88ae0f None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:27:37.479309 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-a4521f1c-80bc-417a-a0f5-2a930e88ae0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:27:37.487834 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 706/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 09:27:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:27:37.637302 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578bf9b0-73a5-4da9-b0d2-da31bef27c84 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:27:37.652279 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578bf9b0-73a5-4da9-b0d2-da31bef27c84 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:27:37.657702 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be5e2a0-926f-45e3-98ce-9ce043732333 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:27:37.658949 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5e2a0-926f-45e3-98ce-9ce043732333 service nova] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:37.659236 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5e2a0-926f-45e3-98ce-9ce043732333 service nova] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:37.659509 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5e2a0-926f-45e3-98ce-9ce043732333 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:37.667825 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be5e2a0-926f-45e3-98ce-9ce043732333 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:27:37.669482 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be5e2a0-926f-45e3-98ce-9ce043732333 service nova] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:27:37.679961 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 716/1422] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:27:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:27:38.547161 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd620c4-70c2-44a0-87b2-7a99b9ed9f8d None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:38.547751 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd620c4-70c2-44a0-87b2-7a99b9ed9f8d None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:38.547751 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd620c4-70c2-44a0-87b2-7a99b9ed9f8d None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:38.549684 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 707/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 09:27:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:27:38.554679 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4382c5-1652-40ad-b8e2-958cb3cdfb52 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:38.555139 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4382c5-1652-40ad-b8e2-958cb3cdfb52 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:38.555248 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4382c5-1652-40ad-b8e2-958cb3cdfb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:38.573690 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-4c4382c5-1652-40ad-b8e2-958cb3cdfb52 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:27:38.574884 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-4c4382c5-1652-40ad-b8e2-958cb3cdfb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:27:38.582668 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 717/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 09:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:27:38.730396 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd620c4-70c2-44a0-87b2-7a99b9ed9f8d None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:27:38.745195 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd620c4-70c2-44a0-87b2-7a99b9ed9f8d None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:27:38.750531 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a9979-26de-498d-b995-d9a04e11bc2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:27:38.751156 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a9979-26de-498d-b995-d9a04e11bc2b service nova] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:38.751436 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a9979-26de-498d-b995-d9a04e11bc2b service nova] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:38.751710 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a9979-26de-498d-b995-d9a04e11bc2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:38.760000 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a9979-26de-498d-b995-d9a04e11bc2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:27:38.761611 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a9979-26de-498d-b995-d9a04e11bc2b service nova] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:27:38.770935 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 708/1425] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:27:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:27:39.644329 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fbffb-c68e-4d45-9361-f7591c74f44a None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:39.644906 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fbffb-c68e-4d45-9361-f7591c74f44a None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:39.644906 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fbffb-c68e-4d45-9361-f7591c74f44a None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:39.646264 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 718/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 09:27:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:27:39.651233 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e59d4-18d2-482a-8804-7fd94fd7e0bd None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:39.651678 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e59d4-18d2-482a-8804-7fd94fd7e0bd None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:39.651788 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e59d4-18d2-482a-8804-7fd94fd7e0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:39.669408 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-a12e59d4-18d2-482a-8804-7fd94fd7e0bd None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:27:39.670585 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-a12e59d4-18d2-482a-8804-7fd94fd7e0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:27:39.678339 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 709/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 09:27:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:27:39.836304 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5fbffb-c68e-4d45-9361-f7591c74f44a None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:27:39.850689 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5fbffb-c68e-4d45-9361-f7591c74f44a None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:27:39.856033 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938a7ce-e635-40ad-a7fe-e38dabb7cd83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:27:39.856727 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938a7ce-e635-40ad-a7fe-e38dabb7cd83 service nova] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:39.857007 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938a7ce-e635-40ad-a7fe-e38dabb7cd83 service nova] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:39.857278 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938a7ce-e635-40ad-a7fe-e38dabb7cd83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:39.866071 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9938a7ce-e635-40ad-a7fe-e38dabb7cd83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:27:39.867635 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9938a7ce-e635-40ad-a7fe-e38dabb7cd83 service nova] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:27:39.877484 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 719/1428] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:27:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 09:27:40.779542 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141bf36-4824-4a5b-a7f7-6f87459f443f None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:40.780121 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141bf36-4824-4a5b-a7f7-6f87459f443f None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:40.780121 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141bf36-4824-4a5b-a7f7-6f87459f443f None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:40.781538 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 710/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 09:27:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:27:40.787220 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf8ac9-131e-4731-906f-5524e994b970 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:40.787659 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf8ac9-131e-4731-906f-5524e994b970 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:40.787761 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf8ac9-131e-4731-906f-5524e994b970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:40.805218 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-ffaf8ac9-131e-4731-906f-5524e994b970 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:27:40.806413 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-ffaf8ac9-131e-4731-906f-5524e994b970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:27:40.814030 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 720/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 09:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:27:40.964911 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2141bf36-4824-4a5b-a7f7-6f87459f443f None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:27:40.979156 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2141bf36-4824-4a5b-a7f7-6f87459f443f None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:27:40.984574 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe76baf0-9b8b-47e1-a6fe-2fcf0cc63e43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:27:40.985207 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76baf0-9b8b-47e1-a6fe-2fcf0cc63e43 service nova] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:40.985491 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76baf0-9b8b-47e1-a6fe-2fcf0cc63e43 service nova] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:40.985767 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76baf0-9b8b-47e1-a6fe-2fcf0cc63e43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:40.993995 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe76baf0-9b8b-47e1-a6fe-2fcf0cc63e43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:27:40.995567 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe76baf0-9b8b-47e1-a6fe-2fcf0cc63e43 service nova] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:27:41.005707 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 711/1431] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:27:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 09:27:41.871334 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40256b49-c1c8-43ae-8897-17c346a1ff30 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:41.871881 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40256b49-c1c8-43ae-8897-17c346a1ff30 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:41.871881 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40256b49-c1c8-43ae-8897-17c346a1ff30 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:41.873305 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 721/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 09:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:27:41.878178 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b1822-386e-470f-b122-afd4ba57209c None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:41.878632 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b1822-386e-470f-b122-afd4ba57209c None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:41.878740 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b1822-386e-470f-b122-afd4ba57209c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:41.896664 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-395b1822-386e-470f-b122-afd4ba57209c None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:27:41.897866 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-395b1822-386e-470f-b122-afd4ba57209c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:27:41.905586 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 712/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 09:27:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:27:42.056368 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40256b49-c1c8-43ae-8897-17c346a1ff30 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:27:42.070421 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40256b49-c1c8-43ae-8897-17c346a1ff30 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:27:42.075759 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0aef29-1eb4-40fc-9472-81aac2588af7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:27:42.076426 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0aef29-1eb4-40fc-9472-81aac2588af7 service nova] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:42.076708 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0aef29-1eb4-40fc-9472-81aac2588af7 service nova] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:42.076981 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0aef29-1eb4-40fc-9472-81aac2588af7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:42.086010 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0aef29-1eb4-40fc-9472-81aac2588af7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:27:42.087602 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0aef29-1eb4-40fc-9472-81aac2588af7 service nova] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:27:42.098086 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 722/1434] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:27:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:27:42.977027 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56524f88-45a3-430a-a962-8d619679fca2 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:42.977565 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56524f88-45a3-430a-a962-8d619679fca2 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:42.977670 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56524f88-45a3-430a-a962-8d619679fca2 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:42.979038 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 713/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 09:27:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:27:42.984641 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149a34e-8df9-4ffa-aeee-d39bbb9ba808 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:42.985054 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149a34e-8df9-4ffa-aeee-d39bbb9ba808 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:42.985218 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149a34e-8df9-4ffa-aeee-d39bbb9ba808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:43.005216 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-7149a34e-8df9-4ffa-aeee-d39bbb9ba808 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:27:43.006422 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-7149a34e-8df9-4ffa-aeee-d39bbb9ba808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:27:43.014321 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 723/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 09:27:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:27:43.167498 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56524f88-45a3-430a-a962-8d619679fca2 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:27:43.182309 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56524f88-45a3-430a-a962-8d619679fca2 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:27:43.187575 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6116f791-7e5b-4d84-ad67-0dedd5b02a5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:27:43.188220 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116f791-7e5b-4d84-ad67-0dedd5b02a5c service nova] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:43.188517 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116f791-7e5b-4d84-ad67-0dedd5b02a5c service nova] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:43.188796 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116f791-7e5b-4d84-ad67-0dedd5b02a5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:43.197904 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6116f791-7e5b-4d84-ad67-0dedd5b02a5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:27:43.199487 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6116f791-7e5b-4d84-ad67-0dedd5b02a5c service nova] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:27:43.209043 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 714/1437] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:27:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:27:44.088547 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685991c6-13fc-437a-a9a2-fa3f3d7d5bef None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:44.089183 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685991c6-13fc-437a-a9a2-fa3f3d7d5bef None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:44.089183 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685991c6-13fc-437a-a9a2-fa3f3d7d5bef None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:44.090570 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 724/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 09:27:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:27:44.095634 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526e6af-5e87-498a-956f-3972f08df805 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:44.099558 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526e6af-5e87-498a-956f-3972f08df805 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:44.099558 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526e6af-5e87-498a-956f-3972f08df805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:44.116190 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-0526e6af-5e87-498a-956f-3972f08df805 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:27:44.117449 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-0526e6af-5e87-498a-956f-3972f08df805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:27:44.125736 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 715/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 09:27:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:27:44.277428 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685991c6-13fc-437a-a9a2-fa3f3d7d5bef None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:27:44.291526 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685991c6-13fc-437a-a9a2-fa3f3d7d5bef None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:27:44.296853 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b9e0e-7c17-4a6f-8ff5-cae61e8894cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:27:44.297481 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b9e0e-7c17-4a6f-8ff5-cae61e8894cb service nova] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:44.297772 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b9e0e-7c17-4a6f-8ff5-cae61e8894cb service nova] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:44.298038 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b9e0e-7c17-4a6f-8ff5-cae61e8894cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:44.306590 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591b9e0e-7c17-4a6f-8ff5-cae61e8894cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:27:44.308157 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591b9e0e-7c17-4a6f-8ff5-cae61e8894cb service nova] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:27:44.318128 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 725/1440] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:27:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:27:46.266064 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa112eb-62f0-428b-8573-f335db0767dc None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:46.266635 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa112eb-62f0-428b-8573-f335db0767dc None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:46.266741 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa112eb-62f0-428b-8573-f335db0767dc None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:46.268390 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 716/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 09:27:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:27:46.274356 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523748d6-78cb-46e7-b046-b7f163184a0c None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:46.274859 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523748d6-78cb-46e7-b046-b7f163184a0c None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:46.274970 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523748d6-78cb-46e7-b046-b7f163184a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:46.293738 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-523748d6-78cb-46e7-b046-b7f163184a0c None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:27:46.294935 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-523748d6-78cb-46e7-b046-b7f163184a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:27:46.303380 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 726/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 09:27:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:27:46.341425 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa112eb-62f0-428b-8573-f335db0767dc None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:27:46.352670 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa112eb-62f0-428b-8573-f335db0767dc None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:27:46.356397 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779f3cd-b702-4e9e-a674-3bd0f3432f1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:27:46.357198 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779f3cd-b702-4e9e-a674-3bd0f3432f1c service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:46.357312 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779f3cd-b702-4e9e-a674-3bd0f3432f1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:46.358194 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779f3cd-b702-4e9e-a674-3bd0f3432f1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:46.368636 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0779f3cd-b702-4e9e-a674-3bd0f3432f1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:27:46.370003 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0779f3cd-b702-4e9e-a674-3bd0f3432f1c service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:27:46.380219 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 717/1443] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:27:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:27:48.581210 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01709c29-dd2c-4492-9627-e29905ea3923 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:48.581756 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01709c29-dd2c-4492-9627-e29905ea3923 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:48.581756 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01709c29-dd2c-4492-9627-e29905ea3923 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:48.583137 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 727/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 09:27:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:27:48.588681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b12e41-3d88-4b11-87e0-c429843469e3 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:48.589124 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b12e41-3d88-4b11-87e0-c429843469e3 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:48.589233 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b12e41-3d88-4b11-87e0-c429843469e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:48.607598 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-80b12e41-3d88-4b11-87e0-c429843469e3 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:27:48.608836 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-80b12e41-3d88-4b11-87e0-c429843469e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:27:48.616651 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 718/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 09:27:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:27:48.655660 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01709c29-dd2c-4492-9627-e29905ea3923 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:27:48.666381 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01709c29-dd2c-4492-9627-e29905ea3923 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:27:48.669932 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc43cc-28a7-4816-8fcc-cafc8b740592 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:27:48.670559 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc43cc-28a7-4816-8fcc-cafc8b740592 service neutron] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:48.670840 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc43cc-28a7-4816-8fcc-cafc8b740592 service neutron] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:48.671115 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc43cc-28a7-4816-8fcc-cafc8b740592 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:48.680072 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fc43cc-28a7-4816-8fcc-cafc8b740592 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:27:48.681520 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fc43cc-28a7-4816-8fcc-cafc8b740592 service neutron] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:27:48.692045 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 728/1446] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:27:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 09:27:51.179588 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6f97f-1bda-40ea-a29c-dbde6c45925f None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:51.180128 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6f97f-1bda-40ea-a29c-dbde6c45925f None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:51.180128 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6f97f-1bda-40ea-a29c-dbde6c45925f None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:51.181543 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 719/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 09:27:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:27:51.186734 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea166e33-319e-4ecd-bffd-03c19f2cf782 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:51.187163 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea166e33-319e-4ecd-bffd-03c19f2cf782 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:51.187308 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea166e33-319e-4ecd-bffd-03c19f2cf782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:51.205403 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-ea166e33-319e-4ecd-bffd-03c19f2cf782 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:27:51.206645 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-ea166e33-319e-4ecd-bffd-03c19f2cf782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:27:51.214560 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 729/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 09:27:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:27:51.253235 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6f97f-1bda-40ea-a29c-dbde6c45925f None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:27:51.264183 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6f97f-1bda-40ea-a29c-dbde6c45925f None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:27:51.267806 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f41073e-f206-4d69-a695-fb8320936238 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:27:51.268467 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41073e-f206-4d69-a695-fb8320936238 service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:51.268747 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41073e-f206-4d69-a695-fb8320936238 service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:51.269058 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41073e-f206-4d69-a695-fb8320936238 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:51.278748 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f41073e-f206-4d69-a695-fb8320936238 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:27:51.280241 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f41073e-f206-4d69-a695-fb8320936238 service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:27:51.290272 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 720/1449] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:27:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:27:53.457998 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c9c1b-c84d-4780-b3f2-4e771fe290b1 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:53.458662 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c9c1b-c84d-4780-b3f2-4e771fe290b1 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:53.458662 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c9c1b-c84d-4780-b3f2-4e771fe290b1 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:53.459859 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 730/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 09:27:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 09:27:53.465358 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dbe657-afc5-4bb5-a933-c29a1aa40b71 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:53.465804 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dbe657-afc5-4bb5-a933-c29a1aa40b71 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:53.465921 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dbe657-afc5-4bb5-a933-c29a1aa40b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:53.484327 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-39dbe657-afc5-4bb5-a933-c29a1aa40b71 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:27:53.485545 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-39dbe657-afc5-4bb5-a933-c29a1aa40b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:27:53.494303 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 721/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 09:27:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:27:53.536883 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c9c1b-c84d-4780-b3f2-4e771fe290b1 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:27:53.547705 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c9c1b-c84d-4780-b3f2-4e771fe290b1 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:27:53.551772 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586b4eb-bc6d-4add-aeb9-90a9ff26642f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:27:53.552449 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586b4eb-bc6d-4add-aeb9-90a9ff26642f service neutron] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:53.552733 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586b4eb-bc6d-4add-aeb9-90a9ff26642f service neutron] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:53.553005 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586b4eb-bc6d-4add-aeb9-90a9ff26642f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:53.562905 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5586b4eb-bc6d-4add-aeb9-90a9ff26642f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:27:53.564458 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5586b4eb-bc6d-4add-aeb9-90a9ff26642f service neutron] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:27:53.574084 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 731/1452] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:27:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:27:55.671535 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434397b-24b8-4651-81c1-f0d929a27db1 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:55.672086 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434397b-24b8-4651-81c1-f0d929a27db1 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:55.672086 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434397b-24b8-4651-81c1-f0d929a27db1 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:55.673491 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 722/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 09:27:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:27:55.678877 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ea5b7-ebd3-4ebf-9ae9-97ef608aeca3 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:55.679324 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ea5b7-ebd3-4ebf-9ae9-97ef608aeca3 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:55.679421 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ea5b7-ebd3-4ebf-9ae9-97ef608aeca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:55.696893 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-927ea5b7-ebd3-4ebf-9ae9-97ef608aeca3 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:27:55.698094 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-927ea5b7-ebd3-4ebf-9ae9-97ef608aeca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:27:55.706538 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 732/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 09:27:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:27:55.745110 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434397b-24b8-4651-81c1-f0d929a27db1 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:27:55.756262 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434397b-24b8-4651-81c1-f0d929a27db1 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:27:55.759770 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c74c7b-6f60-4af7-93d1-8ec55899057e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:27:55.760427 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c74c7b-6f60-4af7-93d1-8ec55899057e service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:55.760709 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c74c7b-6f60-4af7-93d1-8ec55899057e service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:55.760983 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c74c7b-6f60-4af7-93d1-8ec55899057e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:55.770452 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c74c7b-6f60-4af7-93d1-8ec55899057e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:27:55.771874 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c74c7b-6f60-4af7-93d1-8ec55899057e service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:27:55.781215 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 723/1455] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:27:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:27:57.858822 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3feed-2e5c-485c-be20-bff699762753 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:57.859368 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3feed-2e5c-485c-be20-bff699762753 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:57.859368 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3feed-2e5c-485c-be20-bff699762753 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:57.861726 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 733/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 09:27:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:27:57.867323 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b554c9c-cfde-4375-b1af-1bab1a62157b None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:57.867845 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b554c9c-cfde-4375-b1af-1bab1a62157b None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:57.867954 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b554c9c-cfde-4375-b1af-1bab1a62157b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:57.886242 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-4b554c9c-cfde-4375-b1af-1bab1a62157b None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:27:57.887419 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-4b554c9c-cfde-4375-b1af-1bab1a62157b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:27:57.895492 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 724/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 09:27:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:27:57.932920 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c3feed-2e5c-485c-be20-bff699762753 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:27:57.943832 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c3feed-2e5c-485c-be20-bff699762753 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:27:57.947559 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fccc01-56fa-4feb-be5e-218a53f65900 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:27:57.948186 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fccc01-56fa-4feb-be5e-218a53f65900 service neutron] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:27:57.948503 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fccc01-56fa-4feb-be5e-218a53f65900 service neutron] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:27:57.948779 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fccc01-56fa-4feb-be5e-218a53f65900 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:27:57.958052 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fccc01-56fa-4feb-be5e-218a53f65900 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:27:57.959471 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fccc01-56fa-4feb-be5e-218a53f65900 service neutron] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:27:57.968721 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 734/1458] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:27:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:28:00.068219 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b80d9-1f97-4dcb-8a34-cc647dac2f38 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:28:00.068814 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b80d9-1f97-4dcb-8a34-cc647dac2f38 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:28:00.068814 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b80d9-1f97-4dcb-8a34-cc647dac2f38 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:28:00.070207 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 725/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 09:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:28:00.075530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f17b48-a7e5-4e0f-95c9-40f4fa45ab91 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:28:00.075959 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f17b48-a7e5-4e0f-95c9-40f4fa45ab91 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:28:00.076077 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f17b48-a7e5-4e0f-95c9-40f4fa45ab91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:28:00.088779 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=72 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:28:00.094383 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-16f17b48-a7e5-4e0f-95c9-40f4fa45ab91 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:28:00.096137 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-16f17b48-a7e5-4e0f-95c9-40f4fa45ab91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:28:00.104185 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 735/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 09:28:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:28:00.140863 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695b80d9-1f97-4dcb-8a34-cc647dac2f38 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:28:00.152141 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695b80d9-1f97-4dcb-8a34-cc647dac2f38 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:28:00.155627 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d0209-77af-455c-92c3-061ef0b60c3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:28:00.156283 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d0209-77af-455c-92c3-061ef0b60c3a service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:28:00.156567 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d0209-77af-455c-92c3-061ef0b60c3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:28:00.156842 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d0209-77af-455c-92c3-061ef0b60c3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:28:00.166507 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d0209-77af-455c-92c3-061ef0b60c3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:28:00.167925 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d0209-77af-455c-92c3-061ef0b60c3a service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:28:00.177610 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 726/1461] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:28:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:28:02.328989 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a065933-d195-4cbb-b8ff-d58f5527cec4 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:28:02.330077 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a065933-d195-4cbb-b8ff-d58f5527cec4 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:28:02.330077 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a065933-d195-4cbb-b8ff-d58f5527cec4 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:28:02.331451 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 736/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 09:28:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:28:02.336937 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e6aec-e6d8-4559-a25b-16610aa3bdad None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:28:02.337379 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e6aec-e6d8-4559-a25b-16610aa3bdad None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:28:02.337477 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e6aec-e6d8-4559-a25b-16610aa3bdad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:28:02.343791 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=79 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:28:02.356496 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-897e6aec-e6d8-4559-a25b-16610aa3bdad None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:28:02.357700 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-897e6aec-e6d8-4559-a25b-16610aa3bdad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:28:02.365649 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 727/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 09:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 09:28:02.403743 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a065933-d195-4cbb-b8ff-d58f5527cec4 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:28:02.415887 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a065933-d195-4cbb-b8ff-d58f5527cec4 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:28:02.419572 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6721cc-62ae-433e-b06a-fb4aac712e1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:28:02.420241 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6721cc-62ae-433e-b06a-fb4aac712e1a service neutron] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:28:02.420521 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6721cc-62ae-433e-b06a-fb4aac712e1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:28:02.420801 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6721cc-62ae-433e-b06a-fb4aac712e1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:28:02.430392 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6721cc-62ae-433e-b06a-fb4aac712e1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:28:02.431823 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6721cc-62ae-433e-b06a-fb4aac712e1a service neutron] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:28:02.441208 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 737/1464] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:28:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:28:04.495361 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859d3e2-91e3-46b9-8899-f969d2763551 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:28:04.495894 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859d3e2-91e3-46b9-8899-f969d2763551 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:28:04.495894 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859d3e2-91e3-46b9-8899-f969d2763551 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:28:04.497229 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 728/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 09:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:28:04.503154 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857683fe-9fef-4b26-8f35-fa2233bbe2ed None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:28:04.503616 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857683fe-9fef-4b26-8f35-fa2233bbe2ed None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:28:04.503723 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857683fe-9fef-4b26-8f35-fa2233bbe2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:28:04.521272 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-857683fe-9fef-4b26-8f35-fa2233bbe2ed None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:28:04.522468 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-857683fe-9fef-4b26-8f35-fa2233bbe2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:28:04.530182 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 738/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 09:28:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:28:04.566894 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859d3e2-91e3-46b9-8899-f969d2763551 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:28:04.577565 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859d3e2-91e3-46b9-8899-f969d2763551 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:28:04.581592 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b756f-4c87-4b80-8d21-0f77962bc910 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:28:04.582218 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b756f-4c87-4b80-8d21-0f77962bc910 service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:28:04.582498 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b756f-4c87-4b80-8d21-0f77962bc910 service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:28:04.582772 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b756f-4c87-4b80-8d21-0f77962bc910 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:28:04.591705 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3b756f-4c87-4b80-8d21-0f77962bc910 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:28:04.593148 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3b756f-4c87-4b80-8d21-0f77962bc910 service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:28:04.603143 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 729/1467] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:28:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:28:06.662319 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773a9f8-4c23-492a-9baf-c1e5bf21fdc3 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:28:06.662913 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773a9f8-4c23-492a-9baf-c1e5bf21fdc3 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:28:06.662913 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773a9f8-4c23-492a-9baf-c1e5bf21fdc3 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:28:06.664282 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 739/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 09:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:28:06.669482 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ad445-7651-4645-babf-4aed7170ce4d None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:28:06.669870 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ad445-7651-4645-babf-4aed7170ce4d None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:28:06.670038 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ad445-7651-4645-babf-4aed7170ce4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:28:06.687951 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-411ad445-7651-4645-babf-4aed7170ce4d None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:28:06.689199 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-411ad445-7651-4645-babf-4aed7170ce4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:28:06.696996 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 730/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 09:28:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:28:06.734050 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3773a9f8-4c23-492a-9baf-c1e5bf21fdc3 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:28:06.745270 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3773a9f8-4c23-492a-9baf-c1e5bf21fdc3 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:28:06.748773 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734fdeb-fee7-4316-9c12-77bb045a4269 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:28:06.749399 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734fdeb-fee7-4316-9c12-77bb045a4269 service neutron] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:28:06.749682 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734fdeb-fee7-4316-9c12-77bb045a4269 service neutron] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:28:06.749956 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734fdeb-fee7-4316-9c12-77bb045a4269 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:28:06.759079 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9734fdeb-fee7-4316-9c12-77bb045a4269 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:28:06.760540 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9734fdeb-fee7-4316-9c12-77bb045a4269 service neutron] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:28:06.770083 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 740/1470] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:28:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:28:16.682965 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=11 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:28:16.765722 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=15 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:28:27.537296 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fa2ce-139b-4a6e-a22b-94053d4eb692 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:28:27.537892 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fa2ce-139b-4a6e-a22b-94053d4eb692 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:28:27.537892 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fa2ce-139b-4a6e-a22b-94053d4eb692 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:28:27.539273 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 731/1471] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:28:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:28:27.544786 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1135cc9-f24b-40f9-8b61-c66b364ec113 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:28:27.545247 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1135cc9-f24b-40f9-8b61-c66b364ec113 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:28:27.545346 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1135cc9-f24b-40f9-8b61-c66b364ec113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:28:27.563262 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-b1135cc9-f24b-40f9-8b61-c66b364ec113 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:28:27.564496 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-b1135cc9-f24b-40f9-8b61-c66b364ec113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:28:27.572191 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 741/1472] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:28:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 09:28:27.622884 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705ee0b-ec0d-4985-80b8-57e0399b5ed9 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:28:27.623234 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705ee0b-ec0d-4985-80b8-57e0399b5ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:28:27.623476 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705ee0b-ec0d-4985-80b8-57e0399b5ed9 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:28:27.624855 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 732/1473] 10.222.0.62 () {54 vars in 962 bytes} [Mon Jun 27 09:28:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:28:27.630689 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59774ed1-1dc2-4bf9-9e29-ff9b58bf211d None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:28:27.630973 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59774ed1-1dc2-4bf9-9e29-ff9b58bf211d None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:28:27.631255 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59774ed1-1dc2-4bf9-9e29-ff9b58bf211d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:28:27.651033 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-59774ed1-1dc2-4bf9-9e29-ff9b58bf211d None None] MFA Rules not processed for user `e6f97b803a28453c8b78fd8380ac64ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:28:27.652265 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-59774ed1-1dc2-4bf9-9e29-ff9b58bf211d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:28:27.660530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 742/1474] 10.222.0.62 () {58 vars in 1059 bytes} [Mon Jun 27 09:28:27 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:28:27.668053 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705ee0b-ec0d-4985-80b8-57e0399b5ed9 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:28:27.678739 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705ee0b-ec0d-4985-80b8-57e0399b5ed9 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:28:27.682274 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8164d771-2b42-4fbc-9af7-f5b1484304d5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6f97b803a28453c8b78fd8380ac64ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:28:27.682902 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164d771-2b42-4fbc-9af7-f5b1484304d5 service glance] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:28:27.683185 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164d771-2b42-4fbc-9af7-f5b1484304d5 service glance] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:28:27.683467 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164d771-2b42-4fbc-9af7-f5b1484304d5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:28:27.693915 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8164d771-2b42-4fbc-9af7-f5b1484304d5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:28:27.695343 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8164d771-2b42-4fbc-9af7-f5b1484304d5 service glance] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:28:27.705392 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 733/1475] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:28:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:28:29.873348 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5a7d4-d8bf-4c37-a0f8-53165a58910a None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:28:29.873912 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5a7d4-d8bf-4c37-a0f8-53165a58910a None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:28:29.873912 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5a7d4-d8bf-4c37-a0f8-53165a58910a None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:28:29.875304 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 743/1476] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:28:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:28:29.880965 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4805f63-8423-4e8f-abb8-6f3d3542251e None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:28:29.881357 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4805f63-8423-4e8f-abb8-6f3d3542251e None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:28:29.881509 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4805f63-8423-4e8f-abb8-6f3d3542251e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:28:29.898781 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-c4805f63-8423-4e8f-abb8-6f3d3542251e None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:28:29.899961 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-c4805f63-8423-4e8f-abb8-6f3d3542251e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:28:29.908214 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 734/1477] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:28:29.931595 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5a7d4-d8bf-4c37-a0f8-53165a58910a None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:28:29.943959 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5a7d4-d8bf-4c37-a0f8-53165a58910a None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:28:29.948328 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e2c70-6467-494a-8bd5-9ad2296db5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:28:29.948905 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e2c70-6467-494a-8bd5-9ad2296db5fc admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:28:29.949181 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e2c70-6467-494a-8bd5-9ad2296db5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:28:29.949447 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e2c70-6467-494a-8bd5-9ad2296db5fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:28:29.950172 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e2c70-6467-494a-8bd5-9ad2296db5fc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:28:29.951937 dv-cinder-847730-1-smb devstack@keystone.service[80306]: WARNING py.warnings [None req-f37e2c70-6467-494a-8bd5-9ad2296db5fc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 09:28:29.951937 dv-cinder-847730-1-smb devstack@keystone.service[80306]: warnings.warn(msg) Jun 27 09:28:29.951937 dv-cinder-847730-1-smb devstack@keystone.service[80306]: Jun 27 09:28:29.953112 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e2c70-6467-494a-8bd5-9ad2296db5fc admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:28:29.972020 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 744/1478] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Jun 27 09:28:29 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:28:32.037863 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa7be2-c926-447f-9a63-99305e53d746 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:28:32.038441 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa7be2-c926-447f-9a63-99305e53d746 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:28:32.038441 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa7be2-c926-447f-9a63-99305e53d746 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:28:32.039777 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 735/1479] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:28:32.045285 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62281c78-c92e-4ca3-98a6-a60bab9b44b2 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:28:32.045759 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62281c78-c92e-4ca3-98a6-a60bab9b44b2 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:28:32.045859 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62281c78-c92e-4ca3-98a6-a60bab9b44b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:28:32.064079 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-62281c78-c92e-4ca3-98a6-a60bab9b44b2 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:28:32.065361 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-62281c78-c92e-4ca3-98a6-a60bab9b44b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:28:32.073276 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 745/1480] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:28:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:28:32.119822 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa7be2-c926-447f-9a63-99305e53d746 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:28:32.135280 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa7be2-c926-447f-9a63-99305e53d746 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:28:32.141363 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb73c49-2811-4cbe-83d2-e537a728d62f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:28:32.142004 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb73c49-2811-4cbe-83d2-e537a728d62f service nova] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:28:32.142285 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb73c49-2811-4cbe-83d2-e537a728d62f service nova] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:28:32.142557 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb73c49-2811-4cbe-83d2-e537a728d62f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:28:32.151040 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb73c49-2811-4cbe-83d2-e537a728d62f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:28:32.152734 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb73c49-2811-4cbe-83d2-e537a728d62f service nova] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:28:32.162726 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 736/1481] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:28:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 09:28:34.371827 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94725f3c-c7cb-4e04-9bd8-afefe041d853 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:28:34.372374 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94725f3c-c7cb-4e04-9bd8-afefe041d853 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:28:34.372374 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94725f3c-c7cb-4e04-9bd8-afefe041d853 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:28:34.373685 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 746/1482] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:28:34.379902 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826cf8b-85db-460a-a2b8-b16644ad78f6 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:28:34.380357 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826cf8b-85db-460a-a2b8-b16644ad78f6 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:28:34.380491 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826cf8b-85db-460a-a2b8-b16644ad78f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:28:34.398568 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-5826cf8b-85db-460a-a2b8-b16644ad78f6 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:28:34.399778 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-5826cf8b-85db-460a-a2b8-b16644ad78f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:28:34.407667 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 737/1483] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:28:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:28:34.444490 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94725f3c-c7cb-4e04-9bd8-afefe041d853 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:28:34.455713 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94725f3c-c7cb-4e04-9bd8-afefe041d853 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:28:34.459173 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c8ab2-ddc8-4850-8549-e46d72bfad92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:28:34.459791 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c8ab2-ddc8-4850-8549-e46d72bfad92 service neutron] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:28:34.460071 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c8ab2-ddc8-4850-8549-e46d72bfad92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:28:34.460372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c8ab2-ddc8-4850-8549-e46d72bfad92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:28:34.469122 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c8ab2-ddc8-4850-8549-e46d72bfad92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:28:34.470535 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c8ab2-ddc8-4850-8549-e46d72bfad92 service neutron] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:28:34.479744 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 747/1484] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:28:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:28:36.554603 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd4257-75eb-460d-ab01-4fb357ca207c None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:28:36.555156 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd4257-75eb-460d-ab01-4fb357ca207c None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:28:36.555156 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd4257-75eb-460d-ab01-4fb357ca207c None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:28:36.556562 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 738/1485] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:28:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:28:36.562004 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9b4bf-4424-4a8d-a2fd-0eb2ee50794a None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:28:36.562450 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9b4bf-4424-4a8d-a2fd-0eb2ee50794a None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:28:36.562563 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9b4bf-4424-4a8d-a2fd-0eb2ee50794a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:28:36.580066 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-aba9b4bf-4424-4a8d-a2fd-0eb2ee50794a None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:28:36.581293 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-aba9b4bf-4424-4a8d-a2fd-0eb2ee50794a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:28:36.589262 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 748/1486] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:28:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:28:36.628105 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd4257-75eb-460d-ab01-4fb357ca207c None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:28:36.639486 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd4257-75eb-460d-ab01-4fb357ca207c None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:28:36.643056 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3661e5-958f-4bcd-8d91-96a66e9cae05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:28:36.643682 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3661e5-958f-4bcd-8d91-96a66e9cae05 service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:28:36.643966 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3661e5-958f-4bcd-8d91-96a66e9cae05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:28:36.644280 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3661e5-958f-4bcd-8d91-96a66e9cae05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:28:36.655503 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3661e5-958f-4bcd-8d91-96a66e9cae05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:28:36.659137 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3661e5-958f-4bcd-8d91-96a66e9cae05 service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:28:36.671338 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 739/1487] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:28:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:28:38.807888 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05da515-9c2c-4228-aa7b-4fc6369b71d4 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:28:38.808481 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05da515-9c2c-4228-aa7b-4fc6369b71d4 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:28:38.808481 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05da515-9c2c-4228-aa7b-4fc6369b71d4 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:28:38.809855 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 749/1488] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:28:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:28:38.815073 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5344e-4655-4732-b35f-9a10eee9739f None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:28:38.815514 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5344e-4655-4732-b35f-9a10eee9739f None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:28:38.815614 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5344e-4655-4732-b35f-9a10eee9739f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:28:38.833102 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-6aa5344e-4655-4732-b35f-9a10eee9739f None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:28:38.834293 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-6aa5344e-4655-4732-b35f-9a10eee9739f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:28:38.842178 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 740/1489] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:28:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:28:38.883551 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05da515-9c2c-4228-aa7b-4fc6369b71d4 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:28:38.894329 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05da515-9c2c-4228-aa7b-4fc6369b71d4 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:28:38.897915 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07454f2-ed19-48bb-905a-7b3126c1b659 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:28:38.898824 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07454f2-ed19-48bb-905a-7b3126c1b659 service neutron] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:28:38.899105 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07454f2-ed19-48bb-905a-7b3126c1b659 service neutron] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:28:38.899377 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07454f2-ed19-48bb-905a-7b3126c1b659 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:28:38.908906 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07454f2-ed19-48bb-905a-7b3126c1b659 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:28:38.910329 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07454f2-ed19-48bb-905a-7b3126c1b659 service neutron] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:28:38.919715 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 750/1490] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:28:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:28:41.382769 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15b4c1-6206-4202-8849-523acdd3c3bb None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:28:41.383345 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15b4c1-6206-4202-8849-523acdd3c3bb None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:28:41.383345 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15b4c1-6206-4202-8849-523acdd3c3bb None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:28:41.384639 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 741/1491] 10.222.0.62 () {54 vars in 926 bytes} [Mon Jun 27 09:28:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:28:41.389785 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f885874-2e12-4239-b147-66a2467dd421 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:28:41.390730 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f885874-2e12-4239-b147-66a2467dd421 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:28:41.390874 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f885874-2e12-4239-b147-66a2467dd421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:28:41.409748 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-8f885874-2e12-4239-b147-66a2467dd421 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:28:41.410956 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-8f885874-2e12-4239-b147-66a2467dd421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:28:41.418878 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 751/1492] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Jun 27 09:28:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:28:41.456961 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd15b4c1-6206-4202-8849-523acdd3c3bb None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:28:41.467488 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd15b4c1-6206-4202-8849-523acdd3c3bb None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:28:41.471595 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5182a38d-93f1-4bc3-a43e-37caa819781e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:28:41.472240 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182a38d-93f1-4bc3-a43e-37caa819781e service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:28:41.472525 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182a38d-93f1-4bc3-a43e-37caa819781e service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:28:41.472794 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182a38d-93f1-4bc3-a43e-37caa819781e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:28:41.481489 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5182a38d-93f1-4bc3-a43e-37caa819781e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:28:41.482909 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5182a38d-93f1-4bc3-a43e-37caa819781e service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:28:41.493247 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 742/1493] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:28:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:28:51.404181 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=33 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:28:51.488149 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=33 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:30:30.301272 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24925af7-e0aa-4aed-854a-a21126f84cf3 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:30:30.301948 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24925af7-e0aa-4aed-854a-a21126f84cf3 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:30:30.301948 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24925af7-e0aa-4aed-854a-a21126f84cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:30:30.321689 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-24925af7-e0aa-4aed-854a-a21126f84cf3 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:30:30.322904 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-24925af7-e0aa-4aed-854a-a21126f84cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:30:30.330911 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 752/1494] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:30:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:30:30.338815 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55263b01-cc63-42fe-9f22-a0fbda98e7ff None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:30:30.339309 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55263b01-cc63-42fe-9f22-a0fbda98e7ff None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:30:30.339407 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55263b01-cc63-42fe-9f22-a0fbda98e7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:30:30.357640 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-55263b01-cc63-42fe-9f22-a0fbda98e7ff None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:30:30.358825 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-55263b01-cc63-42fe-9f22-a0fbda98e7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:30:30.366897 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 743/1495] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:30:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:30:30.371422 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24925af7-e0aa-4aed-854a-a21126f84cf3 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:30:30.381910 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24925af7-e0aa-4aed-854a-a21126f84cf3 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:30:30.386387 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fce35e-2ee7-418c-bb5a-f88cd7c711f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:30:30.387036 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fce35e-2ee7-418c-bb5a-f88cd7c711f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:30:30.387314 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fce35e-2ee7-418c-bb5a-f88cd7c711f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:30:30.387586 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fce35e-2ee7-418c-bb5a-f88cd7c711f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:30:30.388339 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fce35e-2ee7-418c-bb5a-f88cd7c711f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:30:30.388642 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fce35e-2ee7-418c-bb5a-f88cd7c711f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:30:30.389647 dv-cinder-847730-1-smb devstack@keystone.service[80306]: WARNING py.warnings [None req-35fce35e-2ee7-418c-bb5a-f88cd7c711f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 09:30:30.389647 dv-cinder-847730-1-smb devstack@keystone.service[80306]: warnings.warn(msg) Jun 27 09:30:30.389647 dv-cinder-847730-1-smb devstack@keystone.service[80306]: Jun 27 09:30:30.390532 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fce35e-2ee7-418c-bb5a-f88cd7c711f3 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:30:30.402098 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 753/1496] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:30:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:30:30.410138 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55263b01-cc63-42fe-9f22-a0fbda98e7ff None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:30:30.420008 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55263b01-cc63-42fe-9f22-a0fbda98e7ff None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:30:30.426565 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d4945-9fe4-407b-a064-ce56aa82ec52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:30:30.427216 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d4945-9fe4-407b-a064-ce56aa82ec52 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:30:30.427499 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d4945-9fe4-407b-a064-ce56aa82ec52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:30:30.427772 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d4945-9fe4-407b-a064-ce56aa82ec52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:30:30.428487 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8d4945-9fe4-407b-a064-ce56aa82ec52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:30:30.430267 dv-cinder-847730-1-smb devstack@keystone.service[80307]: WARNING py.warnings [None req-1f8d4945-9fe4-407b-a064-ce56aa82ec52 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 09:30:30.430267 dv-cinder-847730-1-smb devstack@keystone.service[80307]: warnings.warn(msg) Jun 27 09:30:30.430267 dv-cinder-847730-1-smb devstack@keystone.service[80307]: Jun 27 09:30:30.431455 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8d4945-9fe4-407b-a064-ce56aa82ec52 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:30:30.562021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 744/1497] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:30:30 2022] POST /identity/v3/projects => generated 379 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:30:30.566665 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fce35e-2ee7-418c-bb5a-f88cd7c711f3 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:30:30.576792 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fce35e-2ee7-418c-bb5a-f88cd7c711f3 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:30:30.753580 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ea250-f4e9-49f3-a3ed-15f692f424e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:30:30.754567 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ea250-f4e9-49f3-a3ed-15f692f424e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:30:30.754854 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ea250-f4e9-49f3-a3ed-15f692f424e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:30:30.755153 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ea250-f4e9-49f3-a3ed-15f692f424e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:30:30.755878 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ea250-f4e9-49f3-a3ed-15f692f424e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:30:30.756927 dv-cinder-847730-1-smb devstack@keystone.service[80306]: WARNING py.warnings [None req-ab5ea250-f4e9-49f3-a3ed-15f692f424e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 09:30:30.756927 dv-cinder-847730-1-smb devstack@keystone.service[80306]: warnings.warn(msg) Jun 27 09:30:30.756927 dv-cinder-847730-1-smb devstack@keystone.service[80306]: Jun 27 09:30:30.758125 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ea250-f4e9-49f3-a3ed-15f692f424e0 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:30:30.858100 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 754/1498] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:30:30 2022] POST /identity/v3/users => generated 290 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:30:30.862232 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d4945-9fe4-407b-a064-ce56aa82ec52 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:30:30.872544 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d4945-9fe4-407b-a064-ce56aa82ec52 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:30:30.877717 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb090f-9882-445c-abf0-a425cb602c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:30:30.878383 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb090f-9882-445c-abf0-a425cb602c85 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:30:30.878665 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb090f-9882-445c-abf0-a425cb602c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:30:30.878941 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb090f-9882-445c-abf0-a425cb602c85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:30:30.879674 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb090f-9882-445c-abf0-a425cb602c85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:30:30.880831 dv-cinder-847730-1-smb devstack@keystone.service[80307]: WARNING py.warnings [None req-20eb090f-9882-445c-abf0-a425cb602c85 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 09:30:30.880831 dv-cinder-847730-1-smb devstack@keystone.service[80307]: warnings.warn(msg) Jun 27 09:30:30.880831 dv-cinder-847730-1-smb devstack@keystone.service[80307]: Jun 27 09:30:30.881720 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb090f-9882-445c-abf0-a425cb602c85 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:30:30.895309 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 745/1499] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:30:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:30:30.899378 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ea250-f4e9-49f3-a3ed-15f692f424e0 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:30:30.910219 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ea250-f4e9-49f3-a3ed-15f692f424e0 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:30:30.914778 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0dc2e-5f2f-4ebb-80b3-38d30b5eb64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:30:30.915433 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0dc2e-5f2f-4ebb-80b3-38d30b5eb64b admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:30:30.915717 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0dc2e-5f2f-4ebb-80b3-38d30b5eb64b admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:30:30.915994 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0dc2e-5f2f-4ebb-80b3-38d30b5eb64b admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:30:30.916751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba0dc2e-5f2f-4ebb-80b3-38d30b5eb64b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:30:30.917756 dv-cinder-847730-1-smb devstack@keystone.service[80306]: WARNING py.warnings [None req-7ba0dc2e-5f2f-4ebb-80b3-38d30b5eb64b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 09:30:30.917756 dv-cinder-847730-1-smb devstack@keystone.service[80306]: warnings.warn(msg) Jun 27 09:30:30.917756 dv-cinder-847730-1-smb devstack@keystone.service[80306]: Jun 27 09:30:30.918627 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba0dc2e-5f2f-4ebb-80b3-38d30b5eb64b admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:30:30.931769 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 755/1500] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:30:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:30:30.935860 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb090f-9882-445c-abf0-a425cb602c85 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:30:30.945808 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb090f-9882-445c-abf0-a425cb602c85 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:30:30.950841 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7236dc0-f69a-4773-bd61-ba2da3dc03bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:30:30.951713 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7236dc0-f69a-4773-bd61-ba2da3dc03bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:30:30.951990 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7236dc0-f69a-4773-bd61-ba2da3dc03bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:30:30.952305 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7236dc0-f69a-4773-bd61-ba2da3dc03bb admin admin] PATH_INFO: `/v3/projects/532e346c1769489fab757d9f794a75aa/users/ce512c80cdb241a8ac0598548ce16909/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:30:30.967404 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7236dc0-f69a-4773-bd61-ba2da3dc03bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=532e346c1769489fab757d9f794a75aa, user_id=ce512c80cdb241a8ac0598548ce16909, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:30:30.968474 dv-cinder-847730-1-smb devstack@keystone.service[80307]: WARNING py.warnings [None req-e7236dc0-f69a-4773-bd61-ba2da3dc03bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 09:30:30.968474 dv-cinder-847730-1-smb devstack@keystone.service[80307]: warnings.warn(msg) Jun 27 09:30:30.968474 dv-cinder-847730-1-smb devstack@keystone.service[80307]: Jun 27 09:30:30.970414 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7236dc0-f69a-4773-bd61-ba2da3dc03bb admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:30:31.075421 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 746/1501] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:30:30 2022] PUT /identity/v3/projects/532e346c1769489fab757d9f794a75aa/users/ce512c80cdb241a8ac0598548ce16909/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:30:31.086721 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e91be1-e538-4a13-b2f6-c9715f37958d None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:30:31.087050 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e91be1-e538-4a13-b2f6-c9715f37958d None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:30:31.087328 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e91be1-e538-4a13-b2f6-c9715f37958d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:30:31.115943 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-b8e91be1-e538-4a13-b2f6-c9715f37958d None None] MFA Rules not processed for user `ce512c80cdb241a8ac0598548ce16909`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:30:31.117221 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-b8e91be1-e538-4a13-b2f6-c9715f37958d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:30:31.181141 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 756/1502] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:30:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:30:31.195305 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43f4aa-7d80-4cc0-a5a3-58b5374e45be None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:30:31.195660 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43f4aa-7d80-4cc0-a5a3-58b5374e45be None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:30:31.196003 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43f4aa-7d80-4cc0-a5a3-58b5374e45be None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:30:31.199036 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 747/1503] 10.222.0.62 () {54 vars in 963 bytes} [Mon Jun 27 09:30:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:30:31.204900 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b057c-206c-408a-ad35-97b476a3c4b5 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:30:31.205286 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b057c-206c-408a-ad35-97b476a3c4b5 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:30:31.205606 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b057c-206c-408a-ad35-97b476a3c4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:30:31.223315 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-873b057c-206c-408a-ad35-97b476a3c4b5 None None] MFA Rules not processed for user `333bceb4a90749df97595b7f38bf7ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:30:31.224557 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-873b057c-206c-408a-ad35-97b476a3c4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:30:31.267781 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:30:31.275798 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 757/1504] 10.222.0.62 () {58 vars in 1060 bytes} [Mon Jun 27 09:30:31 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:30:31.283520 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc43f4aa-7d80-4cc0-a5a3-58b5374e45be None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:30:31.297059 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc43f4aa-7d80-4cc0-a5a3-58b5374e45be None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:30:31.301586 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a607e4-2e4b-40db-b9b0-94ed38d4993d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:30:31.302445 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a607e4-2e4b-40db-b9b0-94ed38d4993d service cinder] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:30:31.302734 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a607e4-2e4b-40db-b9b0-94ed38d4993d service cinder] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:30:31.303007 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a607e4-2e4b-40db-b9b0-94ed38d4993d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:30:31.312572 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a607e4-2e4b-40db-b9b0-94ed38d4993d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:30:31.314260 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a607e4-2e4b-40db-b9b0-94ed38d4993d service cinder] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:30:31.323056 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 748/1505] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:30:31 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:30:31.365550 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eea6dc-13ea-4a43-87a3-c0b52a1f98a4 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:30:31.365994 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eea6dc-13ea-4a43-87a3-c0b52a1f98a4 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:30:31.365994 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eea6dc-13ea-4a43-87a3-c0b52a1f98a4 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:30:31.367245 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 758/1506] 10.222.0.62 () {52 vars in 829 bytes} [Mon Jun 27 09:30:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:30:31.370753 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a607e4-2e4b-40db-b9b0-94ed38d4993d service cinder] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:30:31.443627 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a607e4-2e4b-40db-b9b0-94ed38d4993d service cinder] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:30:31.448553 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085796cd-468f-4ba4-8504-28821ecfe190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:30:31.449665 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085796cd-468f-4ba4-8504-28821ecfe190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:30:31.450681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085796cd-468f-4ba4-8504-28821ecfe190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:30:31.451114 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085796cd-468f-4ba4-8504-28821ecfe190 admin admin] PATH_INFO: `/v3/users/ce512c80cdb241a8ac0598548ce16909` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:30:31.455733 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085796cd-468f-4ba4-8504-28821ecfe190 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce512c80cdb241a8ac0598548ce16909)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:30:31.457071 dv-cinder-847730-1-smb devstack@keystone.service[80307]: WARNING py.warnings [None req-085796cd-468f-4ba4-8504-28821ecfe190 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 09:30:31.457071 dv-cinder-847730-1-smb devstack@keystone.service[80307]: warnings.warn(msg) Jun 27 09:30:31.457071 dv-cinder-847730-1-smb devstack@keystone.service[80307]: Jun 27 09:30:31.458681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085796cd-468f-4ba4-8504-28821ecfe190 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:30:31.693453 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-085796cd-468f-4ba4-8504-28821ecfe190 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce512c80cdb241a8ac0598548ce16909'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:30:31.706118 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-085796cd-468f-4ba4-8504-28821ecfe190 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce512c80cdb241a8ac0598548ce16909'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:30:31.782039 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-085796cd-468f-4ba4-8504-28821ecfe190 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce512c80cdb241a8ac0598548ce16909'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:30:31.782857 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-085796cd-468f-4ba4-8504-28821ecfe190 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce512c80cdb241a8ac0598548ce16909'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:30:31.800473 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:30:31.802996 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-085796cd-468f-4ba4-8504-28821ecfe190 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce512c80cdb241a8ac0598548ce16909'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:30:31.809060 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 749/1507] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:30:31 2022] DELETE /identity/v3/users/ce512c80cdb241a8ac0598548ce16909 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:30:31.814091 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e740e-bc16-4357-8cb5-64650c990347 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:30:31.814377 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e740e-bc16-4357-8cb5-64650c990347 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:30:31.814682 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e740e-bc16-4357-8cb5-64650c990347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:30:31.831861 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-e61e740e-bc16-4357-8cb5-64650c990347 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:30:31.833136 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-e61e740e-bc16-4357-8cb5-64650c990347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:30:31.893005 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 759/1508] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:30:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:30:31.902840 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085796cd-468f-4ba4-8504-28821ecfe190 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:30:31.904383 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-085796cd-468f-4ba4-8504-28821ecfe190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:30:31.964860 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085796cd-468f-4ba4-8504-28821ecfe190 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:30:31.969148 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16017347-2591-4ad4-a2d7-d958c2816cb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:30:31.969821 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16017347-2591-4ad4-a2d7-d958c2816cb0 service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:30:31.970107 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16017347-2591-4ad4-a2d7-d958c2816cb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:30:31.970382 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16017347-2591-4ad4-a2d7-d958c2816cb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:30:31.980336 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16017347-2591-4ad4-a2d7-d958c2816cb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:30:31.981822 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16017347-2591-4ad4-a2d7-d958c2816cb0 service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:30:31.992979 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 750/1509] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:30:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:30:32.528165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e740e-bc16-4357-8cb5-64650c990347 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:30:32.533754 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-e61e740e-bc16-4357-8cb5-64650c990347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:30:32.542478 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e740e-bc16-4357-8cb5-64650c990347 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:30:32.547483 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ddd05f-ccf3-4935-b0ac-c05f338e6749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:30:32.548396 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddd05f-ccf3-4935-b0ac-c05f338e6749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:30:32.548682 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddd05f-ccf3-4935-b0ac-c05f338e6749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:30:32.548957 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddd05f-ccf3-4935-b0ac-c05f338e6749 admin admin] PATH_INFO: `/v3/projects/532e346c1769489fab757d9f794a75aa` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:30:32.550182 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ddd05f-ccf3-4935-b0ac-c05f338e6749 admin admin] RBAC: Authorizing `identity:delete_project(project_id=532e346c1769489fab757d9f794a75aa)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:30:32.551286 dv-cinder-847730-1-smb devstack@keystone.service[80306]: WARNING py.warnings [None req-58ddd05f-ccf3-4935-b0ac-c05f338e6749 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 09:30:32.551286 dv-cinder-847730-1-smb devstack@keystone.service[80306]: warnings.warn(msg) Jun 27 09:30:32.551286 dv-cinder-847730-1-smb devstack@keystone.service[80306]: Jun 27 09:30:32.552427 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ddd05f-ccf3-4935-b0ac-c05f338e6749 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:30:32.873874 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-58ddd05f-ccf3-4935-b0ac-c05f338e6749 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '532e346c1769489fab757d9f794a75aa', 'request_id': 'req-58ddd05f-ccf3-4935-b0ac-c05f338e6749'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:30:32.948451 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-58ddd05f-ccf3-4935-b0ac-c05f338e6749 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '532e346c1769489fab757d9f794a75aa', 'request_id': 'req-58ddd05f-ccf3-4935-b0ac-c05f338e6749'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:30:32.955616 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-58ddd05f-ccf3-4935-b0ac-c05f338e6749 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '532e346c1769489fab757d9f794a75aa', 'request_id': 'req-58ddd05f-ccf3-4935-b0ac-c05f338e6749'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:30:32.974844 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-58ddd05f-ccf3-4935-b0ac-c05f338e6749 admin admin] The token cache is being invalidate because project 532e346c1769489fab757d9f794a75aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:30:32.975124 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-58ddd05f-ccf3-4935-b0ac-c05f338e6749 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:30:32.975768 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-58ddd05f-ccf3-4935-b0ac-c05f338e6749 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:30:32.977399 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 760/1510] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:30:32 2022] DELETE /identity/v3/projects/532e346c1769489fab757d9f794a75aa => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:30:41.988277 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:30:42.977467 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:32:20.363241 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826ea40-6fcf-4d02-8447-ff88e2856d78 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:32:20.363893 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826ea40-6fcf-4d02-8447-ff88e2856d78 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:32:20.363893 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826ea40-6fcf-4d02-8447-ff88e2856d78 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:32:20.365366 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 751/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 09:32:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:32:20.370471 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa125a-1623-4bf2-9aa2-57d40472e356 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:32:20.370939 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa125a-1623-4bf2-9aa2-57d40472e356 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:32:20.371058 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa125a-1623-4bf2-9aa2-57d40472e356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:32:20.389339 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-f5aa125a-1623-4bf2-9aa2-57d40472e356 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:32:20.390560 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-f5aa125a-1623-4bf2-9aa2-57d40472e356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:32:20.452861 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 761/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 09:32:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:32:20.611424 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826ea40-6fcf-4d02-8447-ff88e2856d78 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:32:20.613224 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-c826ea40-6fcf-4d02-8447-ff88e2856d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:32:20.687999 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826ea40-6fcf-4d02-8447-ff88e2856d78 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:32:20.693222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743fa355-24ab-42cb-9ffa-208e12814ba7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:32:20.693891 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fa355-24ab-42cb-9ffa-208e12814ba7 service nova] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:32:20.694166 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fa355-24ab-42cb-9ffa-208e12814ba7 service nova] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:32:20.694434 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fa355-24ab-42cb-9ffa-208e12814ba7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:32:20.702835 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743fa355-24ab-42cb-9ffa-208e12814ba7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:32:20.704457 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743fa355-24ab-42cb-9ffa-208e12814ba7 service nova] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:32:20.714337 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 752/1513] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:32:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:32:21.553847 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9bcb9-3ebf-49c8-9c1d-384763add6ad None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:32:21.554401 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9bcb9-3ebf-49c8-9c1d-384763add6ad None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:32:21.554401 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9bcb9-3ebf-49c8-9c1d-384763add6ad None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:32:21.556355 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 762/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 09:32:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:32:21.561211 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df0bae-7b62-4d1c-b61d-c5e9b228b026 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:32:21.561669 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df0bae-7b62-4d1c-b61d-c5e9b228b026 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:32:21.561782 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df0bae-7b62-4d1c-b61d-c5e9b228b026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:32:21.579770 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-83df0bae-7b62-4d1c-b61d-c5e9b228b026 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:32:21.581006 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-83df0bae-7b62-4d1c-b61d-c5e9b228b026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:32:21.588795 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 753/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 09:32:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:32:21.739758 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec9bcb9-3ebf-49c8-9c1d-384763add6ad None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:32:21.754731 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec9bcb9-3ebf-49c8-9c1d-384763add6ad None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:32:21.760101 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb3a4fb-6168-417f-9f13-6050c6d86a8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:32:21.760753 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3a4fb-6168-417f-9f13-6050c6d86a8b service nova] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:32:21.761034 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3a4fb-6168-417f-9f13-6050c6d86a8b service nova] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:32:21.761340 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3a4fb-6168-417f-9f13-6050c6d86a8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:32:21.769407 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb3a4fb-6168-417f-9f13-6050c6d86a8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:32:21.770977 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb3a4fb-6168-417f-9f13-6050c6d86a8b service nova] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:32:21.780304 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 763/1516] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:32:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:32:22.096942 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d263f-d060-4164-a89b-e5d9ea74aa2a None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:32:22.097156 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d263f-d060-4164-a89b-e5d9ea74aa2a None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:32:22.097420 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d263f-d060-4164-a89b-e5d9ea74aa2a None None] PATH_INFO: `/v3` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:32:22.098763 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 754/1517] 10.222.0.69 () {54 vars in 925 bytes} [Mon Jun 27 09:32:22 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:32:22.105061 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb302d-1f3a-4938-94df-f1f6c341efe2 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:32:22.105416 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb302d-1f3a-4938-94df-f1f6c341efe2 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:32:22.105780 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb302d-1f3a-4938-94df-f1f6c341efe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:32:22.124672 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-f4cb302d-1f3a-4938-94df-f1f6c341efe2 None None] MFA Rules not processed for user `2bbaf738138b40b2a06bb63934f6608c`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:32:22.125873 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-f4cb302d-1f3a-4938-94df-f1f6c341efe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:32:22.186908 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 764/1518] 10.222.0.69 () {58 vars in 1015 bytes} [Mon Jun 27 09:32:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:32:31.571341 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ccfda-b59e-41d6-978c-f560c6433be5 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:32:31.571926 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ccfda-b59e-41d6-978c-f560c6433be5 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:32:31.571926 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ccfda-b59e-41d6-978c-f560c6433be5 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:32:31.573649 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 755/1519] 10.222.0.62 () {54 vars in 960 bytes} [Mon Jun 27 09:32:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:32:31.574431 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=37 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:32:31.579031 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82b658-fc20-45d0-8963-a5fad924ee6a None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:32:31.579532 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82b658-fc20-45d0-8963-a5fad924ee6a None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:32:31.579675 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82b658-fc20-45d0-8963-a5fad924ee6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:32:31.598448 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-ef82b658-fc20-45d0-8963-a5fad924ee6a None None] MFA Rules not processed for user `2bbaf738138b40b2a06bb63934f6608c`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:32:31.599656 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-ef82b658-fc20-45d0-8963-a5fad924ee6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:32:31.608825 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 765/1520] 10.222.0.62 () {58 vars in 1057 bytes} [Mon Jun 27 09:32:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:32:31.616636 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ccfda-b59e-41d6-978c-f560c6433be5 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:32:31.630382 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ccfda-b59e-41d6-978c-f560c6433be5 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:32:31.635294 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f8976-9b12-4ae1-989c-88ef5069c3c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbaf738138b40b2a06bb63934f6608c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:32:31.635931 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f8976-9b12-4ae1-989c-88ef5069c3c9 service placement] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:32:31.636235 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f8976-9b12-4ae1-989c-88ef5069c3c9 service placement] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:32:31.636515 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f8976-9b12-4ae1-989c-88ef5069c3c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:32:31.645893 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f8976-9b12-4ae1-989c-88ef5069c3c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:32:31.647489 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f8976-9b12-4ae1-989c-88ef5069c3c9 service placement] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:32:31.657683 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 756/1521] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:32:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:32:33.044024 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749be3cb-b9d9-415a-84dd-03b20cdff786 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:32:33.044628 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749be3cb-b9d9-415a-84dd-03b20cdff786 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:32:33.044628 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749be3cb-b9d9-415a-84dd-03b20cdff786 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:32:33.045981 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 766/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 09:32:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:32:33.050963 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad990e-5ac7-44ce-8caa-af73943562b8 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:32:33.051432 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad990e-5ac7-44ce-8caa-af73943562b8 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:32:33.051540 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad990e-5ac7-44ce-8caa-af73943562b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:32:33.070098 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-a8ad990e-5ac7-44ce-8caa-af73943562b8 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:32:33.072068 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-a8ad990e-5ac7-44ce-8caa-af73943562b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:32:33.080071 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 757/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 09:32:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:32:33.233370 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749be3cb-b9d9-415a-84dd-03b20cdff786 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:32:33.248292 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749be3cb-b9d9-415a-84dd-03b20cdff786 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:32:33.253695 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9180f3f2-e015-49df-ae12-41d4ece06d5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:32:33.254339 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180f3f2-e015-49df-ae12-41d4ece06d5b service nova] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:32:33.254618 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180f3f2-e015-49df-ae12-41d4ece06d5b service nova] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:32:33.254967 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180f3f2-e015-49df-ae12-41d4ece06d5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:32:33.263770 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9180f3f2-e015-49df-ae12-41d4ece06d5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:32:33.265390 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9180f3f2-e015-49df-ae12-41d4ece06d5b service nova] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:32:33.275556 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 767/1524] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:32:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:32:34.101493 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65d1d6-ee24-49d7-8e18-7888650f759d None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:32:34.102074 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65d1d6-ee24-49d7-8e18-7888650f759d None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:32:34.102074 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65d1d6-ee24-49d7-8e18-7888650f759d None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:32:34.104345 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 758/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 09:32:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:32:34.109413 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20aa5fc-08b0-406d-896e-4bbf9e03ae86 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:32:34.109885 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20aa5fc-08b0-406d-896e-4bbf9e03ae86 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:32:34.110283 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20aa5fc-08b0-406d-896e-4bbf9e03ae86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:32:34.128807 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-f20aa5fc-08b0-406d-896e-4bbf9e03ae86 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:32:34.129990 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-f20aa5fc-08b0-406d-896e-4bbf9e03ae86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:32:34.138272 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 768/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 09:32:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:32:34.290976 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65d1d6-ee24-49d7-8e18-7888650f759d None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:32:34.306089 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65d1d6-ee24-49d7-8e18-7888650f759d None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:32:34.311523 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e94cc-07a6-4b29-9138-c5a8a1f1c2a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:32:34.312154 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e94cc-07a6-4b29-9138-c5a8a1f1c2a3 service nova] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:32:34.312467 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e94cc-07a6-4b29-9138-c5a8a1f1c2a3 service nova] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:32:34.312742 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e94cc-07a6-4b29-9138-c5a8a1f1c2a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:32:34.320951 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4e94cc-07a6-4b29-9138-c5a8a1f1c2a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:32:34.322543 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4e94cc-07a6-4b29-9138-c5a8a1f1c2a3 service nova] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:32:34.332178 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 759/1527] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:32:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:32:38.500562 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b13b4-4c40-4ab1-8785-e582bf61a0dd None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:32:38.501108 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b13b4-4c40-4ab1-8785-e582bf61a0dd None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:32:38.501108 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b13b4-4c40-4ab1-8785-e582bf61a0dd None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:32:38.502434 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 769/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 09:32:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:32:38.507819 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf9e0a-e988-4ed6-817f-03b6424d3605 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:32:38.508287 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf9e0a-e988-4ed6-817f-03b6424d3605 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:32:38.508402 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf9e0a-e988-4ed6-817f-03b6424d3605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:32:38.526732 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-05bf9e0a-e988-4ed6-817f-03b6424d3605 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:32:38.527930 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-05bf9e0a-e988-4ed6-817f-03b6424d3605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:32:38.536001 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 760/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 09:32:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 09:32:38.573248 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b13b4-4c40-4ab1-8785-e582bf61a0dd None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:32:38.574961 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-815b13b4-4c40-4ab1-8785-e582bf61a0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:32:38.632746 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b13b4-4c40-4ab1-8785-e582bf61a0dd None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:32:38.636328 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed8f9ba-8b25-46c0-baf3-ec2b837fc92a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:32:38.636999 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8f9ba-8b25-46c0-baf3-ec2b837fc92a service neutron] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:32:38.637281 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8f9ba-8b25-46c0-baf3-ec2b837fc92a service neutron] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:32:38.637555 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8f9ba-8b25-46c0-baf3-ec2b837fc92a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:32:38.646484 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed8f9ba-8b25-46c0-baf3-ec2b837fc92a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:32:38.647901 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed8f9ba-8b25-46c0-baf3-ec2b837fc92a service neutron] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:32:38.653315 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:32:38.658310 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 770/1530] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:32:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:32:40.694053 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ca8fa-7e1e-4fca-a831-db2d617e657e None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:32:40.694600 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ca8fa-7e1e-4fca-a831-db2d617e657e None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:32:40.694600 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ca8fa-7e1e-4fca-a831-db2d617e657e None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:32:40.696019 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 761/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 09:32:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:32:40.701331 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1544e-4bb1-4e8a-b603-0a665a0483c4 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:32:40.701778 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1544e-4bb1-4e8a-b603-0a665a0483c4 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:32:40.701884 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1544e-4bb1-4e8a-b603-0a665a0483c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:32:40.720321 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-dac1544e-4bb1-4e8a-b603-0a665a0483c4 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:32:40.721524 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-dac1544e-4bb1-4e8a-b603-0a665a0483c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:32:40.729955 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 771/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 09:32:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:32:40.765976 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ca8fa-7e1e-4fca-a831-db2d617e657e None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:32:40.777337 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ca8fa-7e1e-4fca-a831-db2d617e657e None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:32:40.780840 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a189f-d433-4f98-acde-c9f91dda2fce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:32:40.781468 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a189f-d433-4f98-acde-c9f91dda2fce service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:32:40.781751 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a189f-d433-4f98-acde-c9f91dda2fce service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:32:40.782025 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a189f-d433-4f98-acde-c9f91dda2fce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:32:40.791711 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108a189f-d433-4f98-acde-c9f91dda2fce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:32:40.793162 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108a189f-d433-4f98-acde-c9f91dda2fce service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:32:40.802494 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 762/1533] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:32:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:32:44.342187 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d6245-3f6c-4127-a3a0-f0a3b1319db7 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:32:44.342774 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d6245-3f6c-4127-a3a0-f0a3b1319db7 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:32:44.342774 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d6245-3f6c-4127-a3a0-f0a3b1319db7 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:32:44.344111 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 772/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 09:32:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:32:44.349263 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4345bff-1fff-449c-bc6f-199a2f936566 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:32:44.349659 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4345bff-1fff-449c-bc6f-199a2f936566 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:32:44.349831 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4345bff-1fff-449c-bc6f-199a2f936566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:32:44.368397 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-a4345bff-1fff-449c-bc6f-199a2f936566 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:32:44.369590 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-a4345bff-1fff-449c-bc6f-199a2f936566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:32:44.377715 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 763/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 09:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:32:44.681953 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d6245-3f6c-4127-a3a0-f0a3b1319db7 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:32:44.683630 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-1f0d6245-3f6c-4127-a3a0-f0a3b1319db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:32:44.744987 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d6245-3f6c-4127-a3a0-f0a3b1319db7 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:32:44.748784 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15554ec3-8f5d-4cd6-8a93-c2f6e736e910 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:32:44.749422 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15554ec3-8f5d-4cd6-8a93-c2f6e736e910 service cinder] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:32:44.749710 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15554ec3-8f5d-4cd6-8a93-c2f6e736e910 service cinder] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:32:44.749985 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15554ec3-8f5d-4cd6-8a93-c2f6e736e910 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:32:44.759589 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15554ec3-8f5d-4cd6-8a93-c2f6e736e910 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:32:44.761110 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15554ec3-8f5d-4cd6-8a93-c2f6e736e910 service cinder] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:32:44.770545 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 773/1536] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:32:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:32:46.887709 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f943d88-e4f8-45f2-a021-a8667fbedfa1 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:32:46.888334 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f943d88-e4f8-45f2-a021-a8667fbedfa1 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:32:46.888334 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f943d88-e4f8-45f2-a021-a8667fbedfa1 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:32:46.889753 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 764/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 09:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:32:46.895058 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3caf2b-260e-429c-8310-640a8352e224 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:32:46.895474 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3caf2b-260e-429c-8310-640a8352e224 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:32:46.895603 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3caf2b-260e-429c-8310-640a8352e224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:32:46.914489 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-9f3caf2b-260e-429c-8310-640a8352e224 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:32:46.915676 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-9f3caf2b-260e-429c-8310-640a8352e224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:32:46.923348 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 774/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 09:32:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:32:47.231896 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f943d88-e4f8-45f2-a021-a8667fbedfa1 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:32:47.233724 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-6f943d88-e4f8-45f2-a021-a8667fbedfa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:32:47.247556 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f943d88-e4f8-45f2-a021-a8667fbedfa1 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:32:47.251104 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe74bf9-fa3c-4300-83e9-a210d8e7d939 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:32:47.251732 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe74bf9-fa3c-4300-83e9-a210d8e7d939 service cinder] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:32:47.252014 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe74bf9-fa3c-4300-83e9-a210d8e7d939 service cinder] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:32:47.252322 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe74bf9-fa3c-4300-83e9-a210d8e7d939 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:32:47.261066 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe74bf9-fa3c-4300-83e9-a210d8e7d939 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:32:47.262492 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe74bf9-fa3c-4300-83e9-a210d8e7d939 service cinder] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:32:47.272095 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 765/1539] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:32:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:32:56.909296 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=32 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:32:57.267894 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=33 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:34:28.170605 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad428a99-882f-466e-bbfb-cbf6e5284d78 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:28.171238 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad428a99-882f-466e-bbfb-cbf6e5284d78 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:28.171238 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad428a99-882f-466e-bbfb-cbf6e5284d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:28.192342 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-ad428a99-882f-466e-bbfb-cbf6e5284d78 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:28.193545 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-ad428a99-882f-466e-bbfb-cbf6e5284d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:28.207543 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 775/1540] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:28.216895 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cacb8c-c5e5-4f39-8edc-7b53da041668 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:28.217499 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cacb8c-c5e5-4f39-8edc-7b53da041668 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:28.217499 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cacb8c-c5e5-4f39-8edc-7b53da041668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:28.240471 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-72cacb8c-c5e5-4f39-8edc-7b53da041668 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:28.241710 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-72cacb8c-c5e5-4f39-8edc-7b53da041668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:28.256259 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 766/1541] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:28.260748 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad428a99-882f-466e-bbfb-cbf6e5284d78 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:28.278638 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad428a99-882f-466e-bbfb-cbf6e5284d78 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:28.285882 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e989b8-a955-4d55-92f5-9a272ce40646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:28.286557 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e989b8-a955-4d55-92f5-9a272ce40646 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:28.286835 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e989b8-a955-4d55-92f5-9a272ce40646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:28.287103 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e989b8-a955-4d55-92f5-9a272ce40646 admin admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:28.287831 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e989b8-a955-4d55-92f5-9a272ce40646 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:34:28.288132 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e989b8-a955-4d55-92f5-9a272ce40646 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:28.289778 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e989b8-a955-4d55-92f5-9a272ce40646 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:28.307584 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 776/1542] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:34:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:34:28.316237 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cacb8c-c5e5-4f39-8edc-7b53da041668 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:28.325677 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cacb8c-c5e5-4f39-8edc-7b53da041668 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:28.336249 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc516b3-0eb4-4011-a44f-d2a384691939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:28.336926 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc516b3-0eb4-4011-a44f-d2a384691939 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:28.337208 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc516b3-0eb4-4011-a44f-d2a384691939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:28.337478 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc516b3-0eb4-4011-a44f-d2a384691939 admin admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:28.338184 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc516b3-0eb4-4011-a44f-d2a384691939 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:28.340153 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc516b3-0eb4-4011-a44f-d2a384691939 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:28.440345 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8835c01-5b96-4063-82f8-f4ca4432f5ab None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:28.440559 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8835c01-5b96-4063-82f8-f4ca4432f5ab None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:28.440879 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8835c01-5b96-4063-82f8-f4ca4432f5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:28.448424 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 767/1543] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:34:28 2022] POST /identity/v3/projects => generated 379 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:34:28.453366 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc516b3-0eb4-4011-a44f-d2a384691939 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:28.466689 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-b8835c01-5b96-4063-82f8-f4ca4432f5ab None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:28.467988 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-b8835c01-5b96-4063-82f8-f4ca4432f5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:28.549914 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc516b3-0eb4-4011-a44f-d2a384691939 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:28.566770 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57011fd4-40fc-4781-b13a-b7790f891e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:28.567460 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57011fd4-40fc-4781-b13a-b7790f891e0b admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:28.567739 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57011fd4-40fc-4781-b13a-b7790f891e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:28.568014 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57011fd4-40fc-4781-b13a-b7790f891e0b admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:28.568755 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57011fd4-40fc-4781-b13a-b7790f891e0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:28.569824 dv-cinder-847730-1-smb devstack@keystone.service[80307]: WARNING py.warnings [None req-57011fd4-40fc-4781-b13a-b7790f891e0b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 09:34:28.569824 dv-cinder-847730-1-smb devstack@keystone.service[80307]: warnings.warn(msg) Jun 27 09:34:28.569824 dv-cinder-847730-1-smb devstack@keystone.service[80307]: Jun 27 09:34:28.571071 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57011fd4-40fc-4781-b13a-b7790f891e0b admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:28.615081 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 777/1544] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:28.616829 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb370c1b-cf97-4f8a-a3ff-870abe155ff1 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:28.617119 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb370c1b-cf97-4f8a-a3ff-870abe155ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:28.617866 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb370c1b-cf97-4f8a-a3ff-870abe155ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:28.642876 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-bb370c1b-cf97-4f8a-a3ff-870abe155ff1 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:28.646037 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-bb370c1b-cf97-4f8a-a3ff-870abe155ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:28.660957 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 778/1545] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:28.662611 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec7772-09fc-437a-9735-618d770eaa0d None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:28.662904 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec7772-09fc-437a-9735-618d770eaa0d None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:28.663183 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec7772-09fc-437a-9735-618d770eaa0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:28.675105 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 768/1546] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:34:28 2022] POST /identity/v3/users => generated 290 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:34:28.676562 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262ca2a-98b6-478b-b0fe-3c82c39e011a None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:28.676852 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262ca2a-98b6-478b-b0fe-3c82c39e011a None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:28.677128 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262ca2a-98b6-478b-b0fe-3c82c39e011a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:28.690228 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-b0ec7772-09fc-437a-9735-618d770eaa0d None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:28.691579 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-b0ec7772-09fc-437a-9735-618d770eaa0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:28.706373 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 779/1547] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:28.707249 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec7772-09fc-437a-9735-618d770eaa0d None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:28.713730 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-8262ca2a-98b6-478b-b0fe-3c82c39e011a None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:28.715510 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-8262ca2a-98b6-478b-b0fe-3c82c39e011a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:28.722820 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec7772-09fc-437a-9735-618d770eaa0d None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:28.726635 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 769/1548] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:28.727642 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8262ca2a-98b6-478b-b0fe-3c82c39e011a None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:28.732222 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99b16e-9ab4-4281-87cc-d421fddb4e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:28.733141 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99b16e-9ab4-4281-87cc-d421fddb4e78 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:28.733592 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99b16e-9ab4-4281-87cc-d421fddb4e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:28.734023 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99b16e-9ab4-4281-87cc-d421fddb4e78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:28.734927 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f99b16e-9ab4-4281-87cc-d421fddb4e78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:28.736744 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f99b16e-9ab4-4281-87cc-d421fddb4e78 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:28.744862 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8262ca2a-98b6-478b-b0fe-3c82c39e011a None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:28.756555 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 780/1549] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:34:28.757549 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7570d48-2071-4db3-982d-ddd1a08912bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:28.758043 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ee776-33a9-4b30-bdd4-2265b8abbb50 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:28.758243 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7570d48-2071-4db3-982d-ddd1a08912bb admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:28.758385 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ee776-33a9-4b30-bdd4-2265b8abbb50 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:28.758564 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7570d48-2071-4db3-982d-ddd1a08912bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:28.758681 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ee776-33a9-4b30-bdd4-2265b8abbb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:28.758759 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7570d48-2071-4db3-982d-ddd1a08912bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:28.759704 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7570d48-2071-4db3-982d-ddd1a08912bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:34:28.760017 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7570d48-2071-4db3-982d-ddd1a08912bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:28.761603 dv-cinder-847730-1-smb devstack@keystone.service[80307]: WARNING py.warnings [None req-b7570d48-2071-4db3-982d-ddd1a08912bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 09:34:28.761603 dv-cinder-847730-1-smb devstack@keystone.service[80307]: warnings.warn(msg) Jun 27 09:34:28.761603 dv-cinder-847730-1-smb devstack@keystone.service[80307]: Jun 27 09:34:28.762493 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7570d48-2071-4db3-982d-ddd1a08912bb admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:28.775905 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 770/1550] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:34:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:34:28.777452 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7570d48-2071-4db3-982d-ddd1a08912bb admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:28.793717 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7570d48-2071-4db3-982d-ddd1a08912bb admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:28.795294 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-177ee776-33a9-4b30-bdd4-2265b8abbb50 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:28.796624 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-177ee776-33a9-4b30-bdd4-2265b8abbb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:28.804284 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55116aaa-f00c-40c1-9fab-94b26abafe74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:28.804968 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55116aaa-f00c-40c1-9fab-94b26abafe74 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:28.805254 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55116aaa-f00c-40c1-9fab-94b26abafe74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:28.805533 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55116aaa-f00c-40c1-9fab-94b26abafe74 admin admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:28.806263 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55116aaa-f00c-40c1-9fab-94b26abafe74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:34:28.806584 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55116aaa-f00c-40c1-9fab-94b26abafe74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:28.808762 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55116aaa-f00c-40c1-9fab-94b26abafe74 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:28.810959 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 781/1551] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:28.813894 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba9be1-18cb-4c7e-a30f-6b58dc633d99 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:28.813894 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba9be1-18cb-4c7e-a30f-6b58dc633d99 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:28.813894 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba9be1-18cb-4c7e-a30f-6b58dc633d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:28.832225 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 771/1552] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:34:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:34:28.832225 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55116aaa-f00c-40c1-9fab-94b26abafe74 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:28.836855 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-dcba9be1-18cb-4c7e-a30f-6b58dc633d99 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:28.838063 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-dcba9be1-18cb-4c7e-a30f-6b58dc633d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:28.838170 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55116aaa-f00c-40c1-9fab-94b26abafe74 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:28.842688 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e305ba-74f5-474a-b601-5b82624ef565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:28.843334 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e305ba-74f5-474a-b601-5b82624ef565 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:28.843614 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e305ba-74f5-474a-b601-5b82624ef565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:28.843886 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e305ba-74f5-474a-b601-5b82624ef565 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:28.844632 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e305ba-74f5-474a-b601-5b82624ef565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:28.846210 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e305ba-74f5-474a-b601-5b82624ef565 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:28.846322 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 782/1553] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:28.847220 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba9be1-18cb-4c7e-a30f-6b58dc633d99 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:28.857877 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba9be1-18cb-4c7e-a30f-6b58dc633d99 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:28.858285 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 772/1554] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:34:28.859652 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee667bde-8dca-409e-81a7-cadb6435989b None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:28.859943 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee667bde-8dca-409e-81a7-cadb6435989b None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:28.860242 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee667bde-8dca-409e-81a7-cadb6435989b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:28.865826 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407e325-f6f4-4d78-ba55-593f61524d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:28.866479 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407e325-f6f4-4d78-ba55-593f61524d68 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:28.866760 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407e325-f6f4-4d78-ba55-593f61524d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:28.867039 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407e325-f6f4-4d78-ba55-593f61524d68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:28.868117 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9407e325-f6f4-4d78-ba55-593f61524d68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:28.869183 dv-cinder-847730-1-smb devstack@keystone.service[80306]: WARNING py.warnings [None req-9407e325-f6f4-4d78-ba55-593f61524d68 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 09:34:28.869183 dv-cinder-847730-1-smb devstack@keystone.service[80306]: warnings.warn(msg) Jun 27 09:34:28.869183 dv-cinder-847730-1-smb devstack@keystone.service[80306]: Jun 27 09:34:28.870443 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9407e325-f6f4-4d78-ba55-593f61524d68 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:28.878875 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-ee667bde-8dca-409e-81a7-cadb6435989b None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:28.880474 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-ee667bde-8dca-409e-81a7-cadb6435989b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:28.888547 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 773/1555] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:28.889965 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd754de-82e4-449a-bde3-0208c5af8155 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:28.890259 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd754de-82e4-449a-bde3-0208c5af8155 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:28.890665 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd754de-82e4-449a-bde3-0208c5af8155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:28.908624 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-8bd754de-82e4-449a-bde3-0208c5af8155 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:28.909817 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-8bd754de-82e4-449a-bde3-0208c5af8155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:28.918196 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 774/1556] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:28.919763 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb191fc-fea8-41dd-9b4c-0c51269ea3f6 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:28.919763 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb191fc-fea8-41dd-9b4c-0c51269ea3f6 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:28.920013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb191fc-fea8-41dd-9b4c-0c51269ea3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:28.938133 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-6cb191fc-fea8-41dd-9b4c-0c51269ea3f6 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:28.939321 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-6cb191fc-fea8-41dd-9b4c-0c51269ea3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:28.947520 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 775/1557] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:28.948742 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b83cf-54b0-48b0-ba7d-c1cfeba9948c None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:28.949029 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b83cf-54b0-48b0-ba7d-c1cfeba9948c None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:28.949308 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b83cf-54b0-48b0-ba7d-c1cfeba9948c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:28.966612 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-c14b83cf-54b0-48b0-ba7d-c1cfeba9948c None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:28.970149 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-c14b83cf-54b0-48b0-ba7d-c1cfeba9948c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:28.970316 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 783/1558] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:34:28 2022] POST /identity/v3/projects => generated 365 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:34:28.971233 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407e325-f6f4-4d78-ba55-593f61524d68 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:29.020840 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:34:29.030235 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 776/1559] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:29.031569 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640adaf2-1822-4395-a6b5-cbd391a3546b None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:29.031854 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640adaf2-1822-4395-a6b5-cbd391a3546b None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:29.032543 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640adaf2-1822-4395-a6b5-cbd391a3546b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:29.035428 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407e325-f6f4-4d78-ba55-593f61524d68 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:29.040333 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6653e482-0089-4a1e-abf4-b2eef205b5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:29.041000 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653e482-0089-4a1e-abf4-b2eef205b5df admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:29.041285 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653e482-0089-4a1e-abf4-b2eef205b5df admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:29.041577 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653e482-0089-4a1e-abf4-b2eef205b5df admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:29.042288 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6653e482-0089-4a1e-abf4-b2eef205b5df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:29.044771 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6653e482-0089-4a1e-abf4-b2eef205b5df admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:29.050739 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-640adaf2-1822-4395-a6b5-cbd391a3546b None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:29.051943 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-640adaf2-1822-4395-a6b5-cbd391a3546b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:29.060497 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 777/1560] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:29.061277 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640adaf2-1822-4395-a6b5-cbd391a3546b None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:29.070416 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640adaf2-1822-4395-a6b5-cbd391a3546b None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:29.075735 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe13f20-3fec-443a-b858-18b5770462c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:29.079027 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe13f20-3fec-443a-b858-18b5770462c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:29.079027 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe13f20-3fec-443a-b858-18b5770462c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:29.079027 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe13f20-3fec-443a-b858-18b5770462c7 admin admin] PATH_INFO: `/v3/projects/2b63618987f54652a373e1413607c5f7/users/b2c4f6fbf777401388307bf24396c8e5/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:29.091647 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe13f20-3fec-443a-b858-18b5770462c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b63618987f54652a373e1413607c5f7, user_id=b2c4f6fbf777401388307bf24396c8e5, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:29.094344 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe13f20-3fec-443a-b858-18b5770462c7 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:29.147431 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 784/1561] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:34:28 2022] POST /identity/v3/projects => generated 377 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:34:29.149138 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebed2d6-a8fe-4e81-8758-122026ce5a35 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:29.149428 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebed2d6-a8fe-4e81-8758-122026ce5a35 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:29.149704 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebed2d6-a8fe-4e81-8758-122026ce5a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:29.162473 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:34:29.168680 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-eebed2d6-a8fe-4e81-8758-122026ce5a35 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:29.169930 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-eebed2d6-a8fe-4e81-8758-122026ce5a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:29.186528 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 778/1562] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:34:29 2022] PUT /identity/v3/projects/2b63618987f54652a373e1413607c5f7/users/b2c4f6fbf777401388307bf24396c8e5/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:34:29.187813 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10301e-bb39-46e5-904e-fa3f29d03205 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:29.192711 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10301e-bb39-46e5-904e-fa3f29d03205 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:29.192711 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10301e-bb39-46e5-904e-fa3f29d03205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:29.208091 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-6f10301e-bb39-46e5-904e-fa3f29d03205 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:29.209254 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-6f10301e-bb39-46e5-904e-fa3f29d03205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:29.231046 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 785/1563] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:29.232374 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebed2d6-a8fe-4e81-8758-122026ce5a35 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:29.242106 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebed2d6-a8fe-4e81-8758-122026ce5a35 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:29.277812 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 779/1564] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:29.278879 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f10301e-bb39-46e5-904e-fa3f29d03205 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:29.289463 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f10301e-bb39-46e5-904e-fa3f29d03205 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:29.294622 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7a423-e3af-43e3-b884-ec4c3799a84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:29.295247 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7a423-e3af-43e3-b884-ec4c3799a84f admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:29.295596 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7a423-e3af-43e3-b884-ec4c3799a84f admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:29.295938 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7a423-e3af-43e3-b884-ec4c3799a84f admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:29.296736 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb7a423-e3af-43e3-b884-ec4c3799a84f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:29.298761 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb7a423-e3af-43e3-b884-ec4c3799a84f admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:29.314114 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2173a5-887d-4c2b-ae5e-1c9ddeb7a55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:29.318706 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2173a5-887d-4c2b-ae5e-1c9ddeb7a55c admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:29.318706 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2173a5-887d-4c2b-ae5e-1c9ddeb7a55c admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:29.318706 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2173a5-887d-4c2b-ae5e-1c9ddeb7a55c admin admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:29.318706 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2173a5-887d-4c2b-ae5e-1c9ddeb7a55c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:34:29.318706 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2173a5-887d-4c2b-ae5e-1c9ddeb7a55c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:29.318706 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2173a5-887d-4c2b-ae5e-1c9ddeb7a55c admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:29.331340 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 786/1565] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:34:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:34:29.332814 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bed60b-ae69-4870-9242-6ea703ca207d None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:29.333112 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bed60b-ae69-4870-9242-6ea703ca207d None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:29.333391 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bed60b-ae69-4870-9242-6ea703ca207d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:29.352490 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-a0bed60b-ae69-4870-9242-6ea703ca207d None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:29.353708 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-a0bed60b-ae69-4870-9242-6ea703ca207d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:29.362657 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 787/1566] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:29.363605 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bed60b-ae69-4870-9242-6ea703ca207d None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:29.378688 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bed60b-ae69-4870-9242-6ea703ca207d None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:29.386313 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a93bb-0677-4338-a46f-2f8ac96734f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:29.387382 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a93bb-0677-4338-a46f-2f8ac96734f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:29.387848 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a93bb-0677-4338-a46f-2f8ac96734f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:29.388349 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a93bb-0677-4338-a46f-2f8ac96734f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:29.389569 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9a93bb-0677-4338-a46f-2f8ac96734f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:34:29.390267 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9a93bb-0677-4338-a46f-2f8ac96734f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:29.393031 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9a93bb-0677-4338-a46f-2f8ac96734f4 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:29.398299 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 780/1567] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:34:29 2022] POST /identity/v3/users => generated 283 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:34:29.403121 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7a423-e3af-43e3-b884-ec4c3799a84f admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:29.413299 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7a423-e3af-43e3-b884-ec4c3799a84f admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:29.413491 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 788/1568] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:34:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:34:29.415381 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d912f4a-1c66-47e4-95f3-d4d5faef4b09 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:29.415827 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d912f4a-1c66-47e4-95f3-d4d5faef4b09 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:29.416282 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d912f4a-1c66-47e4-95f3-d4d5faef4b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:29.418814 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb3c56-40a8-4ff3-992b-25c56ad88a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:29.419407 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb3c56-40a8-4ff3-992b-25c56ad88a9e admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:29.419803 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb3c56-40a8-4ff3-992b-25c56ad88a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:29.419987 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb3c56-40a8-4ff3-992b-25c56ad88a9e admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:29.420660 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cb3c56-40a8-4ff3-992b-25c56ad88a9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:29.422806 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cb3c56-40a8-4ff3-992b-25c56ad88a9e admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:29.440510 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-2d912f4a-1c66-47e4-95f3-d4d5faef4b09 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:29.441819 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-2d912f4a-1c66-47e4-95f3-d4d5faef4b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:29.449682 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 789/1569] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:29.450720 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d912f4a-1c66-47e4-95f3-d4d5faef4b09 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:29.461399 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d912f4a-1c66-47e4-95f3-d4d5faef4b09 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:29.467456 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5de04-4a97-4cef-9acc-feb79ea5099d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:29.468118 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5de04-4a97-4cef-9acc-feb79ea5099d admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:29.468544 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5de04-4a97-4cef-9acc-feb79ea5099d admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:29.468853 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5de04-4a97-4cef-9acc-feb79ea5099d admin admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:29.469728 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e5de04-4a97-4cef-9acc-feb79ea5099d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:34:29.470035 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e5de04-4a97-4cef-9acc-feb79ea5099d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:29.471648 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e5de04-4a97-4cef-9acc-feb79ea5099d admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:29.484545 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 790/1570] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:34:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:34:29.485467 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5de04-4a97-4cef-9acc-feb79ea5099d admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:29.495925 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5de04-4a97-4cef-9acc-feb79ea5099d admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:29.502110 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b217592-ba63-4021-aa03-8ee6e7db185d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:29.502766 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b217592-ba63-4021-aa03-8ee6e7db185d admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:29.503044 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b217592-ba63-4021-aa03-8ee6e7db185d admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:29.503316 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b217592-ba63-4021-aa03-8ee6e7db185d admin admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:29.504044 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b217592-ba63-4021-aa03-8ee6e7db185d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:34:29.504378 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b217592-ba63-4021-aa03-8ee6e7db185d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:29.505974 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b217592-ba63-4021-aa03-8ee6e7db185d admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:29.506648 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 781/1571] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:34:29 2022] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:34:29.508292 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb3c56-40a8-4ff3-992b-25c56ad88a9e admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:29.523106 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 791/1572] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:34:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:34:29.523106 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b217592-ba63-4021-aa03-8ee6e7db185d admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:29.523465 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb3c56-40a8-4ff3-992b-25c56ad88a9e admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:29.529756 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a24e30-9c3c-441d-a9d7-4550331a89a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:29.530603 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a24e30-9c3c-441d-a9d7-4550331a89a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:29.530978 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a24e30-9c3c-441d-a9d7-4550331a89a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:29.531347 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a24e30-9c3c-441d-a9d7-4550331a89a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:29.532421 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a24e30-9c3c-441d-a9d7-4550331a89a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:29.534396 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a24e30-9c3c-441d-a9d7-4550331a89a2 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:29.538193 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b217592-ba63-4021-aa03-8ee6e7db185d admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:29.543587 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69fcb7-ef91-433a-be2c-53ceeeb7d8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:29.544575 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69fcb7-ef91-433a-be2c-53ceeeb7d8d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:29.544863 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69fcb7-ef91-433a-be2c-53ceeeb7d8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:29.545131 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69fcb7-ef91-433a-be2c-53ceeeb7d8d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:29.545860 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69fcb7-ef91-433a-be2c-53ceeeb7d8d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:34:29.546171 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69fcb7-ef91-433a-be2c-53ceeeb7d8d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:29.547801 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69fcb7-ef91-433a-be2c-53ceeeb7d8d7 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:29.560940 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 792/1573] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:34:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:34:29.561866 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69fcb7-ef91-433a-be2c-53ceeeb7d8d7 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:29.572014 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69fcb7-ef91-433a-be2c-53ceeeb7d8d7 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:29.577564 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ca02c-39ec-4e02-a1e8-813c3a414388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:29.578224 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ca02c-39ec-4e02-a1e8-813c3a414388 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:29.578652 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ca02c-39ec-4e02-a1e8-813c3a414388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:29.578851 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ca02c-39ec-4e02-a1e8-813c3a414388 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:29.579576 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ca02c-39ec-4e02-a1e8-813c3a414388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:29.581212 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ca02c-39ec-4e02-a1e8-813c3a414388 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:29.594336 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 793/1574] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:34:29.594336 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ca02c-39ec-4e02-a1e8-813c3a414388 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:29.603492 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ca02c-39ec-4e02-a1e8-813c3a414388 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:29.608300 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d29c763-da2d-418a-837b-3a11894009d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:29.609082 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29c763-da2d-418a-837b-3a11894009d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:29.609369 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29c763-da2d-418a-837b-3a11894009d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:29.609668 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29c763-da2d-418a-837b-3a11894009d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:29.610396 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d29c763-da2d-418a-837b-3a11894009d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:29.612421 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d29c763-da2d-418a-837b-3a11894009d9 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:29.617187 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 782/1575] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:34:29 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:34:29.618288 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a24e30-9c3c-441d-a9d7-4550331a89a2 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:29.674264 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a24e30-9c3c-441d-a9d7-4550331a89a2 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:29.677780 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039d382-8c72-45dd-853f-bf667f5a0307 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:29.678458 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039d382-8c72-45dd-853f-bf667f5a0307 service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:29.678735 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039d382-8c72-45dd-853f-bf667f5a0307 service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:29.679007 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039d382-8c72-45dd-853f-bf667f5a0307 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:29.704968 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 794/1576] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:34:29 2022] POST /identity/v3/projects => generated 393 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:34:29.705356 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:34:29.705786 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d29c763-da2d-418a-837b-3a11894009d9 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:29.711633 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:34:29.742233 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c039d382-8c72-45dd-853f-bf667f5a0307 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:29.744745 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c039d382-8c72-45dd-853f-bf667f5a0307 service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:29.753604 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 783/1577] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:34:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:34:29.754425 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039d382-8c72-45dd-853f-bf667f5a0307 service neutron] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:29.764625 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039d382-8c72-45dd-853f-bf667f5a0307 service neutron] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:29.769418 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd6179-cdb3-4641-af59-569bd0e1c23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:29.770083 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd6179-cdb3-4641-af59-569bd0e1c23d admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:29.770367 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd6179-cdb3-4641-af59-569bd0e1c23d admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:29.770636 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd6179-cdb3-4641-af59-569bd0e1c23d admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:29.771355 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bd6179-cdb3-4641-af59-569bd0e1c23d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:29.772573 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d29c763-da2d-418a-837b-3a11894009d9 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:29.773118 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bd6179-cdb3-4641-af59-569bd0e1c23d admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:29.778118 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec6dc4-6852-4bd1-8e19-c135a237fc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:29.778880 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec6dc4-6852-4bd1-8e19-c135a237fc82 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:29.779158 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec6dc4-6852-4bd1-8e19-c135a237fc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:29.779431 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec6dc4-6852-4bd1-8e19-c135a237fc82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:29.780124 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec6dc4-6852-4bd1-8e19-c135a237fc82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:29.782153 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec6dc4-6852-4bd1-8e19-c135a237fc82 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:29.784096 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 784/1578] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:34:29.787751 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd6179-cdb3-4641-af59-569bd0e1c23d admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:29.798122 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd6179-cdb3-4641-af59-569bd0e1c23d admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:29.803360 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4526d6-9c95-4b74-bd30-780dafbcb930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:29.804055 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4526d6-9c95-4b74-bd30-780dafbcb930 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:29.804367 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4526d6-9c95-4b74-bd30-780dafbcb930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:29.804643 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4526d6-9c95-4b74-bd30-780dafbcb930 admin admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:29.805356 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4526d6-9c95-4b74-bd30-780dafbcb930 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:29.807280 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4526d6-9c95-4b74-bd30-780dafbcb930 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:29.897181 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 795/1579] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:34:29 2022] POST /identity/v3/projects => generated 403 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:34:29.901348 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec6dc4-6852-4bd1-8e19-c135a237fc82 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:29.905324 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 785/1580] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:34:29 2022] POST /identity/v3/projects => generated 363 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:34:29.906749 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4526d6-9c95-4b74-bd30-780dafbcb930 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:29.985439 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec6dc4-6852-4bd1-8e19-c135a237fc82 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:29.987793 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4526d6-9c95-4b74-bd30-780dafbcb930 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:29.990718 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a411c-7bae-4fe1-bd29-51d1da7206c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:29.994436 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a411c-7bae-4fe1-bd29-51d1da7206c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:29.994436 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a411c-7bae-4fe1-bd29-51d1da7206c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:29.994436 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a411c-7bae-4fe1-bd29-51d1da7206c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:29.994801 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e35116-ca19-45ab-b8d0-023342dd2e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:29.994905 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a411c-7bae-4fe1-bd29-51d1da7206c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:29.994999 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e35116-ca19-45ab-b8d0-023342dd2e32 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:29.994999 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e35116-ca19-45ab-b8d0-023342dd2e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:29.994999 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e35116-ca19-45ab-b8d0-023342dd2e32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:29.994999 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e35116-ca19-45ab-b8d0-023342dd2e32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:29.995284 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a411c-7bae-4fe1-bd29-51d1da7206c3 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:29.996535 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e35116-ca19-45ab-b8d0-023342dd2e32 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:30.007093 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 786/1581] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:34:30.007906 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e35116-ca19-45ab-b8d0-023342dd2e32 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:30.018090 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e35116-ca19-45ab-b8d0-023342dd2e32 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:30.023145 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16312c48-7a1b-4c9e-bd6d-1c9028d21fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:30.023287 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16312c48-7a1b-4c9e-bd6d-1c9028d21fa1 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:30.023499 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16312c48-7a1b-4c9e-bd6d-1c9028d21fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:30.023770 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16312c48-7a1b-4c9e-bd6d-1c9028d21fa1 admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:30.024487 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16312c48-7a1b-4c9e-bd6d-1c9028d21fa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:30.026371 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16312c48-7a1b-4c9e-bd6d-1c9028d21fa1 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:30.109398 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 787/1582] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:34:30 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:34:30.110553 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16312c48-7a1b-4c9e-bd6d-1c9028d21fa1 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:30.120148 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 796/1583] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:34:29 2022] POST /identity/v3/projects => generated 385 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:34:30.122006 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a411c-7bae-4fe1-bd29-51d1da7206c3 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:30.131201 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16312c48-7a1b-4c9e-bd6d-1c9028d21fa1 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:30.193808 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a411c-7bae-4fe1-bd29-51d1da7206c3 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:30.198969 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd019d-a3fb-49a5-8d94-5159fdd480e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:30.199626 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd019d-a3fb-49a5-8d94-5159fdd480e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:30.199910 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd019d-a3fb-49a5-8d94-5159fdd480e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:30.200351 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd019d-a3fb-49a5-8d94-5159fdd480e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:30.201083 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd019d-a3fb-49a5-8d94-5159fdd480e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:30.202827 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd019d-a3fb-49a5-8d94-5159fdd480e7 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:30.208834 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd903f-8a4a-460f-aaa8-81b2a40e4144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:30.209356 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd903f-8a4a-460f-aaa8-81b2a40e4144 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:30.209695 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd903f-8a4a-460f-aaa8-81b2a40e4144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:30.210044 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd903f-8a4a-460f-aaa8-81b2a40e4144 admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:30.210735 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd903f-8a4a-460f-aaa8-81b2a40e4144 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:30.212676 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd903f-8a4a-460f-aaa8-81b2a40e4144 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:30.218010 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 797/1584] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:34:30 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:34:30.218010 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd019d-a3fb-49a5-8d94-5159fdd480e7 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:30.232336 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:34:30.232544 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd019d-a3fb-49a5-8d94-5159fdd480e7 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:30.235114 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16315adb-de9f-40bc-8747-bbd0324f9483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:30.235833 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16315adb-de9f-40bc-8747-bbd0324f9483 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:30.236054 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16315adb-de9f-40bc-8747-bbd0324f9483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:30.236357 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16315adb-de9f-40bc-8747-bbd0324f9483 admin admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:30.237114 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16315adb-de9f-40bc-8747-bbd0324f9483 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:30.239074 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16315adb-de9f-40bc-8747-bbd0324f9483 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:30.247332 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:34:30.315226 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 788/1585] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:34:30 2022] POST /identity/v3/users => generated 297 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:34:30.316042 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd903f-8a4a-460f-aaa8-81b2a40e4144 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:30.325651 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd903f-8a4a-460f-aaa8-81b2a40e4144 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:30.330319 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984d7f2-9425-4cb3-aa82-1baaaa54bb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:30.330961 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984d7f2-9425-4cb3-aa82-1baaaa54bb28 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:30.331249 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984d7f2-9425-4cb3-aa82-1baaaa54bb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:30.331526 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984d7f2-9425-4cb3-aa82-1baaaa54bb28 admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:30.332218 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8984d7f2-9425-4cb3-aa82-1baaaa54bb28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:30.334144 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8984d7f2-9425-4cb3-aa82-1baaaa54bb28 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:30.364383 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 798/1586] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:34:30 2022] POST /identity/v3/users => generated 302 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:34:30.364383 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16315adb-de9f-40bc-8747-bbd0324f9483 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:30.373726 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16315adb-de9f-40bc-8747-bbd0324f9483 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:30.378242 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f1ea8-53e9-4d84-a878-476a05c73ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:30.379238 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f1ea8-53e9-4d84-a878-476a05c73ae4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:30.379517 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f1ea8-53e9-4d84-a878-476a05c73ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:30.379839 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f1ea8-53e9-4d84-a878-476a05c73ae4 admin admin] PATH_INFO: `/v3/projects/7d520e618b8e4fb1a5bf2bacf03b20fc/users/ed3812a7a5d84612b8bdf8cf93dfb9cf/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:30.395884 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f1ea8-53e9-4d84-a878-476a05c73ae4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d520e618b8e4fb1a5bf2bacf03b20fc, user_id=ed3812a7a5d84612b8bdf8cf93dfb9cf, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:30.397000 dv-cinder-847730-1-smb devstack@keystone.service[80306]: WARNING py.warnings [None req-4b7f1ea8-53e9-4d84-a878-476a05c73ae4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 09:34:30.397000 dv-cinder-847730-1-smb devstack@keystone.service[80306]: warnings.warn(msg) Jun 27 09:34:30.397000 dv-cinder-847730-1-smb devstack@keystone.service[80306]: Jun 27 09:34:30.398974 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f1ea8-53e9-4d84-a878-476a05c73ae4 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:30.415921 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 789/1587] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:34:30 2022] POST /identity/v3/users => generated 282 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:34:30.416910 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984d7f2-9425-4cb3-aa82-1baaaa54bb28 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:30.427994 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984d7f2-9425-4cb3-aa82-1baaaa54bb28 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:30.432720 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d14da69-ee22-45d6-887f-0d70906db580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:30.433493 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14da69-ee22-45d6-887f-0d70906db580 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:30.433825 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14da69-ee22-45d6-887f-0d70906db580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:30.434660 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14da69-ee22-45d6-887f-0d70906db580 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:30.435405 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d14da69-ee22-45d6-887f-0d70906db580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:30.437029 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d14da69-ee22-45d6-887f-0d70906db580 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:30.447692 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 790/1588] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:34:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:34:30.448505 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d14da69-ee22-45d6-887f-0d70906db580 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:30.458147 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d14da69-ee22-45d6-887f-0d70906db580 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:30.462944 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accbb78e-5b53-4e59-89b7-4aab66422f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:30.463606 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbb78e-5b53-4e59-89b7-4aab66422f70 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:30.463888 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbb78e-5b53-4e59-89b7-4aab66422f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:30.464160 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbb78e-5b53-4e59-89b7-4aab66422f70 admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:30.464876 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accbb78e-5b53-4e59-89b7-4aab66422f70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:30.466789 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accbb78e-5b53-4e59-89b7-4aab66422f70 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:30.504520 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 799/1589] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:34:30 2022] PUT /identity/v3/projects/7d520e618b8e4fb1a5bf2bacf03b20fc/users/ed3812a7a5d84612b8bdf8cf93dfb9cf/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:34:30.505652 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f1ea8-53e9-4d84-a878-476a05c73ae4 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:30.567333 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 791/1590] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:34:30 2022] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:34:30.568384 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accbb78e-5b53-4e59-89b7-4aab66422f70 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:30.578474 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accbb78e-5b53-4e59-89b7-4aab66422f70 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:30.583404 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde7a26-da84-462a-b8cc-1d94b8f75ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:30.584383 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde7a26-da84-462a-b8cc-1d94b8f75ccd admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:30.584791 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde7a26-da84-462a-b8cc-1d94b8f75ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:30.585143 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde7a26-da84-462a-b8cc-1d94b8f75ccd admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:30.585968 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fde7a26-da84-462a-b8cc-1d94b8f75ccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:30.586142 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f1ea8-53e9-4d84-a878-476a05c73ae4 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:30.588016 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fde7a26-da84-462a-b8cc-1d94b8f75ccd admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:30.591390 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b1355-89ee-4b90-90ec-9039bef5686e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:30.592453 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b1355-89ee-4b90-90ec-9039bef5686e admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:30.592627 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b1355-89ee-4b90-90ec-9039bef5686e admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:30.592857 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b1355-89ee-4b90-90ec-9039bef5686e admin admin] PATH_INFO: `/v3/projects/594feb4bfaf64c5598a7de46231a50f6/users/d67234e9868b4d34a1532b1aedf33221/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:30.600169 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 792/1591] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:34:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:34:30.603778 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde7a26-da84-462a-b8cc-1d94b8f75ccd admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:30.612649 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b1355-89ee-4b90-90ec-9039bef5686e admin admin] RBAC: Authorizing `identity:create_grant(project_id=594feb4bfaf64c5598a7de46231a50f6, user_id=d67234e9868b4d34a1532b1aedf33221, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:30.614527 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde7a26-da84-462a-b8cc-1d94b8f75ccd admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:30.615321 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b1355-89ee-4b90-90ec-9039bef5686e admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:30.619710 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f3b70-5527-4694-84b0-66598f21c4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:30.620423 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f3b70-5527-4694-84b0-66598f21c4bc admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:30.620708 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f3b70-5527-4694-84b0-66598f21c4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:30.620987 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f3b70-5527-4694-84b0-66598f21c4bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:30.621763 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76f3b70-5527-4694-84b0-66598f21c4bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:30.623389 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76f3b70-5527-4694-84b0-66598f21c4bc admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:30.633610 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 793/1592] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:34:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:34:30.634573 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f3b70-5527-4694-84b0-66598f21c4bc admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:30.644103 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f3b70-5527-4694-84b0-66598f21c4bc admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:30.655946 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05318cfc-8e1a-412f-be5e-4037f6f08593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:30.655946 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05318cfc-8e1a-412f-be5e-4037f6f08593 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:30.655946 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05318cfc-8e1a-412f-be5e-4037f6f08593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:30.655946 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05318cfc-8e1a-412f-be5e-4037f6f08593 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:30.656479 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05318cfc-8e1a-412f-be5e-4037f6f08593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:30.656479 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05318cfc-8e1a-412f-be5e-4037f6f08593 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:30.664305 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 794/1593] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:34:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:34:30.665339 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05318cfc-8e1a-412f-be5e-4037f6f08593 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:30.675790 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05318cfc-8e1a-412f-be5e-4037f6f08593 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:30.683780 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 800/1594] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:34:30 2022] PUT /identity/v3/projects/594feb4bfaf64c5598a7de46231a50f6/users/d67234e9868b4d34a1532b1aedf33221/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:34:30.685421 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f00bb5-422b-44e0-a485-83ccbc23f0c9 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:30.685780 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f00bb5-422b-44e0-a485-83ccbc23f0c9 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:30.686128 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f00bb5-422b-44e0-a485-83ccbc23f0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:30.716788 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-b0f00bb5-422b-44e0-a485-83ccbc23f0c9 None None] MFA Rules not processed for user `ed3812a7a5d84612b8bdf8cf93dfb9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:30.718345 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-b0f00bb5-422b-44e0-a485-83ccbc23f0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:30.746596 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800f1ad-2b0d-4391-acd2-c7e6f5960456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:30.747463 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800f1ad-2b0d-4391-acd2-c7e6f5960456 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:30.747850 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800f1ad-2b0d-4391-acd2-c7e6f5960456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:30.748259 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800f1ad-2b0d-4391-acd2-c7e6f5960456 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:30.749161 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f800f1ad-2b0d-4391-acd2-c7e6f5960456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:30.753400 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f800f1ad-2b0d-4391-acd2-c7e6f5960456 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:30.765860 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 795/1595] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:34:30 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:34:30.765860 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800f1ad-2b0d-4391-acd2-c7e6f5960456 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:30.776896 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800f1ad-2b0d-4391-acd2-c7e6f5960456 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:30.782142 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d576926-9f78-48e4-9d3c-0dd4a744beba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:30.786947 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d576926-9f78-48e4-9d3c-0dd4a744beba admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:30.786947 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d576926-9f78-48e4-9d3c-0dd4a744beba admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:30.786947 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d576926-9f78-48e4-9d3c-0dd4a744beba admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:30.786947 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d576926-9f78-48e4-9d3c-0dd4a744beba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:30.786947 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d576926-9f78-48e4-9d3c-0dd4a744beba admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:30.799266 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 801/1596] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:30 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:30.799266 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f00bb5-422b-44e0-a485-83ccbc23f0c9 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:30.799562 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 796/1597] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:34:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:34:30.799562 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d576926-9f78-48e4-9d3c-0dd4a744beba admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:30.811450 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d576926-9f78-48e4-9d3c-0dd4a744beba admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:30.814622 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f00bb5-422b-44e0-a485-83ccbc23f0c9 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:30.816440 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf359317-5b18-4423-a1e4-915bb56f95a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:30.817115 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf359317-5b18-4423-a1e4-915bb56f95a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:30.817399 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf359317-5b18-4423-a1e4-915bb56f95a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:30.817672 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf359317-5b18-4423-a1e4-915bb56f95a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:30.818390 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf359317-5b18-4423-a1e4-915bb56f95a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:30.819126 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f71b4-ba77-4cb4-b677-5534944b46f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:30.819930 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f71b4-ba77-4cb4-b677-5534944b46f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:30.820063 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf359317-5b18-4423-a1e4-915bb56f95a2 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:30.820396 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f71b4-ba77-4cb4-b677-5534944b46f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:30.820804 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f71b4-ba77-4cb4-b677-5534944b46f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:30.821702 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37f71b4-ba77-4cb4-b677-5534944b46f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:30.823407 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37f71b4-ba77-4cb4-b677-5534944b46f5 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:30.831160 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 797/1598] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:34:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:34:30.832097 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf359317-5b18-4423-a1e4-915bb56f95a2 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:30.834832 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 802/1599] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:34:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:34:30.836323 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a549597-bfe5-411b-93cc-3cf2dff7fc6e None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:30.836684 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a549597-bfe5-411b-93cc-3cf2dff7fc6e None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:30.837031 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a549597-bfe5-411b-93cc-3cf2dff7fc6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:30.843087 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf359317-5b18-4423-a1e4-915bb56f95a2 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:30.847675 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08952890-39b4-4f8f-a862-acad093bd997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:30.848365 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08952890-39b4-4f8f-a862-acad093bd997 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:30.848650 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08952890-39b4-4f8f-a862-acad093bd997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:30.848925 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08952890-39b4-4f8f-a862-acad093bd997 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:30.849738 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08952890-39b4-4f8f-a862-acad093bd997 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:30.851328 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08952890-39b4-4f8f-a862-acad093bd997 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:30.856275 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-8a549597-bfe5-411b-93cc-3cf2dff7fc6e None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:30.857526 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-8a549597-bfe5-411b-93cc-3cf2dff7fc6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:30.862415 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 798/1600] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:34:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:34:30.863379 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08952890-39b4-4f8f-a862-acad093bd997 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:30.867153 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 803/1601] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:30.868297 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a549597-bfe5-411b-93cc-3cf2dff7fc6e None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:30.876326 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08952890-39b4-4f8f-a862-acad093bd997 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:30.878254 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a549597-bfe5-411b-93cc-3cf2dff7fc6e None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:30.881094 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c14754-eea3-4b8f-8aa0-4655462870e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:30.882174 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c14754-eea3-4b8f-8aa0-4655462870e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:30.882576 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c14754-eea3-4b8f-8aa0-4655462870e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:30.882860 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c14754-eea3-4b8f-8aa0-4655462870e8 admin admin] PATH_INFO: `/v3/projects/68753bc10c4147468040c550ef88a6f4/users/4c30a14c11d24ff3bd270c8e865a55d5/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:30.882966 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf2864-1b8c-4a35-b3ba-cff558a36de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:30.883521 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf2864-1b8c-4a35-b3ba-cff558a36de3 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:30.883814 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf2864-1b8c-4a35-b3ba-cff558a36de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:30.884103 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf2864-1b8c-4a35-b3ba-cff558a36de3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:30.884843 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaf2864-1b8c-4a35-b3ba-cff558a36de3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:30.886751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaf2864-1b8c-4a35-b3ba-cff558a36de3 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:30.899430 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c14754-eea3-4b8f-8aa0-4655462870e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68753bc10c4147468040c550ef88a6f4, user_id=4c30a14c11d24ff3bd270c8e865a55d5, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:30.904064 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c14754-eea3-4b8f-8aa0-4655462870e8 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:30.990074 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:34:30.997271 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 804/1602] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:34:30 2022] POST /identity/v3/projects => generated 363 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:34:30.997973 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf2864-1b8c-4a35-b3ba-cff558a36de3 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:31.003638 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 799/1603] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:34:30 2022] PUT /identity/v3/projects/68753bc10c4147468040c550ef88a6f4/users/4c30a14c11d24ff3bd270c8e865a55d5/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:34:31.004172 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c14754-eea3-4b8f-8aa0-4655462870e8 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:31.022522 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:34:31.064274 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf2864-1b8c-4a35-b3ba-cff558a36de3 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:31.066262 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c14754-eea3-4b8f-8aa0-4655462870e8 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:31.069130 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ded3c-7e63-4611-9f53-d6da72c78ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:31.069799 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ded3c-7e63-4611-9f53-d6da72c78ecb admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:31.070078 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ded3c-7e63-4611-9f53-d6da72c78ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:31.070348 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ded3c-7e63-4611-9f53-d6da72c78ecb admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:31.071073 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633ded3c-7e63-4611-9f53-d6da72c78ecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:31.072366 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc331f-a259-450d-8bb5-8c41450f0f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:31.072726 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633ded3c-7e63-4611-9f53-d6da72c78ecb admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:31.073642 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc331f-a259-450d-8bb5-8c41450f0f86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:31.074859 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc331f-a259-450d-8bb5-8c41450f0f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:31.075142 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc331f-a259-450d-8bb5-8c41450f0f86 admin admin] PATH_INFO: `/v3/projects/3812510785294b2ba0e47adde49bfc7d/users/cb39db04e49749219cde545b5ad63e71/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:31.083325 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 805/1604] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:34:30 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:34:31.084138 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ded3c-7e63-4611-9f53-d6da72c78ecb admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:31.094903 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccc331f-a259-450d-8bb5-8c41450f0f86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3812510785294b2ba0e47adde49bfc7d, user_id=cb39db04e49749219cde545b5ad63e71, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:31.095351 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ded3c-7e63-4611-9f53-d6da72c78ecb admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:31.097686 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccc331f-a259-450d-8bb5-8c41450f0f86 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:31.101019 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2455e9-564b-4ac7-930e-104083e39658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:31.101019 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2455e9-564b-4ac7-930e-104083e39658 admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:31.101223 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2455e9-564b-4ac7-930e-104083e39658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:31.101456 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2455e9-564b-4ac7-930e-104083e39658 admin admin] PATH_INFO: `/v3/projects/8a4172de74f54f9fa1b4a2d24908de24/users/8a959557b0064aff8e2308e842859481/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:31.116321 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2455e9-564b-4ac7-930e-104083e39658 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a4172de74f54f9fa1b4a2d24908de24, user_id=8a959557b0064aff8e2308e842859481, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:31.119236 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2455e9-564b-4ac7-930e-104083e39658 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:31.201639 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 800/1605] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:34:31 2022] PUT /identity/v3/projects/3812510785294b2ba0e47adde49bfc7d/users/cb39db04e49749219cde545b5ad63e71/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:34:31.204579 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc331f-a259-450d-8bb5-8c41450f0f86 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:31.264449 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 806/1606] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:34:31 2022] PUT /identity/v3/projects/8a4172de74f54f9fa1b4a2d24908de24/users/8a959557b0064aff8e2308e842859481/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:34:31.265296 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2455e9-564b-4ac7-930e-104083e39658 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:31.275734 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc331f-a259-450d-8bb5-8c41450f0f86 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:31.335897 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2455e9-564b-4ac7-930e-104083e39658 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:31.340855 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266394a-8763-423c-89f2-4103c06ab58d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:31.341710 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266394a-8763-423c-89f2-4103c06ab58d service neutron] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:31.342184 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266394a-8763-423c-89f2-4103c06ab58d service neutron] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:31.342619 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266394a-8763-423c-89f2-4103c06ab58d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:31.361574 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cafc2a-56f8-472f-93a1-6db1ecf72698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:31.362605 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cafc2a-56f8-472f-93a1-6db1ecf72698 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:31.363103 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cafc2a-56f8-472f-93a1-6db1ecf72698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:31.364228 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cafc2a-56f8-472f-93a1-6db1ecf72698 admin admin] PATH_INFO: `/v3/projects/914487d4e22545c89e75a8e34282802a/users/a76dd39b4a8c4deea3fa8a61debd8d24/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:31.391200 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cafc2a-56f8-472f-93a1-6db1ecf72698 admin admin] RBAC: Authorizing `identity:create_grant(project_id=914487d4e22545c89e75a8e34282802a, user_id=a76dd39b4a8c4deea3fa8a61debd8d24, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:31.395012 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cafc2a-56f8-472f-93a1-6db1ecf72698 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:31.435444 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c266394a-8763-423c-89f2-4103c06ab58d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:31.436968 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c266394a-8763-423c-89f2-4103c06ab58d service neutron] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:31.448235 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 807/1607] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:34:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:34:31.449062 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266394a-8763-423c-89f2-4103c06ab58d service neutron] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:31.460690 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266394a-8763-423c-89f2-4103c06ab58d service neutron] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:31.466788 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8887b9-b9cd-4030-8b5d-119822d61858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:31.467519 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8887b9-b9cd-4030-8b5d-119822d61858 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:31.467808 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8887b9-b9cd-4030-8b5d-119822d61858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:31.468127 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8887b9-b9cd-4030-8b5d-119822d61858 admin admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:31.468929 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8887b9-b9cd-4030-8b5d-119822d61858 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:31.471527 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8887b9-b9cd-4030-8b5d-119822d61858 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:31.491734 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 801/1608] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:34:31 2022] PUT /identity/v3/projects/914487d4e22545c89e75a8e34282802a/users/a76dd39b4a8c4deea3fa8a61debd8d24/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:34:31.493468 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8ee10-2a9f-4b36-8169-12dc3c816388 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:31.493767 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8ee10-2a9f-4b36-8169-12dc3c816388 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:31.494048 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8ee10-2a9f-4b36-8169-12dc3c816388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:31.526162 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-74f8ee10-2a9f-4b36-8169-12dc3c816388 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:31.527375 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-74f8ee10-2a9f-4b36-8169-12dc3c816388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:31.557266 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:34:31.568887 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 808/1609] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:34:31 2022] POST /identity/v3/users => generated 288 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:34:31.569727 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8887b9-b9cd-4030-8b5d-119822d61858 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:31.577253 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:34:31.581307 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8887b9-b9cd-4030-8b5d-119822d61858 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:31.600641 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 802/1610] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:31.601881 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d70cb26-c5e2-41ac-bed6-88f30da63dba None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:31.602172 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d70cb26-c5e2-41ac-bed6-88f30da63dba None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:31.602447 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d70cb26-c5e2-41ac-bed6-88f30da63dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:31.636036 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-3d70cb26-c5e2-41ac-bed6-88f30da63dba None None] MFA Rules not processed for user `cb39db04e49749219cde545b5ad63e71`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:31.638056 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-3d70cb26-c5e2-41ac-bed6-88f30da63dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:31.649568 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ff521-bb42-482b-be36-6a83180d74db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:31.651373 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ff521-bb42-482b-be36-6a83180d74db admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:31.651373 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ff521-bb42-482b-be36-6a83180d74db admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:31.651373 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ff521-bb42-482b-be36-6a83180d74db admin admin] PATH_INFO: `/v3/projects/59c030259a0345bb997a4fb0ad0f7728/users/553bf9fe59074554a4642339b1b2a800/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:31.665874 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ff521-bb42-482b-be36-6a83180d74db admin admin] RBAC: Authorizing `identity:create_grant(project_id=59c030259a0345bb997a4fb0ad0f7728, user_id=553bf9fe59074554a4642339b1b2a800, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:31.668701 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ff521-bb42-482b-be36-6a83180d74db admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:31.707306 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 803/1611] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:31 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:31.708661 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96417b-89ba-4e40-8671-2f57f67955f4 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:31.708954 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96417b-89ba-4e40-8671-2f57f67955f4 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:31.709232 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96417b-89ba-4e40-8671-2f57f67955f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:31.728330 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-0b96417b-89ba-4e40-8671-2f57f67955f4 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:31.729603 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-0b96417b-89ba-4e40-8671-2f57f67955f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:31.739575 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 804/1612] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:31.740785 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69cabe-1108-4675-9296-d16380c7094f None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:31.741078 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69cabe-1108-4675-9296-d16380c7094f None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:31.741549 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69cabe-1108-4675-9296-d16380c7094f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:31.777134 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-db69cabe-1108-4675-9296-d16380c7094f None None] MFA Rules not processed for user `a76dd39b4a8c4deea3fa8a61debd8d24`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:31.777762 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-db69cabe-1108-4675-9296-d16380c7094f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:31.791404 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 809/1613] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:34:31 2022] PUT /identity/v3/projects/59c030259a0345bb997a4fb0ad0f7728/users/553bf9fe59074554a4642339b1b2a800/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:34:31.792532 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ff521-bb42-482b-be36-6a83180d74db admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:31.895087 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ff521-bb42-482b-be36-6a83180d74db admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:31.901254 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034fc8be-e88a-4499-9137-738f0673942c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:31.901938 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034fc8be-e88a-4499-9137-738f0673942c admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:31.908416 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034fc8be-e88a-4499-9137-738f0673942c admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:31.908416 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034fc8be-e88a-4499-9137-738f0673942c admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:31.908416 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034fc8be-e88a-4499-9137-738f0673942c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:31.908416 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034fc8be-e88a-4499-9137-738f0673942c admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:31.916169 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 810/1614] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:34:31.916421 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 805/1615] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:31 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:31.917158 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034fc8be-e88a-4499-9137-738f0673942c admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:31.917851 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69cabe-1108-4675-9296-d16380c7094f None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:31.920421 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-034fc8be-e88a-4499-9137-738f0673942c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:31.940919 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69cabe-1108-4675-9296-d16380c7094f None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:31.948802 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61ee10c-8c19-409f-b893-ba2784b2cbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:31.949510 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ee10c-8c19-409f-b893-ba2784b2cbd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:31.949823 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ee10c-8c19-409f-b893-ba2784b2cbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:31.950112 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ee10c-8c19-409f-b893-ba2784b2cbd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:31.950836 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61ee10c-8c19-409f-b893-ba2784b2cbd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:31.952784 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61ee10c-8c19-409f-b893-ba2784b2cbd9 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:31.994158 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034fc8be-e88a-4499-9137-738f0673942c admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:32.001428 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c5c08-f799-42f8-8ccd-088502b24c4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:32.001428 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c5c08-f799-42f8-8ccd-088502b24c4a service neutron] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:32.001428 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c5c08-f799-42f8-8ccd-088502b24c4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:32.001428 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c5c08-f799-42f8-8ccd-088502b24c4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:32.010990 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215c5c08-f799-42f8-8ccd-088502b24c4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:32.012566 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215c5c08-f799-42f8-8ccd-088502b24c4a service neutron] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:32.023649 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 811/1616] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:34:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:34:32.024370 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c5c08-f799-42f8-8ccd-088502b24c4a service neutron] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:32.033029 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c5c08-f799-42f8-8ccd-088502b24c4a service neutron] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:32.037277 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ba226-f550-4ee6-ad42-d766681cd920 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:32.037948 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ba226-f550-4ee6-ad42-d766681cd920 service neutron] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:32.038225 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ba226-f550-4ee6-ad42-d766681cd920 service neutron] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:32.038495 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ba226-f550-4ee6-ad42-d766681cd920 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:32.050352 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360ba226-f550-4ee6-ad42-d766681cd920 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:32.051804 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360ba226-f550-4ee6-ad42-d766681cd920 service neutron] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:32.064055 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 812/1617] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:34:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:34:32.072446 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ea414-10d2-454c-ae5f-e5e611cbcb10 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:32.072848 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ea414-10d2-454c-ae5f-e5e611cbcb10 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:32.073204 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ea414-10d2-454c-ae5f-e5e611cbcb10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:32.091424 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 806/1618] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:34:31 2022] POST /identity/v3/projects => generated 405 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:34:32.093371 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61ee10c-8c19-409f-b893-ba2784b2cbd9 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:32.132358 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-c17ea414-10d2-454c-ae5f-e5e611cbcb10 None None] MFA Rules not processed for user `553bf9fe59074554a4642339b1b2a800`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:32.133770 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-c17ea414-10d2-454c-ae5f-e5e611cbcb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:32.141068 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:34:32.153150 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:34:32.244361 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61ee10c-8c19-409f-b893-ba2784b2cbd9 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:32.252372 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb0cd6-7a83-4aeb-a3c6-38408bc28db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:32.253553 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb0cd6-7a83-4aeb-a3c6-38408bc28db7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:32.253839 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb0cd6-7a83-4aeb-a3c6-38408bc28db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:32.254181 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb0cd6-7a83-4aeb-a3c6-38408bc28db7 admin admin] PATH_INFO: `/v3/projects/4f26538727414b67a765bcef68badfd6/users/52c39037fbc847e3b82ed9ec1fa0cca1/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:32.258277 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 813/1619] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:32.271453 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb0cd6-7a83-4aeb-a3c6-38408bc28db7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f26538727414b67a765bcef68badfd6, user_id=52c39037fbc847e3b82ed9ec1fa0cca1, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:32.283487 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb0cd6-7a83-4aeb-a3c6-38408bc28db7 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:32.283585 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17ea414-10d2-454c-ae5f-e5e611cbcb10 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:32.381331 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 807/1620] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:34:32 2022] PUT /identity/v3/projects/4f26538727414b67a765bcef68badfd6/users/52c39037fbc847e3b82ed9ec1fa0cca1/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:34:32.382475 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb0cd6-7a83-4aeb-a3c6-38408bc28db7 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:32.550700 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17ea414-10d2-454c-ae5f-e5e611cbcb10 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:32.601415 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb0cd6-7a83-4aeb-a3c6-38408bc28db7 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:32.607676 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb041596-1299-42bd-ac60-c686b3f71c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:32.608721 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb041596-1299-42bd-ac60-c686b3f71c27 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:32.609507 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb041596-1299-42bd-ac60-c686b3f71c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:32.610005 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb041596-1299-42bd-ac60-c686b3f71c27 admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:32.610995 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb041596-1299-42bd-ac60-c686b3f71c27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:32.613553 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb041596-1299-42bd-ac60-c686b3f71c27 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:32.624450 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba976706-b334-40c9-bb08-f169d1af6b73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:32.625135 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba976706-b334-40c9-bb08-f169d1af6b73 service cinder] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:32.625422 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba976706-b334-40c9-bb08-f169d1af6b73 service cinder] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:32.626863 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba976706-b334-40c9-bb08-f169d1af6b73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:32.723298 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 808/1621] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:34:32 2022] POST /identity/v3/users => generated 309 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:34:32.725747 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec13fef-2fa6-4141-8a25-b5cfb21d6629 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:32.726063 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec13fef-2fa6-4141-8a25-b5cfb21d6629 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:32.727351 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec13fef-2fa6-4141-8a25-b5cfb21d6629 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:32.732898 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 809/1622] 10.222.0.62 () {54 vars in 961 bytes} [Mon Jun 27 09:34:32 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:34:32.736525 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec13fef-2fa6-4141-8a25-b5cfb21d6629 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:32.777445 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec13fef-2fa6-4141-8a25-b5cfb21d6629 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:32.792314 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba976706-b334-40c9-bb08-f169d1af6b73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:32.794451 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd295c3-6c03-4cc9-82a2-8126490ab40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:32.795405 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd295c3-6c03-4cc9-82a2-8126490ab40c admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:32.795689 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd295c3-6c03-4cc9-82a2-8126490ab40c admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:32.795968 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd295c3-6c03-4cc9-82a2-8126490ab40c admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:32.796718 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd295c3-6c03-4cc9-82a2-8126490ab40c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:32.798323 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd295c3-6c03-4cc9-82a2-8126490ab40c admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:32.803921 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba976706-b334-40c9-bb08-f169d1af6b73 service cinder] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:32.823519 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 814/1623] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:34:32 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:34:32.825693 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba976706-b334-40c9-bb08-f169d1af6b73 service cinder] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:32.832187 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 810/1624] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:34:32.832187 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fb157-cfb1-4a2d-b2a3-48798e8e7b4b None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:32.832187 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fb157-cfb1-4a2d-b2a3-48798e8e7b4b None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:32.832187 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fb157-cfb1-4a2d-b2a3-48798e8e7b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:32.862909 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba976706-b334-40c9-bb08-f169d1af6b73 service cinder] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:32.873994 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ff6e1-b8a3-4e88-a59f-4325362417e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:32.874680 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ff6e1-b8a3-4e88-a59f-4325362417e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:32.875245 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ff6e1-b8a3-4e88-a59f-4325362417e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:32.875535 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ff6e1-b8a3-4e88-a59f-4325362417e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:32.876476 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752ff6e1-b8a3-4e88-a59f-4325362417e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:32.879819 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-a21fb157-cfb1-4a2d-b2a3-48798e8e7b4b None None] MFA Rules not processed for user `2c1434a85b30411c9c59cc50c3980cd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:32.882013 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752ff6e1-b8a3-4e88-a59f-4325362417e0 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:32.885681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-a21fb157-cfb1-4a2d-b2a3-48798e8e7b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:32.906291 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 815/1625] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:34:32.907312 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ff6e1-b8a3-4e88-a59f-4325362417e0 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:32.925232 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ff6e1-b8a3-4e88-a59f-4325362417e0 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:32.929083 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129a395-85ae-407a-ac3e-272fac805a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:32.929987 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129a395-85ae-407a-ac3e-272fac805a94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:32.930266 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129a395-85ae-407a-ac3e-272fac805a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:32.930541 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129a395-85ae-407a-ac3e-272fac805a94 admin admin] PATH_INFO: `/v3/projects/4f26538727414b67a765bcef68badfd6/users/52c39037fbc847e3b82ed9ec1fa0cca1/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:32.933554 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b129a395-85ae-407a-ac3e-272fac805a94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f26538727414b67a765bcef68badfd6, user_id=52c39037fbc847e3b82ed9ec1fa0cca1, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:32.937854 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b129a395-85ae-407a-ac3e-272fac805a94 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:32.952008 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 816/1626] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:34:32 2022] PUT /identity/v3/projects/4f26538727414b67a765bcef68badfd6/users/52c39037fbc847e3b82ed9ec1fa0cca1/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:34:32.954723 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129a395-85ae-407a-ac3e-272fac805a94 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:33.019923 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 811/1627] 10.222.0.62 () {58 vars in 1058 bytes} [Mon Jun 27 09:34:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:33.031116 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22872622-9bfa-4591-b0f8-1f7e364fc9f0 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:33.031802 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22872622-9bfa-4591-b0f8-1f7e364fc9f0 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:33.032259 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22872622-9bfa-4591-b0f8-1f7e364fc9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:33.075706 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129a395-85ae-407a-ac3e-272fac805a94 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:33.077413 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-22872622-9bfa-4591-b0f8-1f7e364fc9f0 None None] MFA Rules not processed for user `52c39037fbc847e3b82ed9ec1fa0cca1`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:33.079169 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-22872622-9bfa-4591-b0f8-1f7e364fc9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:33.081673 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da710f-220e-407c-a618-b5a0d1507f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:33.083611 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da710f-220e-407c-a618-b5a0d1507f10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:33.084058 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da710f-220e-407c-a618-b5a0d1507f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:33.084512 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da710f-220e-407c-a618-b5a0d1507f10 admin admin] PATH_INFO: `/v3/projects/6cd6a0a008ad4558aa0afc3199ae6c37/users/6ab6824641b54a2982b90d49455ae2c7/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:33.103492 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48da710f-220e-407c-a618-b5a0d1507f10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cd6a0a008ad4558aa0afc3199ae6c37, user_id=6ab6824641b54a2982b90d49455ae2c7, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:33.110040 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48da710f-220e-407c-a618-b5a0d1507f10 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:33.201114 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 812/1628] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:33 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:33.202451 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22872622-9bfa-4591-b0f8-1f7e364fc9f0 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:33.224460 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 817/1629] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:34:32 2022] PUT /identity/v3/projects/6cd6a0a008ad4558aa0afc3199ae6c37/users/6ab6824641b54a2982b90d49455ae2c7/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:34:33.225679 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da710f-220e-407c-a618-b5a0d1507f10 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:33.303713 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:34:33.369386 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da710f-220e-407c-a618-b5a0d1507f10 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:33.381428 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd58ba-2f18-443a-b147-1f49d530e27c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:33.381428 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd58ba-2f18-443a-b147-1f49d530e27c service cinder] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:33.381633 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd58ba-2f18-443a-b147-1f49d530e27c service cinder] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:33.381819 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd58ba-2f18-443a-b147-1f49d530e27c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:33.403301 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22872622-9bfa-4591-b0f8-1f7e364fc9f0 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:33.440301 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:34:33.559381 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd58ba-2f18-443a-b147-1f49d530e27c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:33.565783 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd58ba-2f18-443a-b147-1f49d530e27c service cinder] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:33.575892 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c0fcc0-cd13-4cf5-961c-541c8335b627 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:33.576639 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0fcc0-cd13-4cf5-961c-541c8335b627 service nova] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:33.576924 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0fcc0-cd13-4cf5-961c-541c8335b627 service nova] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:33.577202 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0fcc0-cd13-4cf5-961c-541c8335b627 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:33.595663 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 818/1630] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:34:33 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:34:33.598775 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd58ba-2f18-443a-b147-1f49d530e27c service cinder] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:33.730403 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c0fcc0-cd13-4cf5-961c-541c8335b627 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:33.735785 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c0fcc0-cd13-4cf5-961c-541c8335b627 service nova] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:33.763687 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd58ba-2f18-443a-b147-1f49d530e27c service cinder] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:33.765806 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 813/1631] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:34:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:34:33.770499 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d0d97-b78b-4593-8128-3412f7a6cf37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:33.771958 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d0d97-b78b-4593-8128-3412f7a6cf37 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:33.772270 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d0d97-b78b-4593-8128-3412f7a6cf37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:33.772550 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d0d97-b78b-4593-8128-3412f7a6cf37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:33.773342 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d0d97-b78b-4593-8128-3412f7a6cf37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:33.775652 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d0d97-b78b-4593-8128-3412f7a6cf37 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:33.789181 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 819/1632] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:34:33 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:34:33.794138 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c0fcc0-cd13-4cf5-961c-541c8335b627 service nova] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:33.807786 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c0fcc0-cd13-4cf5-961c-541c8335b627 service nova] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:33.813406 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c39ba1-6c7c-413a-b098-7489b4955751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:33.814832 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c39ba1-6c7c-413a-b098-7489b4955751 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:33.815477 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c39ba1-6c7c-413a-b098-7489b4955751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:33.815901 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c39ba1-6c7c-413a-b098-7489b4955751 admin admin] PATH_INFO: `/v3/projects/6cd6a0a008ad4558aa0afc3199ae6c37/users/6ab6824641b54a2982b90d49455ae2c7/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:33.818848 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c39ba1-6c7c-413a-b098-7489b4955751 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cd6a0a008ad4558aa0afc3199ae6c37, user_id=6ab6824641b54a2982b90d49455ae2c7, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:33.826112 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c39ba1-6c7c-413a-b098-7489b4955751 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:33.854101 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 814/1633] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:34:33 2022] PUT /identity/v3/projects/6cd6a0a008ad4558aa0afc3199ae6c37/users/6ab6824641b54a2982b90d49455ae2c7/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:34:33.867668 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37d389-283a-4b86-9925-fcf1061ce152 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:33.868291 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37d389-283a-4b86-9925-fcf1061ce152 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:33.871980 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37d389-283a-4b86-9925-fcf1061ce152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:33.934290 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-bc37d389-283a-4b86-9925-fcf1061ce152 None None] MFA Rules not processed for user `6ab6824641b54a2982b90d49455ae2c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:33.938075 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-bc37d389-283a-4b86-9925-fcf1061ce152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:34.041769 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 820/1634] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:33 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:34.066094 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:34:34.094284 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c39ba1-6c7c-413a-b098-7489b4955751 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:34.275726 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c39ba1-6c7c-413a-b098-7489b4955751 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:34.280496 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9aed69-8b80-4ad5-a364-88525f119498 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:34.280854 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9aed69-8b80-4ad5-a364-88525f119498 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:34.281295 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9aed69-8b80-4ad5-a364-88525f119498 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:34.283330 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 821/1635] 10.222.0.62 () {54 vars in 912 bytes} [Mon Jun 27 09:34:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:34:34.286056 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f96e11-d393-4ac2-a1bc-e45b298626a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:34.289007 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f96e11-d393-4ac2-a1bc-e45b298626a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:34.289539 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f96e11-d393-4ac2-a1bc-e45b298626a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:34.289997 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f96e11-d393-4ac2-a1bc-e45b298626a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:34.292407 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71bc1d-4c73-4ae2-9830-c84f7a910c53 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:34.292652 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71bc1d-4c73-4ae2-9830-c84f7a910c53 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:34.292958 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71bc1d-4c73-4ae2-9830-c84f7a910c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:34.329756 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f96e11-d393-4ac2-a1bc-e45b298626a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:34.330392 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-ff71bc1d-4c73-4ae2-9830-c84f7a910c53 None None] MFA Rules not processed for user `2c1434a85b30411c9c59cc50c3980cd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:34.331649 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-ff71bc1d-4c73-4ae2-9830-c84f7a910c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:34.345922 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f96e11-d393-4ac2-a1bc-e45b298626a2 service cinder] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:34.371982 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 815/1636] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:34:34 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:34:34.514704 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 822/1637] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Jun 27 09:34:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jun 27 09:34:34.527814 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f96e11-d393-4ac2-a1bc-e45b298626a2 service cinder] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:34.538722 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f96e11-d393-4ac2-a1bc-e45b298626a2 service cinder] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:34.542739 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8effff8b-e0c7-45b8-b237-6c9a357ca69b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:34.543974 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effff8b-e0c7-45b8-b237-6c9a357ca69b service cinder] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:34.548374 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effff8b-e0c7-45b8-b237-6c9a357ca69b service cinder] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:34.548374 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effff8b-e0c7-45b8-b237-6c9a357ca69b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:34.560090 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8effff8b-e0c7-45b8-b237-6c9a357ca69b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:34.563259 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8effff8b-e0c7-45b8-b237-6c9a357ca69b service cinder] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:34.592479 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 816/1638] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:34:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:34:34.740792 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:34:35.085596 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff71bc1d-4c73-4ae2-9830-c84f7a910c53 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:35.483949 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff71bc1d-4c73-4ae2-9830-c84f7a910c53 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:35.483949 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a21394-ae0c-46c0-9ef9-4f6c3687ea78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:35.483949 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a21394-ae0c-46c0-9ef9-4f6c3687ea78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:35.483949 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a21394-ae0c-46c0-9ef9-4f6c3687ea78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:35.489785 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a21394-ae0c-46c0-9ef9-4f6c3687ea78 admin admin] PATH_INFO: `/v3/users/cb39db04e49749219cde545b5ad63e71` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:35.489785 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a21394-ae0c-46c0-9ef9-4f6c3687ea78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb39db04e49749219cde545b5ad63e71)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:35.489785 dv-cinder-847730-1-smb devstack@keystone.service[80306]: WARNING py.warnings [None req-f3a21394-ae0c-46c0-9ef9-4f6c3687ea78 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 09:34:35.489785 dv-cinder-847730-1-smb devstack@keystone.service[80306]: warnings.warn(msg) Jun 27 09:34:35.489785 dv-cinder-847730-1-smb devstack@keystone.service[80306]: Jun 27 09:34:35.489785 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a21394-ae0c-46c0-9ef9-4f6c3687ea78 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:35.489785 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:34:35.915813 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-f3a21394-ae0c-46c0-9ef9-4f6c3687ea78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb39db04e49749219cde545b5ad63e71'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:35.919332 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-f3a21394-ae0c-46c0-9ef9-4f6c3687ea78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb39db04e49749219cde545b5ad63e71'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:36.015831 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8effff8b-e0c7-45b8-b237-6c9a357ca69b service cinder] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:36.035963 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8effff8b-e0c7-45b8-b237-6c9a357ca69b service cinder] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:36.040468 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-f3a21394-ae0c-46c0-9ef9-4f6c3687ea78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb39db04e49749219cde545b5ad63e71'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:36.041536 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-f3a21394-ae0c-46c0-9ef9-4f6c3687ea78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb39db04e49749219cde545b5ad63e71'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:36.061155 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-f3a21394-ae0c-46c0-9ef9-4f6c3687ea78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb39db04e49749219cde545b5ad63e71'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:36.062619 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b3b2d1-2839-4263-8c1c-816e16098ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:36.063511 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3b2d1-2839-4263-8c1c-816e16098ca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:36.063788 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3b2d1-2839-4263-8c1c-816e16098ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:36.067613 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3b2d1-2839-4263-8c1c-816e16098ca9 admin admin] PATH_INFO: `/v3/users/ed3812a7a5d84612b8bdf8cf93dfb9cf` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:36.069717 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b3b2d1-2839-4263-8c1c-816e16098ca9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed3812a7a5d84612b8bdf8cf93dfb9cf)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:36.078418 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b3b2d1-2839-4263-8c1c-816e16098ca9 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:36.127986 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 823/1639] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:34:35 2022] DELETE /identity/v3/users/cb39db04e49749219cde545b5ad63e71 => generated 0 bytes in 1044 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:34:36.134187 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfc5d6-46b2-4d90-b154-07b28ba33bdb None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:36.134187 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfc5d6-46b2-4d90-b154-07b28ba33bdb None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:36.134187 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfc5d6-46b2-4d90-b154-07b28ba33bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:36.167247 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-66bfc5d6-46b2-4d90-b154-07b28ba33bdb None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:36.169404 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-66bfc5d6-46b2-4d90-b154-07b28ba33bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:36.298952 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 824/1640] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 09:34:36.331618 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-85b3b2d1-2839-4263-8c1c-816e16098ca9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed3812a7a5d84612b8bdf8cf93dfb9cf'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:36.360916 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-85b3b2d1-2839-4263-8c1c-816e16098ca9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed3812a7a5d84612b8bdf8cf93dfb9cf'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:36.466408 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-85b3b2d1-2839-4263-8c1c-816e16098ca9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed3812a7a5d84612b8bdf8cf93dfb9cf'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:36.471090 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-85b3b2d1-2839-4263-8c1c-816e16098ca9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed3812a7a5d84612b8bdf8cf93dfb9cf'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:36.471335 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bfc5d6-46b2-4d90-b154-07b28ba33bdb None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:36.471335 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-66bfc5d6-46b2-4d90-b154-07b28ba33bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:36.497956 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-85b3b2d1-2839-4263-8c1c-816e16098ca9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed3812a7a5d84612b8bdf8cf93dfb9cf'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:36.512893 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 817/1641] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:34:36 2022] DELETE /identity/v3/users/ed3812a7a5d84612b8bdf8cf93dfb9cf => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:34:36.517835 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c4b67-7459-4b94-9218-4dc6a56019cb None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:36.518125 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c4b67-7459-4b94-9218-4dc6a56019cb None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:36.518710 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c4b67-7459-4b94-9218-4dc6a56019cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:36.566148 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-660c4b67-7459-4b94-9218-4dc6a56019cb None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:36.571289 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-660c4b67-7459-4b94-9218-4dc6a56019cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:36.612777 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bfc5d6-46b2-4d90-b154-07b28ba33bdb None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:36.623777 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:34:36.630967 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:34:36.696736 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd98550-1fad-4db9-885a-a0947aae6997 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:36.697504 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd98550-1fad-4db9-885a-a0947aae6997 service neutron] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:36.697786 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd98550-1fad-4db9-885a-a0947aae6997 service neutron] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:36.698065 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd98550-1fad-4db9-885a-a0947aae6997 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:36.701672 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-0dd98550-1fad-4db9-885a-a0947aae6997 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:36.740365 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 818/1642] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:36.745280 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99045165-4e2d-4574-9582-b0d5eaeb9634 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:36.745280 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99045165-4e2d-4574-9582-b0d5eaeb9634 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:36.745280 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99045165-4e2d-4574-9582-b0d5eaeb9634 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:36.747131 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 819/1643] 10.222.0.62 () {54 vars in 961 bytes} [Mon Jun 27 09:34:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:34:36.754519 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff7541-49cc-44ed-a290-c95fe27fd210 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:36.754814 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff7541-49cc-44ed-a290-c95fe27fd210 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:36.755097 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff7541-49cc-44ed-a290-c95fe27fd210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:36.802651 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-57ff7541-49cc-44ed-a290-c95fe27fd210 None None] MFA Rules not processed for user `2c1434a85b30411c9c59cc50c3980cd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:36.802651 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-57ff7541-49cc-44ed-a290-c95fe27fd210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:36.837176 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd98550-1fad-4db9-885a-a0947aae6997 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:36.838666 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd98550-1fad-4db9-885a-a0947aae6997 service neutron] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:36.863307 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 825/1644] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:34:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:34:36.864173 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd98550-1fad-4db9-885a-a0947aae6997 service neutron] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:36.865503 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-0dd98550-1fad-4db9-885a-a0947aae6997 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:36.888172 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd98550-1fad-4db9-885a-a0947aae6997 service neutron] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:36.892109 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1047683-9dae-402a-8fdd-15cd5bba71ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:36.892799 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1047683-9dae-402a-8fdd-15cd5bba71ec service neutron] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:36.893082 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1047683-9dae-402a-8fdd-15cd5bba71ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:36.893365 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1047683-9dae-402a-8fdd-15cd5bba71ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:36.920550 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1047683-9dae-402a-8fdd-15cd5bba71ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:36.930269 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1047683-9dae-402a-8fdd-15cd5bba71ec service neutron] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:36.952287 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 820/1645] 10.222.0.62 () {58 vars in 1058 bytes} [Mon Jun 27 09:34:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:36.954275 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b3596-e788-43a6-b237-3c5aaa9b6c64 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:36.954885 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b3596-e788-43a6-b237-3c5aaa9b6c64 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:36.955339 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b3596-e788-43a6-b237-3c5aaa9b6c64 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:36.957455 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 821/1646] 10.222.0.62 () {54 vars in 912 bytes} [Mon Jun 27 09:34:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:34:36.972629 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82f002-4c7c-41ed-8cd1-4e6de677d15c None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:36.972885 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82f002-4c7c-41ed-8cd1-4e6de677d15c None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:36.974526 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82f002-4c7c-41ed-8cd1-4e6de677d15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:36.983015 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 826/1647] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:34:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:34:37.005883 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-ea82f002-4c7c-41ed-8cd1-4e6de677d15c None None] MFA Rules not processed for user `2c1434a85b30411c9c59cc50c3980cd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:37.009052 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-ea82f002-4c7c-41ed-8cd1-4e6de677d15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:37.036072 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 822/1648] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Jun 27 09:34:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:37.044123 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1047683-9dae-402a-8fdd-15cd5bba71ec service neutron] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:37.045656 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-d1047683-9dae-402a-8fdd-15cd5bba71ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:37.150748 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1047683-9dae-402a-8fdd-15cd5bba71ec service neutron] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:37.157262 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3cf0e1-83d5-4afa-bb49-2457ab9883f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:37.158303 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3cf0e1-83d5-4afa-bb49-2457ab9883f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:37.159144 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3cf0e1-83d5-4afa-bb49-2457ab9883f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:37.159546 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3cf0e1-83d5-4afa-bb49-2457ab9883f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:37.177004 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3cf0e1-83d5-4afa-bb49-2457ab9883f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:37.179778 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3cf0e1-83d5-4afa-bb49-2457ab9883f1 service cinder] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:37.202578 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 827/1649] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:34:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:34:39.091849 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea82f002-4c7c-41ed-8cd1-4e6de677d15c None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:39.094375 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-ea82f002-4c7c-41ed-8cd1-4e6de677d15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:39.101327 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3cf0e1-83d5-4afa-bb49-2457ab9883f1 service cinder] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:39.109842 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-ca3cf0e1-83d5-4afa-bb49-2457ab9883f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:39.135517 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea82f002-4c7c-41ed-8cd1-4e6de677d15c None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:39.148234 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de66813-056a-4f89-96ff-f56576bf40f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:39.149030 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3cf0e1-83d5-4afa-bb49-2457ab9883f1 service cinder] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:39.150113 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de66813-056a-4f89-96ff-f56576bf40f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:39.150849 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de66813-056a-4f89-96ff-f56576bf40f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:39.151550 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de66813-056a-4f89-96ff-f56576bf40f2 admin admin] PATH_INFO: `/v3/projects/7d520e618b8e4fb1a5bf2bacf03b20fc` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:39.154427 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de66813-056a-4f89-96ff-f56576bf40f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d520e618b8e4fb1a5bf2bacf03b20fc)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:39.157039 dv-cinder-847730-1-smb devstack@keystone.service[80307]: WARNING py.warnings [None req-0de66813-056a-4f89-96ff-f56576bf40f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 09:34:39.157039 dv-cinder-847730-1-smb devstack@keystone.service[80307]: warnings.warn(msg) Jun 27 09:34:39.157039 dv-cinder-847730-1-smb devstack@keystone.service[80307]: Jun 27 09:34:39.158461 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de66813-056a-4f89-96ff-f56576bf40f2 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:39.163378 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff53b5-13f3-4aa7-aec9-beef430d4008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:39.167277 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff53b5-13f3-4aa7-aec9-beef430d4008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:39.167277 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff53b5-13f3-4aa7-aec9-beef430d4008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:39.167277 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff53b5-13f3-4aa7-aec9-beef430d4008 admin admin] PATH_INFO: `/v3/projects/3812510785294b2ba0e47adde49bfc7d` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:39.171620 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff53b5-13f3-4aa7-aec9-beef430d4008 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3812510785294b2ba0e47adde49bfc7d)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:39.178018 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff53b5-13f3-4aa7-aec9-beef430d4008 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:39.372689 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-0de66813-056a-4f89-96ff-f56576bf40f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d520e618b8e4fb1a5bf2bacf03b20fc', 'request_id': 'req-0de66813-056a-4f89-96ff-f56576bf40f2'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:39.401924 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-26ff53b5-13f3-4aa7-aec9-beef430d4008 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3812510785294b2ba0e47adde49bfc7d', 'request_id': 'req-26ff53b5-13f3-4aa7-aec9-beef430d4008'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:39.454410 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-0de66813-056a-4f89-96ff-f56576bf40f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d520e618b8e4fb1a5bf2bacf03b20fc', 'request_id': 'req-0de66813-056a-4f89-96ff-f56576bf40f2'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:39.463736 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-0de66813-056a-4f89-96ff-f56576bf40f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d520e618b8e4fb1a5bf2bacf03b20fc', 'request_id': 'req-0de66813-056a-4f89-96ff-f56576bf40f2'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:39.506054 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-26ff53b5-13f3-4aa7-aec9-beef430d4008 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3812510785294b2ba0e47adde49bfc7d', 'request_id': 'req-26ff53b5-13f3-4aa7-aec9-beef430d4008'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:39.518142 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-26ff53b5-13f3-4aa7-aec9-beef430d4008 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3812510785294b2ba0e47adde49bfc7d', 'request_id': 'req-26ff53b5-13f3-4aa7-aec9-beef430d4008'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:39.546790 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-0de66813-056a-4f89-96ff-f56576bf40f2 admin admin] The token cache is being invalidate because project 7d520e618b8e4fb1a5bf2bacf03b20fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:34:39.546790 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-0de66813-056a-4f89-96ff-f56576bf40f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:39.549979 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-26ff53b5-13f3-4aa7-aec9-beef430d4008 admin admin] The token cache is being invalidate because project 3812510785294b2ba0e47adde49bfc7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:34:39.550459 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-0de66813-056a-4f89-96ff-f56576bf40f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:39.550994 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-26ff53b5-13f3-4aa7-aec9-beef430d4008 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:39.554306 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-26ff53b5-13f3-4aa7-aec9-beef430d4008 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:39.558818 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 823/1650] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:34:39 2022] DELETE /identity/v3/projects/7d520e618b8e4fb1a5bf2bacf03b20fc => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:34:39.564135 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de66813-056a-4f89-96ff-f56576bf40f2 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:39.566036 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 828/1651] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:34:39 2022] DELETE /identity/v3/projects/3812510785294b2ba0e47adde49bfc7d => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:34:39.568943 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-0de66813-056a-4f89-96ff-f56576bf40f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:39.570212 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff53b5-13f3-4aa7-aec9-beef430d4008 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:39.575287 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-26ff53b5-13f3-4aa7-aec9-beef430d4008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:39.751335 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff53b5-13f3-4aa7-aec9-beef430d4008 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:39.769462 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569160ee-8eb4-481f-8b04-e9ee4715d8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:39.770365 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569160ee-8eb4-481f-8b04-e9ee4715d8d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:39.770649 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569160ee-8eb4-481f-8b04-e9ee4715d8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:39.770923 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569160ee-8eb4-481f-8b04-e9ee4715d8d9 admin admin] PATH_INFO: `/v3/users/6ab6824641b54a2982b90d49455ae2c7` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:39.774936 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569160ee-8eb4-481f-8b04-e9ee4715d8d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ab6824641b54a2982b90d49455ae2c7)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:39.776971 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569160ee-8eb4-481f-8b04-e9ee4715d8d9 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:39.836979 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de66813-056a-4f89-96ff-f56576bf40f2 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:39.851838 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d08f1-e87a-4a12-98b7-e6b807bc9c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:39.853762 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d08f1-e87a-4a12-98b7-e6b807bc9c09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:39.854331 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d08f1-e87a-4a12-98b7-e6b807bc9c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:39.854698 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d08f1-e87a-4a12-98b7-e6b807bc9c09 admin admin] PATH_INFO: `/v3/users/52c39037fbc847e3b82ed9ec1fa0cca1` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:39.857284 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87d08f1-e87a-4a12-98b7-e6b807bc9c09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52c39037fbc847e3b82ed9ec1fa0cca1)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:39.862151 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87d08f1-e87a-4a12-98b7-e6b807bc9c09 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:39.927565 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:34:39.995752 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:34:40.070465 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-569160ee-8eb4-481f-8b04-e9ee4715d8d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ab6824641b54a2982b90d49455ae2c7'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:40.071424 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-569160ee-8eb4-481f-8b04-e9ee4715d8d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ab6824641b54a2982b90d49455ae2c7'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:40.220342 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-569160ee-8eb4-481f-8b04-e9ee4715d8d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ab6824641b54a2982b90d49455ae2c7'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:40.223400 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-569160ee-8eb4-481f-8b04-e9ee4715d8d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ab6824641b54a2982b90d49455ae2c7'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:40.245072 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-569160ee-8eb4-481f-8b04-e9ee4715d8d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ab6824641b54a2982b90d49455ae2c7'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:40.325381 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 829/1652] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:34:39 2022] DELETE /identity/v3/users/6ab6824641b54a2982b90d49455ae2c7 => generated 0 bytes in 756 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:34:40.328513 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-f87d08f1-e87a-4a12-98b7-e6b807bc9c09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52c39037fbc847e3b82ed9ec1fa0cca1'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:40.360654 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-f87d08f1-e87a-4a12-98b7-e6b807bc9c09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52c39037fbc847e3b82ed9ec1fa0cca1'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:40.457717 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-f87d08f1-e87a-4a12-98b7-e6b807bc9c09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52c39037fbc847e3b82ed9ec1fa0cca1'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:40.458521 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-f87d08f1-e87a-4a12-98b7-e6b807bc9c09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52c39037fbc847e3b82ed9ec1fa0cca1'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:40.542352 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-f87d08f1-e87a-4a12-98b7-e6b807bc9c09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52c39037fbc847e3b82ed9ec1fa0cca1'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:40.561421 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 824/1653] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:34:39 2022] DELETE /identity/v3/users/52c39037fbc847e3b82ed9ec1fa0cca1 => generated 0 bytes in 998 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:34:42.383503 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569160ee-8eb4-481f-8b04-e9ee4715d8d9 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:42.383503 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-569160ee-8eb4-481f-8b04-e9ee4715d8d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:42.513170 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:34:42.540281 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569160ee-8eb4-481f-8b04-e9ee4715d8d9 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:42.637952 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed842e3-77c8-4457-90d3-911d0909924b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:42.638877 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed842e3-77c8-4457-90d3-911d0909924b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:42.639161 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed842e3-77c8-4457-90d3-911d0909924b admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:42.639438 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed842e3-77c8-4457-90d3-911d0909924b admin admin] PATH_INFO: `/v3/projects/6cd6a0a008ad4558aa0afc3199ae6c37` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:42.643832 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed842e3-77c8-4457-90d3-911d0909924b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cd6a0a008ad4558aa0afc3199ae6c37)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:42.645991 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed842e3-77c8-4457-90d3-911d0909924b admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:42.730252 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621aa1d-f0e1-4ed4-8352-251433c72271 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:42.731023 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621aa1d-f0e1-4ed4-8352-251433c72271 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:42.731593 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621aa1d-f0e1-4ed4-8352-251433c72271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:42.780302 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-8621aa1d-f0e1-4ed4-8352-251433c72271 None None] MFA Rules not processed for user `b2c4f6fbf777401388307bf24396c8e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:42.784798 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-8621aa1d-f0e1-4ed4-8352-251433c72271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:42.874297 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-4ed842e3-77c8-4457-90d3-911d0909924b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cd6a0a008ad4558aa0afc3199ae6c37', 'request_id': 'req-4ed842e3-77c8-4457-90d3-911d0909924b'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:42.984670 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 825/1654] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:42.989472 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621aa1d-f0e1-4ed4-8352-251433c72271 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:43.003767 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-4ed842e3-77c8-4457-90d3-911d0909924b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cd6a0a008ad4558aa0afc3199ae6c37', 'request_id': 'req-4ed842e3-77c8-4457-90d3-911d0909924b'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:43.007870 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-8621aa1d-f0e1-4ed4-8352-251433c72271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:43.008451 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-4ed842e3-77c8-4457-90d3-911d0909924b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cd6a0a008ad4558aa0afc3199ae6c37', 'request_id': 'req-4ed842e3-77c8-4457-90d3-911d0909924b'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:43.057329 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-4ed842e3-77c8-4457-90d3-911d0909924b admin admin] The token cache is being invalidate because project 6cd6a0a008ad4558aa0afc3199ae6c37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:34:43.057994 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-4ed842e3-77c8-4457-90d3-911d0909924b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:43.060473 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-4ed842e3-77c8-4457-90d3-911d0909924b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:43.062538 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 830/1655] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:34:42 2022] DELETE /identity/v3/projects/6cd6a0a008ad4558aa0afc3199ae6c37 => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:34:43.066148 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada762fb-b199-4352-8913-02d369379bb0 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:43.069015 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621aa1d-f0e1-4ed4-8352-251433c72271 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:43.069908 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada762fb-b199-4352-8913-02d369379bb0 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:43.070415 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada762fb-b199-4352-8913-02d369379bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:43.125095 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-ada762fb-b199-4352-8913-02d369379bb0 None None] MFA Rules not processed for user `b2c4f6fbf777401388307bf24396c8e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:43.130046 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-ada762fb-b199-4352-8913-02d369379bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:43.208729 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:34:43.275181 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47f417-2e6b-4e3d-8123-5311774e45b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:43.276351 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47f417-2e6b-4e3d-8123-5311774e45b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:43.303880 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47f417-2e6b-4e3d-8123-5311774e45b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:43.303880 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47f417-2e6b-4e3d-8123-5311774e45b5 admin admin] PATH_INFO: `/v3/projects/4f26538727414b67a765bcef68badfd6` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:43.303880 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa47f417-2e6b-4e3d-8123-5311774e45b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f26538727414b67a765bcef68badfd6)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:43.303880 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa47f417-2e6b-4e3d-8123-5311774e45b5 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:43.340127 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 831/1656] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:43.340127 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97a76d-4bbc-43e8-ba00-1c64ecb3ad2a None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:43.340127 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97a76d-4bbc-43e8-ba00-1c64ecb3ad2a None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:43.340127 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97a76d-4bbc-43e8-ba00-1c64ecb3ad2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:43.387649 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-6b97a76d-4bbc-43e8-ba00-1c64ecb3ad2a None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:43.393316 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-6b97a76d-4bbc-43e8-ba00-1c64ecb3ad2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:43.410088 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 832/1657] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:43.410088 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97a76d-4bbc-43e8-ba00-1c64ecb3ad2a None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:43.410088 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-6b97a76d-4bbc-43e8-ba00-1c64ecb3ad2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:43.505559 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97a76d-4bbc-43e8-ba00-1c64ecb3ad2a None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:43.516594 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8716437-fe99-4601-99aa-cc682171bf5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:43.517264 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8716437-fe99-4601-99aa-cc682171bf5e service nova] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:43.517542 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8716437-fe99-4601-99aa-cc682171bf5e service nova] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:43.517904 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8716437-fe99-4601-99aa-cc682171bf5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:43.519898 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-c8716437-fe99-4601-99aa-cc682171bf5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:43.585168 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8716437-fe99-4601-99aa-cc682171bf5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:43.591551 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8716437-fe99-4601-99aa-cc682171bf5e service nova] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:43.617250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-aa47f417-2e6b-4e3d-8123-5311774e45b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f26538727414b67a765bcef68badfd6', 'request_id': 'req-aa47f417-2e6b-4e3d-8123-5311774e45b5'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:43.632683 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 833/1658] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:34:43 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:34:43.632683 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dda35e-a11e-44bb-b50e-9b8669fe2795 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:43.632683 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dda35e-a11e-44bb-b50e-9b8669fe2795 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:43.632683 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dda35e-a11e-44bb-b50e-9b8669fe2795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:43.705438 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-a6dda35e-a11e-44bb-b50e-9b8669fe2795 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:43.708767 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-a6dda35e-a11e-44bb-b50e-9b8669fe2795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:43.747331 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-aa47f417-2e6b-4e3d-8123-5311774e45b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f26538727414b67a765bcef68badfd6', 'request_id': 'req-aa47f417-2e6b-4e3d-8123-5311774e45b5'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:43.764679 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-aa47f417-2e6b-4e3d-8123-5311774e45b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f26538727414b67a765bcef68badfd6', 'request_id': 'req-aa47f417-2e6b-4e3d-8123-5311774e45b5'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:43.824988 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-aa47f417-2e6b-4e3d-8123-5311774e45b5 admin admin] The token cache is being invalidate because project 4f26538727414b67a765bcef68badfd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:34:43.829197 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-aa47f417-2e6b-4e3d-8123-5311774e45b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:43.830489 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-aa47f417-2e6b-4e3d-8123-5311774e45b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:43.835124 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 826/1659] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:34:42 2022] DELETE /identity/v3/projects/4f26538727414b67a765bcef68badfd6 => generated 0 bytes in 850 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:34:43.846639 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3541a8c-c00a-4e90-a5dd-91599e1d7d3a None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:43.849320 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3541a8c-c00a-4e90-a5dd-91599e1d7d3a None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:43.851347 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3541a8c-c00a-4e90-a5dd-91599e1d7d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:43.895652 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 834/1660] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:43.896899 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dda35e-a11e-44bb-b50e-9b8669fe2795 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:43.916122 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dda35e-a11e-44bb-b50e-9b8669fe2795 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:43.928307 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-a3541a8c-c00a-4e90-a5dd-91599e1d7d3a None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:43.930116 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-a3541a8c-c00a-4e90-a5dd-91599e1d7d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:43.936974 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017cc0d5-8dab-4cc7-b007-ca7d392c3b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:43.937760 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017cc0d5-8dab-4cc7-b007-ca7d392c3b2d admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:43.938046 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017cc0d5-8dab-4cc7-b007-ca7d392c3b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:43.941017 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017cc0d5-8dab-4cc7-b007-ca7d392c3b2d admin admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:43.941822 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017cc0d5-8dab-4cc7-b007-ca7d392c3b2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:34:43.942142 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017cc0d5-8dab-4cc7-b007-ca7d392c3b2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:43.950224 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017cc0d5-8dab-4cc7-b007-ca7d392c3b2d admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:43.972289 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 827/1661] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:43.973983 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd3dfd-6074-478f-88fd-8390866baaa4 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:43.977615 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd3dfd-6074-478f-88fd-8390866baaa4 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:43.979625 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd3dfd-6074-478f-88fd-8390866baaa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:43.995449 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 835/1662] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:34:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:34:43.996493 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017cc0d5-8dab-4cc7-b007-ca7d392c3b2d admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:44.034571 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017cc0d5-8dab-4cc7-b007-ca7d392c3b2d admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:44.072839 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bdb06c-584b-426f-8430-65504c74493f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:44.073569 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bdb06c-584b-426f-8430-65504c74493f admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:44.074397 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bdb06c-584b-426f-8430-65504c74493f admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:44.074721 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bdb06c-584b-426f-8430-65504c74493f admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:44.075576 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bdb06c-584b-426f-8430-65504c74493f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:44.077577 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bdb06c-584b-426f-8430-65504c74493f admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:44.080016 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-65dd3dfd-6074-478f-88fd-8390866baaa4 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:44.084225 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-65dd3dfd-6074-478f-88fd-8390866baaa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:44.122820 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 828/1663] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:44.127323 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dd3dfd-6074-478f-88fd-8390866baaa4 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:44.151616 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dd3dfd-6074-478f-88fd-8390866baaa4 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:44.169882 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25927698-7b25-4489-ab5f-2898385d19ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:44.172413 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25927698-7b25-4489-ab5f-2898385d19ae admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:44.173228 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25927698-7b25-4489-ab5f-2898385d19ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:44.175245 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25927698-7b25-4489-ab5f-2898385d19ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:44.176274 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25927698-7b25-4489-ab5f-2898385d19ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:34:44.178408 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25927698-7b25-4489-ab5f-2898385d19ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:44.191150 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25927698-7b25-4489-ab5f-2898385d19ae admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:44.223525 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 836/1664] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:34:43 2022] POST /identity/v3/projects => generated 377 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:34:44.224730 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bdb06c-584b-426f-8430-65504c74493f admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:44.232243 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 829/1665] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:34:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:34:44.237201 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25927698-7b25-4489-ab5f-2898385d19ae admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:44.269294 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25927698-7b25-4489-ab5f-2898385d19ae admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:44.335476 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:34:44.454615 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d957c4a-5896-4ae3-aad8-c68378bf5289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:44.455331 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d957c4a-5896-4ae3-aad8-c68378bf5289 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:44.455644 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d957c4a-5896-4ae3-aad8-c68378bf5289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:44.455923 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d957c4a-5896-4ae3-aad8-c68378bf5289 admin admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:44.456666 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d957c4a-5896-4ae3-aad8-c68378bf5289 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:44.461599 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d957c4a-5896-4ae3-aad8-c68378bf5289 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:44.470377 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bdb06c-584b-426f-8430-65504c74493f admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:44.493104 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc921e-0671-439c-9662-ebbdb0f27cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:44.493104 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc921e-0671-439c-9662-ebbdb0f27cec admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:44.493104 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc921e-0671-439c-9662-ebbdb0f27cec admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:44.503578 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc921e-0671-439c-9662-ebbdb0f27cec admin admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:44.504508 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc921e-0671-439c-9662-ebbdb0f27cec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:44.506489 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc921e-0671-439c-9662-ebbdb0f27cec admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:44.640738 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 830/1666] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:34:44 2022] POST /identity/v3/projects => generated 369 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:34:44.646593 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d957c4a-5896-4ae3-aad8-c68378bf5289 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:44.663218 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 837/1667] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:34:44 2022] POST /identity/v3/users => generated 289 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:34:44.668108 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc921e-0671-439c-9662-ebbdb0f27cec admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:44.703241 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc921e-0671-439c-9662-ebbdb0f27cec admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:44.813111 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:34:44.839027 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c266c4-a4cb-4dcf-a834-d3714362b8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:44.840309 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c266c4-a4cb-4dcf-a834-d3714362b8e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:44.840595 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c266c4-a4cb-4dcf-a834-d3714362b8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:44.840869 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c266c4-a4cb-4dcf-a834-d3714362b8e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:44.841605 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c266c4-a4cb-4dcf-a834-d3714362b8e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:44.843218 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c266c4-a4cb-4dcf-a834-d3714362b8e4 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:44.895173 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 838/1668] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:34:44.898205 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c266c4-a4cb-4dcf-a834-d3714362b8e4 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:44.898942 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d957c4a-5896-4ae3-aad8-c68378bf5289 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:44.902673 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-85c266c4-a4cb-4dcf-a834-d3714362b8e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:44.912922 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c597e2c-9582-41c9-87da-ebab113f7a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:44.916662 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c597e2c-9582-41c9-87da-ebab113f7a3c admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:44.918891 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c597e2c-9582-41c9-87da-ebab113f7a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:44.919261 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c597e2c-9582-41c9-87da-ebab113f7a3c admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:44.921750 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c597e2c-9582-41c9-87da-ebab113f7a3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:44.927129 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c597e2c-9582-41c9-87da-ebab113f7a3c admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:44.950922 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c266c4-a4cb-4dcf-a834-d3714362b8e4 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:44.968699 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461de4d5-83a7-4ffc-ad98-6a471e16d68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:44.971867 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461de4d5-83a7-4ffc-ad98-6a471e16d68c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:44.972397 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461de4d5-83a7-4ffc-ad98-6a471e16d68c admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:44.972823 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461de4d5-83a7-4ffc-ad98-6a471e16d68c admin admin] PATH_INFO: `/v3/users/553bf9fe59074554a4642339b1b2a800` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:44.977387 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461de4d5-83a7-4ffc-ad98-6a471e16d68c admin admin] RBAC: Authorizing `identity:delete_user(user_id=553bf9fe59074554a4642339b1b2a800)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:44.979593 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461de4d5-83a7-4ffc-ad98-6a471e16d68c admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:45.071567 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 831/1669] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:34:44 2022] POST /identity/v3/users => generated 285 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:34:45.072828 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c597e2c-9582-41c9-87da-ebab113f7a3c admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:45.111423 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c597e2c-9582-41c9-87da-ebab113f7a3c admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:45.140186 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017e727-558d-4878-8228-3051eb21560c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:45.141611 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017e727-558d-4878-8228-3051eb21560c admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:45.142279 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017e727-558d-4878-8228-3051eb21560c admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:45.143072 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017e727-558d-4878-8228-3051eb21560c admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:45.145696 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9017e727-558d-4878-8228-3051eb21560c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:45.150023 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9017e727-558d-4878-8228-3051eb21560c admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:45.183611 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 832/1670] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:34:45.188621 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017e727-558d-4878-8228-3051eb21560c admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:45.245434 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017e727-558d-4878-8228-3051eb21560c admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:45.265068 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53357a1a-5769-41fe-b234-37470e29476a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:45.265552 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-461de4d5-83a7-4ffc-ad98-6a471e16d68c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '553bf9fe59074554a4642339b1b2a800'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:45.265747 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53357a1a-5769-41fe-b234-37470e29476a admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:45.266259 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-461de4d5-83a7-4ffc-ad98-6a471e16d68c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '553bf9fe59074554a4642339b1b2a800'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:45.266885 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53357a1a-5769-41fe-b234-37470e29476a admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:45.267167 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53357a1a-5769-41fe-b234-37470e29476a admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:45.267908 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53357a1a-5769-41fe-b234-37470e29476a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:45.271654 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53357a1a-5769-41fe-b234-37470e29476a admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:45.302722 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 833/1671] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:34:45.302722 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d190ce0-9b83-4eb3-92fa-15d289456d3f None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:45.302722 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d190ce0-9b83-4eb3-92fa-15d289456d3f None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:45.304548 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d190ce0-9b83-4eb3-92fa-15d289456d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:45.349467 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-4d190ce0-9b83-4eb3-92fa-15d289456d3f None None] MFA Rules not processed for user `d67234e9868b4d34a1532b1aedf33221`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:45.351137 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-4d190ce0-9b83-4eb3-92fa-15d289456d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:45.354093 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-461de4d5-83a7-4ffc-ad98-6a471e16d68c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '553bf9fe59074554a4642339b1b2a800'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:45.354744 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-461de4d5-83a7-4ffc-ad98-6a471e16d68c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '553bf9fe59074554a4642339b1b2a800'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:45.363640 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-461de4d5-83a7-4ffc-ad98-6a471e16d68c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '553bf9fe59074554a4642339b1b2a800'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:45.403459 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 839/1672] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:34:44 2022] DELETE /identity/v3/users/553bf9fe59074554a4642339b1b2a800 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:34:45.405576 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416b141-042e-42d0-acd5-0404f883d2cd None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:45.410284 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416b141-042e-42d0-acd5-0404f883d2cd None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:45.410786 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416b141-042e-42d0-acd5-0404f883d2cd None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:45.412532 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 840/1673] 10.222.0.62 () {54 vars in 912 bytes} [Mon Jun 27 09:34:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:34:45.413725 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416b141-042e-42d0-acd5-0404f883d2cd None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:45.422152 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-4416b141-042e-42d0-acd5-0404f883d2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:45.480886 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 834/1674] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:45.481908 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d190ce0-9b83-4eb3-92fa-15d289456d3f None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:45.484558 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-4d190ce0-9b83-4eb3-92fa-15d289456d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:45.521737 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d190ce0-9b83-4eb3-92fa-15d289456d3f None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:45.526718 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143edc53-4484-44d6-bc5b-58b2f3b7958b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:45.528120 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143edc53-4484-44d6-bc5b-58b2f3b7958b admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:45.528439 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143edc53-4484-44d6-bc5b-58b2f3b7958b admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:45.528719 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143edc53-4484-44d6-bc5b-58b2f3b7958b admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:45.529466 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143edc53-4484-44d6-bc5b-58b2f3b7958b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:45.531156 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143edc53-4484-44d6-bc5b-58b2f3b7958b admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:45.543060 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 835/1675] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:34:45.547499 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba568f1a-6c4b-4403-bd40-28d0a2d5dc31 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:45.547499 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba568f1a-6c4b-4403-bd40-28d0a2d5dc31 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:45.547499 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba568f1a-6c4b-4403-bd40-28d0a2d5dc31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:45.548008 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416b141-042e-42d0-acd5-0404f883d2cd None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:45.558188 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93943cec-9ede-44b5-8c46-7f9e090940a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:45.560501 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93943cec-9ede-44b5-8c46-7f9e090940a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:45.560962 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93943cec-9ede-44b5-8c46-7f9e090940a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:45.561567 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93943cec-9ede-44b5-8c46-7f9e090940a6 admin admin] PATH_INFO: `/v3/projects/670abd28891b4e398972bcac9bcabb78/users/5424ad4111f24708868e52063b8f4a6b/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:45.565776 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-ba568f1a-6c4b-4403-bd40-28d0a2d5dc31 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:45.567930 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-ba568f1a-6c4b-4403-bd40-28d0a2d5dc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:45.584008 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 836/1676] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:45.594698 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93943cec-9ede-44b5-8c46-7f9e090940a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=670abd28891b4e398972bcac9bcabb78, user_id=5424ad4111f24708868e52063b8f4a6b, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:45.595354 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31bdfbb-47b9-4cc4-96fb-290b8e3fcc1b None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:45.595824 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31bdfbb-47b9-4cc4-96fb-290b8e3fcc1b None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:45.596305 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31bdfbb-47b9-4cc4-96fb-290b8e3fcc1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:45.598236 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93943cec-9ede-44b5-8c46-7f9e090940a6 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:45.670721 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-d31bdfbb-47b9-4cc4-96fb-290b8e3fcc1b None None] MFA Rules not processed for user `097b991d67164cda94cc5aa24397f414`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:45.671975 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-d31bdfbb-47b9-4cc4-96fb-290b8e3fcc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:45.722490 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 841/1677] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:34:45 2022] PUT /identity/v3/projects/670abd28891b4e398972bcac9bcabb78/users/5424ad4111f24708868e52063b8f4a6b/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:34:45.723549 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93943cec-9ede-44b5-8c46-7f9e090940a6 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:45.731883 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-93943cec-9ede-44b5-8c46-7f9e090940a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:45.775393 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 837/1678] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Jun 27 09:34:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:45.777820 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31bdfbb-47b9-4cc4-96fb-290b8e3fcc1b None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:45.800166 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31bdfbb-47b9-4cc4-96fb-290b8e3fcc1b None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:45.910143 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93943cec-9ede-44b5-8c46-7f9e090940a6 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:45.916600 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c194012-da9b-4b68-a462-4546487e679c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:45.917692 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c194012-da9b-4b68-a462-4546487e679c admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:45.918077 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c194012-da9b-4b68-a462-4546487e679c admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:45.918486 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c194012-da9b-4b68-a462-4546487e679c admin admin] PATH_INFO: `/v3/projects/d673b7d1878a458ebbb964d637e2f4c3/users/df5054f21f1645eeae0be0c97bfeec30/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:45.923743 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf468113-7f5e-454b-afe3-bff223714316 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:45.930235 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf468113-7f5e-454b-afe3-bff223714316 service nova] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:45.930235 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf468113-7f5e-454b-afe3-bff223714316 service nova] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:45.930235 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf468113-7f5e-454b-afe3-bff223714316 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:45.940297 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c194012-da9b-4b68-a462-4546487e679c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d673b7d1878a458ebbb964d637e2f4c3, user_id=df5054f21f1645eeae0be0c97bfeec30, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:45.943619 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c194012-da9b-4b68-a462-4546487e679c admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:46.021117 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 838/1679] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:34:45 2022] PUT /identity/v3/projects/d673b7d1878a458ebbb964d637e2f4c3/users/df5054f21f1645eeae0be0c97bfeec30/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:34:46.022238 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c194012-da9b-4b68-a462-4546487e679c admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:46.026616 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-3c194012-da9b-4b68-a462-4546487e679c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:46.029200 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf468113-7f5e-454b-afe3-bff223714316 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:46.036409 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf468113-7f5e-454b-afe3-bff223714316 service nova] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:46.051538 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 842/1680] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:34:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:34:46.056605 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a87a50-bb5d-4ebe-bc57-d4108771155d None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:46.058045 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a87a50-bb5d-4ebe-bc57-d4108771155d None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:46.059538 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a87a50-bb5d-4ebe-bc57-d4108771155d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:46.131906 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-d1a87a50-bb5d-4ebe-bc57-d4108771155d None None] MFA Rules not processed for user `5424ad4111f24708868e52063b8f4a6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:46.136970 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-d1a87a50-bb5d-4ebe-bc57-d4108771155d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:46.197974 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c194012-da9b-4b68-a462-4546487e679c admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:46.209240 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897fa32-8345-4e23-a510-10e57dcefab6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:46.210180 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897fa32-8345-4e23-a510-10e57dcefab6 service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:46.210631 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897fa32-8345-4e23-a510-10e57dcefab6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:46.211069 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897fa32-8345-4e23-a510-10e57dcefab6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:46.347677 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 843/1681] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:46.347677 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a87a50-bb5d-4ebe-bc57-d4108771155d None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:46.364898 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9897fa32-8345-4e23-a510-10e57dcefab6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:46.366373 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9897fa32-8345-4e23-a510-10e57dcefab6 service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:46.369426 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a87a50-bb5d-4ebe-bc57-d4108771155d None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:46.381749 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c995a4-ff77-4595-87f7-b990697d5bda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:46.381749 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c995a4-ff77-4595-87f7-b990697d5bda service neutron] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:46.381749 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c995a4-ff77-4595-87f7-b990697d5bda service neutron] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:46.381749 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c995a4-ff77-4595-87f7-b990697d5bda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:46.400448 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c995a4-ff77-4595-87f7-b990697d5bda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:46.405205 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c995a4-ff77-4595-87f7-b990697d5bda service neutron] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:46.424162 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 844/1682] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:34:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:34:46.424689 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 839/1683] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:34:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:34:46.425682 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897fa32-8345-4e23-a510-10e57dcefab6 service neutron] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:46.425796 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dccdeb-ed9c-4a7a-82f0-f98958697274 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:46.426002 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dccdeb-ed9c-4a7a-82f0-f98958697274 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:46.429026 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:34:46.433972 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dccdeb-ed9c-4a7a-82f0-f98958697274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:46.466757 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897fa32-8345-4e23-a510-10e57dcefab6 service neutron] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:46.493130 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0d623-8085-4961-aeae-ae03ff5c92e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:46.493886 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0d623-8085-4961-aeae-ae03ff5c92e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:46.494173 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0d623-8085-4961-aeae-ae03ff5c92e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:46.494455 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0d623-8085-4961-aeae-ae03ff5c92e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:46.495219 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a0d623-8085-4961-aeae-ae03ff5c92e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:46.497983 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a0d623-8085-4961-aeae-ae03ff5c92e6 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:46.515529 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-e0dccdeb-ed9c-4a7a-82f0-f98958697274 None None] MFA Rules not processed for user `df5054f21f1645eeae0be0c97bfeec30`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:46.519172 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-e0dccdeb-ed9c-4a7a-82f0-f98958697274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:46.642857 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 840/1684] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:34:46 2022] POST /identity/v3/projects => generated 377 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:34:46.643805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0d623-8085-4961-aeae-ae03ff5c92e6 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:46.775983 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 845/1685] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:46 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:46.782621 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dccdeb-ed9c-4a7a-82f0-f98958697274 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:46.826693 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0d623-8085-4961-aeae-ae03ff5c92e6 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:46.826911 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dccdeb-ed9c-4a7a-82f0-f98958697274 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:46.838002 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff208ac-af97-4589-bac2-d36593b0a0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:46.840280 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff208ac-af97-4589-bac2-d36593b0a0ec admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:46.846576 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff208ac-af97-4589-bac2-d36593b0a0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:46.846576 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff208ac-af97-4589-bac2-d36593b0a0ec admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:46.846576 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff208ac-af97-4589-bac2-d36593b0a0ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:46.846576 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff208ac-af97-4589-bac2-d36593b0a0ec admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:46.846959 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e41592-6768-4242-88ba-e4fab3b263d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:46.847410 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e41592-6768-4242-88ba-e4fab3b263d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:46.847844 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e41592-6768-4242-88ba-e4fab3b263d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:46.848297 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e41592-6768-4242-88ba-e4fab3b263d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:46.849171 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e41592-6768-4242-88ba-e4fab3b263d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:46.861252 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e41592-6768-4242-88ba-e4fab3b263d8 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:46.956567 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 841/1686] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:34:46 2022] POST /identity/v3/users => generated 295 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:34:46.960569 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff208ac-af97-4589-bac2-d36593b0a0ec admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:46.979510 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:34:46.986817 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff208ac-af97-4589-bac2-d36593b0a0ec admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:46.993776 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5961dac-b5d1-4fa6-894f-b7a94dd1739e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:46.994469 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5961dac-b5d1-4fa6-894f-b7a94dd1739e admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:46.994756 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5961dac-b5d1-4fa6-894f-b7a94dd1739e admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:46.995039 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5961dac-b5d1-4fa6-894f-b7a94dd1739e admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:46.995898 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5961dac-b5d1-4fa6-894f-b7a94dd1739e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:47.000387 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5961dac-b5d1-4fa6-894f-b7a94dd1739e admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:47.037926 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 842/1687] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:34:47.044210 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5961dac-b5d1-4fa6-894f-b7a94dd1739e admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:47.046565 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 846/1688] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:34:46 2022] POST /identity/v3/projects => generated 369 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:34:47.050850 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e41592-6768-4242-88ba-e4fab3b263d8 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:47.078271 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5961dac-b5d1-4fa6-894f-b7a94dd1739e admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:47.231842 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e41592-6768-4242-88ba-e4fab3b263d8 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:47.235955 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a7e58-3280-499f-9321-67454a6f6ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:47.237746 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a7e58-3280-499f-9321-67454a6f6ad1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:47.238760 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a7e58-3280-499f-9321-67454a6f6ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:47.238760 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a7e58-3280-499f-9321-67454a6f6ad1 admin admin] PATH_INFO: `/v3/projects/f586faaa25bb4ca3a6f8dd404ae37aa2/users/f24b1ddf56554100beb36f2d3a5d3d81/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:47.255462 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd36f02-8681-4a1d-ad2a-35c0a428d534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:47.258582 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd36f02-8681-4a1d-ad2a-35c0a428d534 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:47.258582 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd36f02-8681-4a1d-ad2a-35c0a428d534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:47.258817 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd36f02-8681-4a1d-ad2a-35c0a428d534 admin admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:47.263791 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd36f02-8681-4a1d-ad2a-35c0a428d534 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:47.270002 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd36f02-8681-4a1d-ad2a-35c0a428d534 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:47.278252 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4a7e58-3280-499f-9321-67454a6f6ad1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f586faaa25bb4ca3a6f8dd404ae37aa2, user_id=f24b1ddf56554100beb36f2d3a5d3d81, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:47.287090 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4a7e58-3280-499f-9321-67454a6f6ad1 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:47.377303 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 843/1689] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:34:47 2022] PUT /identity/v3/projects/f586faaa25bb4ca3a6f8dd404ae37aa2/users/f24b1ddf56554100beb36f2d3a5d3d81/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:34:47.381256 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a7e58-3280-499f-9321-67454a6f6ad1 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:47.454504 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 847/1690] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:34:47 2022] POST /identity/v3/users => generated 291 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 09:34:47.458805 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd36f02-8681-4a1d-ad2a-35c0a428d534 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:47.508483 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd36f02-8681-4a1d-ad2a-35c0a428d534 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:47.602811 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a7e58-3280-499f-9321-67454a6f6ad1 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:47.619838 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fb3c57-6948-4c9d-ad3b-e20fd3495e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:47.623849 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fb3c57-6948-4c9d-ad3b-e20fd3495e5f admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:47.623849 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fb3c57-6948-4c9d-ad3b-e20fd3495e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:47.623849 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fb3c57-6948-4c9d-ad3b-e20fd3495e5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:47.624450 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fb3c57-6948-4c9d-ad3b-e20fd3495e5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:47.626890 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fb3c57-6948-4c9d-ad3b-e20fd3495e5f admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:47.657662 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 844/1691] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:34:47.661833 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fb3c57-6948-4c9d-ad3b-e20fd3495e5f admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:47.663799 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e0bbe7-0649-45bf-ba2b-513e1e520382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:47.665482 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0bbe7-0649-45bf-ba2b-513e1e520382 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:47.666474 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0bbe7-0649-45bf-ba2b-513e1e520382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:47.668653 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0bbe7-0649-45bf-ba2b-513e1e520382 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:47.670562 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e0bbe7-0649-45bf-ba2b-513e1e520382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:47.673531 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e0bbe7-0649-45bf-ba2b-513e1e520382 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:47.686987 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fb3c57-6948-4c9d-ad3b-e20fd3495e5f admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:47.706161 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00391fb-b5a2-45a4-a055-89765e0dedbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:47.706852 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00391fb-b5a2-45a4-a055-89765e0dedbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:47.707132 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00391fb-b5a2-45a4-a055-89765e0dedbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:47.707407 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00391fb-b5a2-45a4-a055-89765e0dedbf admin admin] PATH_INFO: `/v3/projects/f586faaa25bb4ca3a6f8dd404ae37aa2/users/f24b1ddf56554100beb36f2d3a5d3d81/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:47.714522 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00391fb-b5a2-45a4-a055-89765e0dedbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f586faaa25bb4ca3a6f8dd404ae37aa2, user_id=f24b1ddf56554100beb36f2d3a5d3d81, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:47.717264 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00391fb-b5a2-45a4-a055-89765e0dedbf admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:47.719876 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 848/1692] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:34:47.724700 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9aca49-5858-410c-ad51-b05d0b23f863 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:47.725000 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9aca49-5858-410c-ad51-b05d0b23f863 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:47.725284 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9aca49-5858-410c-ad51-b05d0b23f863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:47.755221 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 845/1693] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:34:47 2022] PUT /identity/v3/projects/f586faaa25bb4ca3a6f8dd404ae37aa2/users/f24b1ddf56554100beb36f2d3a5d3d81/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:34:47.756063 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00391fb-b5a2-45a4-a055-89765e0dedbf admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:47.799620 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-1c9aca49-5858-410c-ad51-b05d0b23f863 None None] MFA Rules not processed for user `4c30a14c11d24ff3bd270c8e865a55d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:47.802453 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-1c9aca49-5858-410c-ad51-b05d0b23f863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:47.906694 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:34:47.922480 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00391fb-b5a2-45a4-a055-89765e0dedbf admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:47.935416 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99067bca-2359-487a-a16c-e8a500bdb2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:47.936676 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99067bca-2359-487a-a16c-e8a500bdb2e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:47.937057 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99067bca-2359-487a-a16c-e8a500bdb2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:47.937431 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99067bca-2359-487a-a16c-e8a500bdb2e1 admin admin] PATH_INFO: `/v3/projects/cb98f414bd1545808f064ff3be44e50b/users/3fe6460f24ab4eb9a818ec5090fcfdac/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:47.970575 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99067bca-2359-487a-a16c-e8a500bdb2e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb98f414bd1545808f064ff3be44e50b, user_id=3fe6460f24ab4eb9a818ec5090fcfdac, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:47.976152 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99067bca-2359-487a-a16c-e8a500bdb2e1 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:48.092715 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 849/1694] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:48.094515 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad6339-94ea-49d3-ad19-25ba7f80c7bc None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:48.095541 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad6339-94ea-49d3-ad19-25ba7f80c7bc None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:48.096082 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad6339-94ea-49d3-ad19-25ba7f80c7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:48.142189 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 846/1695] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:34:47 2022] PUT /identity/v3/projects/cb98f414bd1545808f064ff3be44e50b/users/3fe6460f24ab4eb9a818ec5090fcfdac/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:34:48.146805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99067bca-2359-487a-a16c-e8a500bdb2e1 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:48.152659 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-99067bca-2359-487a-a16c-e8a500bdb2e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:48.271281 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-c7ad6339-94ea-49d3-ad19-25ba7f80c7bc None None] MFA Rules not processed for user `f24b1ddf56554100beb36f2d3a5d3d81`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:48.275825 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-c7ad6339-94ea-49d3-ad19-25ba7f80c7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:48.296489 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:34:48.536836 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 850/1696] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:48 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:48.536836 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad6339-94ea-49d3-ad19-25ba7f80c7bc None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:48.537697 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99067bca-2359-487a-a16c-e8a500bdb2e1 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:48.537697 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e959f-e145-4a1d-9e4f-c3e8e1abc4b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:48.538552 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e959f-e145-4a1d-9e4f-c3e8e1abc4b5 service nova] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:48.539035 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e959f-e145-4a1d-9e4f-c3e8e1abc4b5 service nova] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:48.539459 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e959f-e145-4a1d-9e4f-c3e8e1abc4b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:48.634158 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad6339-94ea-49d3-ad19-25ba7f80c7bc None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:48.644109 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1491f648-2d85-4590-9ebf-8e4b079f9799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:48.644853 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491f648-2d85-4590-9ebf-8e4b079f9799 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:48.645137 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491f648-2d85-4590-9ebf-8e4b079f9799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:48.645414 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491f648-2d85-4590-9ebf-8e4b079f9799 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:48.646164 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1491f648-2d85-4590-9ebf-8e4b079f9799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:48.648959 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1491f648-2d85-4590-9ebf-8e4b079f9799 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:48.671378 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 851/1697] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:34:48.675054 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69853d5-e0f6-4c5f-a335-52a6b7cbf979 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:48.675348 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69853d5-e0f6-4c5f-a335-52a6b7cbf979 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:48.675625 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69853d5-e0f6-4c5f-a335-52a6b7cbf979 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:48.684880 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 852/1698] 10.222.0.62 () {54 vars in 960 bytes} [Mon Jun 27 09:34:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:34:48.684880 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69853d5-e0f6-4c5f-a335-52a6b7cbf979 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:48.685199 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e959f-e145-4a1d-9e4f-c3e8e1abc4b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:48.685804 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-c69853d5-e0f6-4c5f-a335-52a6b7cbf979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:48.688704 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e959f-e145-4a1d-9e4f-c3e8e1abc4b5 service nova] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:48.719279 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 847/1699] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:34:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:34:48.719279 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e959f-e145-4a1d-9e4f-c3e8e1abc4b5 service nova] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:48.723182 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-df4e959f-e145-4a1d-9e4f-c3e8e1abc4b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:48.726492 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69853d5-e0f6-4c5f-a335-52a6b7cbf979 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:48.739114 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0581b12f-1842-4f34-bdc2-a7f4730e21a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:48.739668 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581b12f-1842-4f34-bdc2-a7f4730e21a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:48.739952 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581b12f-1842-4f34-bdc2-a7f4730e21a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:48.740252 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581b12f-1842-4f34-bdc2-a7f4730e21a0 admin admin] PATH_INFO: `/v3/projects/59c030259a0345bb997a4fb0ad0f7728` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:48.743283 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0581b12f-1842-4f34-bdc2-a7f4730e21a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59c030259a0345bb997a4fb0ad0f7728)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:48.745798 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0581b12f-1842-4f34-bdc2-a7f4730e21a0 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:48.858114 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e959f-e145-4a1d-9e4f-c3e8e1abc4b5 service nova] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:48.869517 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa17246-0aa0-472c-bfeb-5e1ece45513a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:48.870546 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa17246-0aa0-472c-bfeb-5e1ece45513a service cinder] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:48.872064 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa17246-0aa0-472c-bfeb-5e1ece45513a service cinder] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:48.873296 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa17246-0aa0-472c-bfeb-5e1ece45513a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:48.951067 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-0581b12f-1842-4f34-bdc2-a7f4730e21a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59c030259a0345bb997a4fb0ad0f7728', 'request_id': 'req-0581b12f-1842-4f34-bdc2-a7f4730e21a0'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:48.973510 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa17246-0aa0-472c-bfeb-5e1ece45513a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:48.975523 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa17246-0aa0-472c-bfeb-5e1ece45513a service cinder] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:48.987178 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 848/1700] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:34:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:34:48.988169 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa17246-0aa0-472c-bfeb-5e1ece45513a service cinder] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:49.001603 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa17246-0aa0-472c-bfeb-5e1ece45513a service cinder] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:49.022728 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-0581b12f-1842-4f34-bdc2-a7f4730e21a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59c030259a0345bb997a4fb0ad0f7728', 'request_id': 'req-0581b12f-1842-4f34-bdc2-a7f4730e21a0'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:49.032442 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-0581b12f-1842-4f34-bdc2-a7f4730e21a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59c030259a0345bb997a4fb0ad0f7728', 'request_id': 'req-0581b12f-1842-4f34-bdc2-a7f4730e21a0'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:49.062437 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-0581b12f-1842-4f34-bdc2-a7f4730e21a0 admin admin] The token cache is being invalidate because project 59c030259a0345bb997a4fb0ad0f7728 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:34:49.062437 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-0581b12f-1842-4f34-bdc2-a7f4730e21a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:49.062984 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-0581b12f-1842-4f34-bdc2-a7f4730e21a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:49.066493 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 853/1701] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:34:48 2022] DELETE /identity/v3/projects/59c030259a0345bb997a4fb0ad0f7728 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:34:49.070894 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5223ba-ebe2-44b0-ace2-19b2c6dd083d None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:49.071178 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5223ba-ebe2-44b0-ace2-19b2c6dd083d None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:49.071459 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5223ba-ebe2-44b0-ace2-19b2c6dd083d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:49.123173 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-0f5223ba-ebe2-44b0-ace2-19b2c6dd083d None None] MFA Rules not processed for user `2bbaf738138b40b2a06bb63934f6608c`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:49.126337 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-0f5223ba-ebe2-44b0-ace2-19b2c6dd083d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:49.153490 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19062e7e-934c-46a4-b32b-c72f9523e2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:49.154038 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19062e7e-934c-46a4-b32b-c72f9523e2d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:49.154322 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19062e7e-934c-46a4-b32b-c72f9523e2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:49.154598 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19062e7e-934c-46a4-b32b-c72f9523e2d2 admin admin] PATH_INFO: `/v3/projects/cb98f414bd1545808f064ff3be44e50b/users/3fe6460f24ab4eb9a818ec5090fcfdac/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:49.161973 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19062e7e-934c-46a4-b32b-c72f9523e2d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb98f414bd1545808f064ff3be44e50b, user_id=3fe6460f24ab4eb9a818ec5090fcfdac, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:49.170063 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19062e7e-934c-46a4-b32b-c72f9523e2d2 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:49.183110 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 849/1702] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:34:48 2022] PUT /identity/v3/projects/cb98f414bd1545808f064ff3be44e50b/users/3fe6460f24ab4eb9a818ec5090fcfdac/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:34:49.184473 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d60c6a-178c-40ac-ba42-e00305f42c37 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:49.184591 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d60c6a-178c-40ac-ba42-e00305f42c37 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:49.184847 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d60c6a-178c-40ac-ba42-e00305f42c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:49.251404 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-c8d60c6a-178c-40ac-ba42-e00305f42c37 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:49.252799 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-c8d60c6a-178c-40ac-ba42-e00305f42c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:49.274057 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 854/1703] 10.222.0.62 () {58 vars in 1057 bytes} [Mon Jun 27 09:34:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:49.276147 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a052c0-87ca-41b8-b00b-08a9343f68e8 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:49.276147 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a052c0-87ca-41b8-b00b-08a9343f68e8 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:49.276412 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a052c0-87ca-41b8-b00b-08a9343f68e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:49.348534 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 850/1704] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:49.348534 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d60c6a-178c-40ac-ba42-e00305f42c37 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:49.348927 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-50a052c0-87ca-41b8-b00b-08a9343f68e8 None None] MFA Rules not processed for user `3fe6460f24ab4eb9a818ec5090fcfdac`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:49.348927 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-50a052c0-87ca-41b8-b00b-08a9343f68e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:49.533369 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d60c6a-178c-40ac-ba42-e00305f42c37 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:49.540282 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 855/1705] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:49 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:49.541742 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b6c55-0261-4c6e-b350-ca6eafdb1f1f None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:49.542137 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b6c55-0261-4c6e-b350-ca6eafdb1f1f None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:49.542556 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b6c55-0261-4c6e-b350-ca6eafdb1f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:49.550691 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985bd2f5-413b-4346-8d0b-3f76749fe004 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbaf738138b40b2a06bb63934f6608c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:49.550691 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bd2f5-413b-4346-8d0b-3f76749fe004 service placement] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:49.550691 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bd2f5-413b-4346-8d0b-3f76749fe004 service placement] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:49.550691 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bd2f5-413b-4346-8d0b-3f76749fe004 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:49.551496 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-985bd2f5-413b-4346-8d0b-3f76749fe004 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:49.579205 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985bd2f5-413b-4346-8d0b-3f76749fe004 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:49.582387 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985bd2f5-413b-4346-8d0b-3f76749fe004 service placement] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:49.591478 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-c55b6c55-0261-4c6e-b350-ca6eafdb1f1f None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:49.593204 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-c55b6c55-0261-4c6e-b350-ca6eafdb1f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:49.608617 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 851/1706] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:34:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:34:49.610707 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985bd2f5-413b-4346-8d0b-3f76749fe004 service placement] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:49.612279 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 856/1707] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:49.616994 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b6c55-0261-4c6e-b350-ca6eafdb1f1f None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:49.617962 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-985bd2f5-413b-4346-8d0b-3f76749fe004 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:49.634969 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b6c55-0261-4c6e-b350-ca6eafdb1f1f None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:49.657559 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98990d7-a1a6-4be6-8482-7e61f2b8ae83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:49.657559 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98990d7-a1a6-4be6-8482-7e61f2b8ae83 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:49.657559 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98990d7-a1a6-4be6-8482-7e61f2b8ae83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:49.666218 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98990d7-a1a6-4be6-8482-7e61f2b8ae83 admin admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:49.666218 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98990d7-a1a6-4be6-8482-7e61f2b8ae83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:34:49.666218 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98990d7-a1a6-4be6-8482-7e61f2b8ae83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:49.671518 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98990d7-a1a6-4be6-8482-7e61f2b8ae83 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:49.709860 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 857/1708] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:34:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:34:49.712748 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98990d7-a1a6-4be6-8482-7e61f2b8ae83 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:49.755256 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98990d7-a1a6-4be6-8482-7e61f2b8ae83 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:49.768134 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37131fd9-4c52-4112-ac25-d2cd2df0decc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:49.768748 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37131fd9-4c52-4112-ac25-d2cd2df0decc admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:49.771532 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37131fd9-4c52-4112-ac25-d2cd2df0decc admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:49.772078 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37131fd9-4c52-4112-ac25-d2cd2df0decc admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:49.772959 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37131fd9-4c52-4112-ac25-d2cd2df0decc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:49.782025 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37131fd9-4c52-4112-ac25-d2cd2df0decc admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:49.789326 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985bd2f5-413b-4346-8d0b-3f76749fe004 service placement] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:49.806467 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce381c4d-31b2-4959-ab08-de90c82e3f85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:49.807488 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce381c4d-31b2-4959-ab08-de90c82e3f85 service cinder] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:49.807926 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce381c4d-31b2-4959-ab08-de90c82e3f85 service cinder] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:49.808864 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce381c4d-31b2-4959-ab08-de90c82e3f85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:49.827181 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce381c4d-31b2-4959-ab08-de90c82e3f85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:49.829146 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce381c4d-31b2-4959-ab08-de90c82e3f85 service cinder] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:49.864917 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 852/1709] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:34:49 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:34:49.976537 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 858/1710] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:34:49 2022] POST /identity/v3/projects => generated 373 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:34:49.978668 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce381c4d-31b2-4959-ab08-de90c82e3f85 service cinder] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:49.992116 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:34:50.003841 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce381c4d-31b2-4959-ab08-de90c82e3f85 service cinder] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:50.073101 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37131fd9-4c52-4112-ac25-d2cd2df0decc admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:50.075218 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-37131fd9-4c52-4112-ac25-d2cd2df0decc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:50.180152 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da88587-d930-473b-9a7d-04718aec05e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:50.180896 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da88587-d930-473b-9a7d-04718aec05e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:50.181186 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da88587-d930-473b-9a7d-04718aec05e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:50.181458 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da88587-d930-473b-9a7d-04718aec05e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:50.182500 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da88587-d930-473b-9a7d-04718aec05e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:50.184838 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da88587-d930-473b-9a7d-04718aec05e4 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:50.280729 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37131fd9-4c52-4112-ac25-d2cd2df0decc admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:50.290539 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8fc56-1355-473b-9518-0fe89a409a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:50.292237 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8fc56-1355-473b-9518-0fe89a409a62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:50.298274 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8fc56-1355-473b-9518-0fe89a409a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:50.298274 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8fc56-1355-473b-9518-0fe89a409a62 admin admin] PATH_INFO: `/v3/users/a76dd39b4a8c4deea3fa8a61debd8d24` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:50.298274 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c8fc56-1355-473b-9518-0fe89a409a62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a76dd39b4a8c4deea3fa8a61debd8d24)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:50.299660 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c8fc56-1355-473b-9518-0fe89a409a62 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:50.335300 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 853/1711] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:34:49 2022] POST /identity/v3/users => generated 287 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:34:50.336550 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da88587-d930-473b-9a7d-04718aec05e4 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:50.357908 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:34:50.531519 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da88587-d930-473b-9a7d-04718aec05e4 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:50.537090 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed29a06-6d61-4f91-b91b-068e92e9efae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:50.538110 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed29a06-6d61-4f91-b91b-068e92e9efae service cinder] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:50.538811 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed29a06-6d61-4f91-b91b-068e92e9efae service cinder] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:50.539435 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed29a06-6d61-4f91-b91b-068e92e9efae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:50.541797 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-7ed29a06-6d61-4f91-b91b-068e92e9efae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:50.553803 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-f1c8fc56-1355-473b-9518-0fe89a409a62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a76dd39b4a8c4deea3fa8a61debd8d24'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:50.556750 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-f1c8fc56-1355-473b-9518-0fe89a409a62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a76dd39b4a8c4deea3fa8a61debd8d24'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:50.646969 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed29a06-6d61-4f91-b91b-068e92e9efae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:50.648746 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed29a06-6d61-4f91-b91b-068e92e9efae service cinder] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:50.665506 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-f1c8fc56-1355-473b-9518-0fe89a409a62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a76dd39b4a8c4deea3fa8a61debd8d24'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:50.666398 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-f1c8fc56-1355-473b-9518-0fe89a409a62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a76dd39b4a8c4deea3fa8a61debd8d24'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:50.674643 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-f1c8fc56-1355-473b-9518-0fe89a409a62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a76dd39b4a8c4deea3fa8a61debd8d24'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:50.704426 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 854/1712] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:34:50 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:34:50.710663 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57a431-d0bc-4bad-a6a1-45381d17a543 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:50.711467 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57a431-d0bc-4bad-a6a1-45381d17a543 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:50.712647 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57a431-d0bc-4bad-a6a1-45381d17a543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:50.724771 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 859/1713] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:34:50 2022] DELETE /identity/v3/users/a76dd39b4a8c4deea3fa8a61debd8d24 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:34:50.724771 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8fc56-1355-473b-9518-0fe89a409a62 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:50.727516 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-f1c8fc56-1355-473b-9518-0fe89a409a62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:50.816703 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-da57a431-d0bc-4bad-a6a1-45381d17a543 None None] MFA Rules not processed for user `8a959557b0064aff8e2308e842859481`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:50.819353 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-da57a431-d0bc-4bad-a6a1-45381d17a543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:50.888778 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8fc56-1355-473b-9518-0fe89a409a62 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:50.900080 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e341c481-11c9-4dfa-ae0c-d03da32a5bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:50.902867 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341c481-11c9-4dfa-ae0c-d03da32a5bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:50.902867 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341c481-11c9-4dfa-ae0c-d03da32a5bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:50.902867 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341c481-11c9-4dfa-ae0c-d03da32a5bd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:50.902867 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e341c481-11c9-4dfa-ae0c-d03da32a5bd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:50.907014 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e341c481-11c9-4dfa-ae0c-d03da32a5bd1 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:50.943481 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 860/1714] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:34:50.945005 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07dcd4-71ef-49a3-a89a-97bbe7100c7b None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:50.945297 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07dcd4-71ef-49a3-a89a-97bbe7100c7b None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:50.945581 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07dcd4-71ef-49a3-a89a-97bbe7100c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:50.959291 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 855/1715] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:50.969994 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57a431-d0bc-4bad-a6a1-45381d17a543 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:50.989335 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57a431-d0bc-4bad-a6a1-45381d17a543 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:51.037457 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-7b07dcd4-71ef-49a3-a89a-97bbe7100c7b None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:51.041201 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-7b07dcd4-71ef-49a3-a89a-97bbe7100c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:51.051625 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45651ba-ee4c-4b85-917e-195d3623bccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:51.051625 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45651ba-ee4c-4b85-917e-195d3623bccf admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:51.051625 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45651ba-ee4c-4b85-917e-195d3623bccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:51.051625 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45651ba-ee4c-4b85-917e-195d3623bccf admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:51.052229 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45651ba-ee4c-4b85-917e-195d3623bccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:51.052229 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45651ba-ee4c-4b85-917e-195d3623bccf admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:51.062222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 856/1716] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:34:51.064320 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c9483-70ca-4812-9b29-b2971ba4c1a1 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:51.064823 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c9483-70ca-4812-9b29-b2971ba4c1a1 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:51.065225 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c9483-70ca-4812-9b29-b2971ba4c1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:51.080396 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 861/1717] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:51.080396 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b07dcd4-71ef-49a3-a89a-97bbe7100c7b None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:51.091806 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b07dcd4-71ef-49a3-a89a-97bbe7100c7b None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:51.099874 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dbba28-e12a-40e3-a7f2-9cae3cb3e5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:51.101162 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbba28-e12a-40e3-a7f2-9cae3cb3e5a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:51.101714 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbba28-e12a-40e3-a7f2-9cae3cb3e5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:51.102206 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbba28-e12a-40e3-a7f2-9cae3cb3e5a7 admin admin] PATH_INFO: `/v3/projects/db923466cf984f5b8a8ad732373a6120/users/2112716b5f424895bb2046a45b1f6fbc/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:51.138878 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:34:51.145196 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-390c9483-70ca-4812-9b29-b2971ba4c1a1 None None] MFA Rules not processed for user `8a959557b0064aff8e2308e842859481`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:51.149542 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-390c9483-70ca-4812-9b29-b2971ba4c1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:51.153738 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dbba28-e12a-40e3-a7f2-9cae3cb3e5a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db923466cf984f5b8a8ad732373a6120, user_id=2112716b5f424895bb2046a45b1f6fbc, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:51.159650 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 857/1718] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:51.160716 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c9483-70ca-4812-9b29-b2971ba4c1a1 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:51.165249 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-390c9483-70ca-4812-9b29-b2971ba4c1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:51.178136 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dbba28-e12a-40e3-a7f2-9cae3cb3e5a7 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:51.264290 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 862/1719] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:34:51 2022] PUT /identity/v3/projects/db923466cf984f5b8a8ad732373a6120/users/2112716b5f424895bb2046a45b1f6fbc/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:34:51.265364 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dbba28-e12a-40e3-a7f2-9cae3cb3e5a7 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:51.269742 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-84dbba28-e12a-40e3-a7f2-9cae3cb3e5a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:51.310213 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c9483-70ca-4812-9b29-b2971ba4c1a1 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:51.533253 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dbba28-e12a-40e3-a7f2-9cae3cb3e5a7 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:51.566227 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b10d8-41b1-482c-9664-fa030051b14b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:51.566227 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b10d8-41b1-482c-9664-fa030051b14b service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:51.566227 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b10d8-41b1-482c-9664-fa030051b14b service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:51.566227 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b10d8-41b1-482c-9664-fa030051b14b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:51.568306 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472eb660-605e-4611-80dc-4c571b370303 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:51.568986 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472eb660-605e-4611-80dc-4c571b370303 service nova] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:51.569622 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472eb660-605e-4611-80dc-4c571b370303 service nova] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:51.569906 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472eb660-605e-4611-80dc-4c571b370303 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:51.774448 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:34:51.774640 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472eb660-605e-4611-80dc-4c571b370303 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:51.774737 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7b10d8-41b1-482c-9664-fa030051b14b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:51.774809 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472eb660-605e-4611-80dc-4c571b370303 service nova] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:51.774882 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7b10d8-41b1-482c-9664-fa030051b14b service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:51.799214 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 858/1720] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:34:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 639 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:34:51.800841 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34721867-01cd-4594-95cb-e7eeee958b6e None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:51.803246 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34721867-01cd-4594-95cb-e7eeee958b6e None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:51.803246 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34721867-01cd-4594-95cb-e7eeee958b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:51.809052 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 863/1721] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:34:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:34:51.865589 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-34721867-01cd-4594-95cb-e7eeee958b6e None None] MFA Rules not processed for user `2112716b5f424895bb2046a45b1f6fbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:51.867068 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-34721867-01cd-4594-95cb-e7eeee958b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:52.076126 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 859/1722] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:52.339000 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472eb660-605e-4611-80dc-4c571b370303 service nova] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:52.341679 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-472eb660-605e-4611-80dc-4c571b370303 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:52.378818 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472eb660-605e-4611-80dc-4c571b370303 service nova] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:52.413115 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e326b7-26ff-48cf-a7e9-33b2b9f3640f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:52.413763 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e326b7-26ff-48cf-a7e9-33b2b9f3640f service nova] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:52.414052 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e326b7-26ff-48cf-a7e9-33b2b9f3640f service nova] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:52.414330 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e326b7-26ff-48cf-a7e9-33b2b9f3640f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:52.435501 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e326b7-26ff-48cf-a7e9-33b2b9f3640f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:52.435501 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e326b7-26ff-48cf-a7e9-33b2b9f3640f service nova] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:52.456364 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 864/1723] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:34:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:34:52.733376 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34721867-01cd-4594-95cb-e7eeee958b6e None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:52.735066 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-34721867-01cd-4594-95cb-e7eeee958b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:52.806312 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190504c-f6fd-4377-a233-fb2754513116 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:52.806599 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190504c-f6fd-4377-a233-fb2754513116 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:52.806882 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190504c-f6fd-4377-a233-fb2754513116 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:52.808349 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 865/1724] 10.222.0.62 () {54 vars in 912 bytes} [Mon Jun 27 09:34:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 09:34:52.815649 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c36e44-b851-457c-abc1-642273e93b70 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:52.815938 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c36e44-b851-457c-abc1-642273e93b70 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:52.816262 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c36e44-b851-457c-abc1-642273e93b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:52.857739 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-54c36e44-b851-457c-abc1-642273e93b70 None None] MFA Rules not processed for user `097b991d67164cda94cc5aa24397f414`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:52.859167 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-54c36e44-b851-457c-abc1-642273e93b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:52.878353 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 866/1725] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Jun 27 09:34:52 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jun 27 09:34:52.879452 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c36e44-b851-457c-abc1-642273e93b70 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:52.881106 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-54c36e44-b851-457c-abc1-642273e93b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:52.898542 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c36e44-b851-457c-abc1-642273e93b70 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:52.906524 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34721867-01cd-4594-95cb-e7eeee958b6e None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:52.908811 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83190af5-59d7-471a-83b4-094f6f8d80cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:52.910041 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83190af5-59d7-471a-83b4-094f6f8d80cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:52.910472 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83190af5-59d7-471a-83b4-094f6f8d80cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:52.911987 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83190af5-59d7-471a-83b4-094f6f8d80cf admin admin] PATH_INFO: `/v3/projects/914487d4e22545c89e75a8e34282802a` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:52.913493 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83190af5-59d7-471a-83b4-094f6f8d80cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=914487d4e22545c89e75a8e34282802a)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:52.916059 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84c073-47fb-48f5-8894-6d5bde2e4a96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:52.917042 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84c073-47fb-48f5-8894-6d5bde2e4a96 service cinder] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:52.918081 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83190af5-59d7-471a-83b4-094f6f8d80cf admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:52.918583 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84c073-47fb-48f5-8894-6d5bde2e4a96 service cinder] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:52.918894 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84c073-47fb-48f5-8894-6d5bde2e4a96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:52.950080 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-ea84c073-47fb-48f5-8894-6d5bde2e4a96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:53.126064 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea84c073-47fb-48f5-8894-6d5bde2e4a96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:53.128813 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea84c073-47fb-48f5-8894-6d5bde2e4a96 service cinder] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:53.143344 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-83190af5-59d7-471a-83b4-094f6f8d80cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '914487d4e22545c89e75a8e34282802a', 'request_id': 'req-83190af5-59d7-471a-83b4-094f6f8d80cf'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:53.169149 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 860/1726] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:34:52 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:34:53.172278 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84c073-47fb-48f5-8894-6d5bde2e4a96 service cinder] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:53.193377 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84c073-47fb-48f5-8894-6d5bde2e4a96 service cinder] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:53.253924 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-83190af5-59d7-471a-83b4-094f6f8d80cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '914487d4e22545c89e75a8e34282802a', 'request_id': 'req-83190af5-59d7-471a-83b4-094f6f8d80cf'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:53.266776 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-83190af5-59d7-471a-83b4-094f6f8d80cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '914487d4e22545c89e75a8e34282802a', 'request_id': 'req-83190af5-59d7-471a-83b4-094f6f8d80cf'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:53.285086 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:34:53.298903 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-83190af5-59d7-471a-83b4-094f6f8d80cf admin admin] The token cache is being invalidate because project 914487d4e22545c89e75a8e34282802a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:34:53.300597 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-83190af5-59d7-471a-83b4-094f6f8d80cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:53.301865 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-83190af5-59d7-471a-83b4-094f6f8d80cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:34:53.309607 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 867/1727] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:34:52 2022] DELETE /identity/v3/projects/914487d4e22545c89e75a8e34282802a => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:34:53.312473 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13247a0c-b854-405a-92c4-b1b79b896cfa None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:53.312473 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13247a0c-b854-405a-92c4-b1b79b896cfa None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:53.312473 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13247a0c-b854-405a-92c4-b1b79b896cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:53.350383 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7479cc2a-00ea-4597-a5d2-c534492f848f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:53.350383 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7479cc2a-00ea-4597-a5d2-c534492f848f service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:53.350383 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7479cc2a-00ea-4597-a5d2-c534492f848f service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:53.350383 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7479cc2a-00ea-4597-a5d2-c534492f848f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:53.350828 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-7479cc2a-00ea-4597-a5d2-c534492f848f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:53.361960 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-13247a0c-b854-405a-92c4-b1b79b896cfa None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:53.365876 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-13247a0c-b854-405a-92c4-b1b79b896cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:53.373398 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7479cc2a-00ea-4597-a5d2-c534492f848f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:53.377391 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7479cc2a-00ea-4597-a5d2-c534492f848f service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:53.398409 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 861/1728] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:34:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:34:53.472867 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 868/1729] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:53.485917 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4614830-38e7-4ae8-b6d7-6deee17ae01e None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:53.485917 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4614830-38e7-4ae8-b6d7-6deee17ae01e None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:53.486168 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4614830-38e7-4ae8-b6d7-6deee17ae01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:53.517868 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-c4614830-38e7-4ae8-b6d7-6deee17ae01e None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:53.522507 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-c4614830-38e7-4ae8-b6d7-6deee17ae01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:53.531101 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 862/1730] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:53.535396 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13247a0c-b854-405a-92c4-b1b79b896cfa None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:53.551678 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13247a0c-b854-405a-92c4-b1b79b896cfa None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:53.558504 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ee106-f4db-4915-8020-18b7d447d688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:53.559318 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ee106-f4db-4915-8020-18b7d447d688 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:53.559736 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ee106-f4db-4915-8020-18b7d447d688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:53.560095 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ee106-f4db-4915-8020-18b7d447d688 admin admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:53.560976 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ee106-f4db-4915-8020-18b7d447d688 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:34:53.561393 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ee106-f4db-4915-8020-18b7d447d688 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:53.563377 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ee106-f4db-4915-8020-18b7d447d688 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:53.584061 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 869/1731] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:34:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:34:53.586836 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4614830-38e7-4ae8-b6d7-6deee17ae01e None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:53.601571 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4614830-38e7-4ae8-b6d7-6deee17ae01e None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:53.609110 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cecf91-3714-4682-85cc-00d8b031c8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:53.609949 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cecf91-3714-4682-85cc-00d8b031c8f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:53.609949 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cecf91-3714-4682-85cc-00d8b031c8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:53.610643 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cecf91-3714-4682-85cc-00d8b031c8f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:53.611484 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cecf91-3714-4682-85cc-00d8b031c8f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:53.614157 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cecf91-3714-4682-85cc-00d8b031c8f6 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:53.745089 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 863/1732] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:34:53 2022] POST /identity/v3/projects => generated 381 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:34:53.749210 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ee106-f4db-4915-8020-18b7d447d688 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:53.765121 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ee106-f4db-4915-8020-18b7d447d688 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:53.927795 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3420f8a-ba92-484f-95e9-67177c66dca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:53.929001 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3420f8a-ba92-484f-95e9-67177c66dca3 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:53.931301 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3420f8a-ba92-484f-95e9-67177c66dca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:53.931776 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3420f8a-ba92-484f-95e9-67177c66dca3 admin admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:53.933368 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3420f8a-ba92-484f-95e9-67177c66dca3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:53.937115 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3420f8a-ba92-484f-95e9-67177c66dca3 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:54.046946 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 870/1733] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:34:53 2022] POST /identity/v3/users => generated 291 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:34:54.048122 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cecf91-3714-4682-85cc-00d8b031c8f6 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:54.064534 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cecf91-3714-4682-85cc-00d8b031c8f6 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:54.071067 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e2af17-e75c-472c-9267-82b6abd53a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:54.072846 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e2af17-e75c-472c-9267-82b6abd53a66 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:54.073043 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e2af17-e75c-472c-9267-82b6abd53a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:54.073333 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e2af17-e75c-472c-9267-82b6abd53a66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:54.074315 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e2af17-e75c-472c-9267-82b6abd53a66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:54.076259 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e2af17-e75c-472c-9267-82b6abd53a66 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:54.103895 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3420f8a-ba92-484f-95e9-67177c66dca3 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:54.119210 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 864/1734] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:34:54.126601 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3420f8a-ba92-484f-95e9-67177c66dca3 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:54.137865 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a761856-ba74-4c08-8194-970053ae2c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:54.138830 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a761856-ba74-4c08-8194-970053ae2c0c admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:54.140059 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a761856-ba74-4c08-8194-970053ae2c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:54.142257 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a761856-ba74-4c08-8194-970053ae2c0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:54.143221 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a761856-ba74-4c08-8194-970053ae2c0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:54.148226 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a761856-ba74-4c08-8194-970053ae2c0c admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:54.152652 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:34:54.192993 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e2af17-e75c-472c-9267-82b6abd53a66 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:54.204137 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 871/1735] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:34:54.210353 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e2af17-e75c-472c-9267-82b6abd53a66 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:54.218196 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372ea4e-93ba-4987-9bb7-c34accac2698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:54.228308 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372ea4e-93ba-4987-9bb7-c34accac2698 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:54.228308 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372ea4e-93ba-4987-9bb7-c34accac2698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:54.228308 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372ea4e-93ba-4987-9bb7-c34accac2698 admin admin] PATH_INFO: `/v3/projects/f334edfead2746c2bff58f9b8de38590/users/d0225f96ecf94565941735ad53a26849/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:54.243444 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372ea4e-93ba-4987-9bb7-c34accac2698 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f334edfead2746c2bff58f9b8de38590, user_id=d0225f96ecf94565941735ad53a26849, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:54.257128 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372ea4e-93ba-4987-9bb7-c34accac2698 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:54.363106 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 865/1736] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:34:54 2022] PUT /identity/v3/projects/f334edfead2746c2bff58f9b8de38590/users/d0225f96ecf94565941735ad53a26849/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:34:54.374588 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d813d29-ac2a-4c43-b373-a3d126ce28c7 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:54.375061 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d813d29-ac2a-4c43-b373-a3d126ce28c7 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:54.375149 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d813d29-ac2a-4c43-b373-a3d126ce28c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:54.501723 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:34:54.508424 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-5d813d29-ac2a-4c43-b373-a3d126ce28c7 None None] MFA Rules not processed for user `d0225f96ecf94565941735ad53a26849`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:54.508424 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-5d813d29-ac2a-4c43-b373-a3d126ce28c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:54.548700 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90a84b-8897-4bcb-b411-f00895d2657a None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:54.548950 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90a84b-8897-4bcb-b411-f00895d2657a None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:54.549399 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90a84b-8897-4bcb-b411-f00895d2657a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:54.590310 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-da90a84b-8897-4bcb-b411-f00895d2657a None None] MFA Rules not processed for user `d67234e9868b4d34a1532b1aedf33221`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:54.591549 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-da90a84b-8897-4bcb-b411-f00895d2657a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:54.688630 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 872/1737] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:54.692983 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d813d29-ac2a-4c43-b373-a3d126ce28c7 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:54.769422 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 866/1738] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:54.846152 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610edde0-64ac-42e2-8487-3e9d9d7d2546 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:54.846436 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610edde0-64ac-42e2-8487-3e9d9d7d2546 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:54.846725 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610edde0-64ac-42e2-8487-3e9d9d7d2546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:54.898667 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-610edde0-64ac-42e2-8487-3e9d9d7d2546 None None] MFA Rules not processed for user `8a959557b0064aff8e2308e842859481`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:54.899904 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-610edde0-64ac-42e2-8487-3e9d9d7d2546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:54.918639 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d813d29-ac2a-4c43-b373-a3d126ce28c7 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:54.943821 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c295e38-3824-4380-9951-849a78739bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:54.943932 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c295e38-3824-4380-9951-849a78739bd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:54.944233 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c295e38-3824-4380-9951-849a78739bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:54.944533 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c295e38-3824-4380-9951-849a78739bd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:54.945253 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c295e38-3824-4380-9951-849a78739bd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:54.947153 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c295e38-3824-4380-9951-849a78739bd4 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:55.156547 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 873/1739] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:34:54 2022] POST /identity/v3/projects => generated 381 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:34:55.156850 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 867/1740] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 09:34:55.163016 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c295e38-3824-4380-9951-849a78739bd4 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:55.265150 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0afe23-a8b4-4623-92c0-611230a16d79 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:55.265616 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0afe23-a8b4-4623-92c0-611230a16d79 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:55.266038 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0afe23-a8b4-4623-92c0-611230a16d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:55.333471 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c295e38-3824-4380-9951-849a78739bd4 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:55.349912 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3482f8a7-efe2-4d2a-a937-b3c3beea63c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:55.353378 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482f8a7-efe2-4d2a-a937-b3c3beea63c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:55.353884 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482f8a7-efe2-4d2a-a937-b3c3beea63c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:55.355933 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482f8a7-efe2-4d2a-a937-b3c3beea63c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:55.356928 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-3d0afe23-a8b4-4623-92c0-611230a16d79 None None] MFA Rules not processed for user `8f5d1f2327914f9fb070c6212582b6dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:55.357072 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3482f8a7-efe2-4d2a-a937-b3c3beea63c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:55.358390 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-3d0afe23-a8b4-4623-92c0-611230a16d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:55.360748 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3482f8a7-efe2-4d2a-a937-b3c3beea63c6 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:55.482943 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 868/1741] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Jun 27 09:34:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:55.585618 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 874/1742] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:34:55 2022] POST /identity/v3/users => generated 297 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:34:55.590737 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0afe23-a8b4-4623-92c0-611230a16d79 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:55.617142 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0afe23-a8b4-4623-92c0-611230a16d79 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:55.622118 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f94016-7449-4373-b3ee-c3514fd45474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:55.623371 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f94016-7449-4373-b3ee-c3514fd45474 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:55.624444 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f94016-7449-4373-b3ee-c3514fd45474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:55.624828 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f94016-7449-4373-b3ee-c3514fd45474 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:55.626422 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f94016-7449-4373-b3ee-c3514fd45474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:55.630808 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f94016-7449-4373-b3ee-c3514fd45474 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:55.660474 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 869/1743] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:34:55 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:34:55.661436 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3482f8a7-efe2-4d2a-a937-b3c3beea63c6 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:55.683565 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3482f8a7-efe2-4d2a-a937-b3c3beea63c6 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:55.703942 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a04ac9-1fff-4b62-9fc5-ade3156d4923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:55.704840 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a04ac9-1fff-4b62-9fc5-ade3156d4923 admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:55.705161 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a04ac9-1fff-4b62-9fc5-ade3156d4923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:55.705391 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a04ac9-1fff-4b62-9fc5-ade3156d4923 admin admin] PATH_INFO: `/v3/projects/aeaf9951896946468fde68a6ce41eb82/users/56f1e553397d48aaaa9d311dfd2a618d/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:55.737495 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a04ac9-1fff-4b62-9fc5-ade3156d4923 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aeaf9951896946468fde68a6ce41eb82, user_id=56f1e553397d48aaaa9d311dfd2a618d, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:55.740172 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a04ac9-1fff-4b62-9fc5-ade3156d4923 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:55.875632 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 875/1744] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:34:55 2022] PUT /identity/v3/projects/aeaf9951896946468fde68a6ce41eb82/users/56f1e553397d48aaaa9d311dfd2a618d/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:34:55.882638 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f94016-7449-4373-b3ee-c3514fd45474 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:55.906015 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f94016-7449-4373-b3ee-c3514fd45474 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:55.936649 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a04ac9-1fff-4b62-9fc5-ade3156d4923 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:55.938582 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-e6a04ac9-1fff-4b62-9fc5-ade3156d4923 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:56.080780 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a04ac9-1fff-4b62-9fc5-ade3156d4923 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:56.087048 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4f996-f78a-4a9f-a6cd-cc96d28e093e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5477b14dae24fd3a644c9cbd6ff85ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:56.088742 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4f996-f78a-4a9f-a6cd-cc96d28e093e service swift] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:56.090216 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4f996-f78a-4a9f-a6cd-cc96d28e093e service swift] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:56.091055 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4f996-f78a-4a9f-a6cd-cc96d28e093e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:56.151084 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37773da5-c869-4cc4-80ba-396c55b2082e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:56.152388 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37773da5-c869-4cc4-80ba-396c55b2082e admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:56.155984 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37773da5-c869-4cc4-80ba-396c55b2082e admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:56.155984 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37773da5-c869-4cc4-80ba-396c55b2082e admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:56.156891 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37773da5-c869-4cc4-80ba-396c55b2082e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:56.161156 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37773da5-c869-4cc4-80ba-396c55b2082e admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:56.188125 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 870/1745] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:34:55 2022] GET /identity/v3/roles => generated 1420 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:34:56.192077 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf0623-de9f-4257-a0a8-ffc28790d080 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:56.192648 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea4f996-f78a-4a9f-a6cd-cc96d28e093e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:56.194298 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf0623-de9f-4257-a0a8-ffc28790d080 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:56.194585 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf0623-de9f-4257-a0a8-ffc28790d080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:56.195284 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea4f996-f78a-4a9f-a6cd-cc96d28e093e service swift] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:56.202445 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:34:56.227539 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 876/1746] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Jun 27 09:34:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 09:34:56.238842 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4f996-f78a-4a9f-a6cd-cc96d28e093e service swift] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:56.283569 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-efcf0623-de9f-4257-a0a8-ffc28790d080 None None] MFA Rules not processed for user `4c30a14c11d24ff3bd270c8e865a55d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:56.284559 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-efcf0623-de9f-4257-a0a8-ffc28790d080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:56.286922 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4f996-f78a-4a9f-a6cd-cc96d28e093e service swift] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:56.308303 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965343c8-1886-49df-b77b-08a765c8a7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:56.330265 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965343c8-1886-49df-b77b-08a765c8a7af admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:56.334101 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965343c8-1886-49df-b77b-08a765c8a7af admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:56.336090 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965343c8-1886-49df-b77b-08a765c8a7af admin admin] PATH_INFO: `/v3/projects/aeaf9951896946468fde68a6ce41eb82/users/56f1e553397d48aaaa9d311dfd2a618d/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:56.350156 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965343c8-1886-49df-b77b-08a765c8a7af admin admin] RBAC: Authorizing `identity:create_grant(project_id=aeaf9951896946468fde68a6ce41eb82, user_id=56f1e553397d48aaaa9d311dfd2a618d, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:56.364714 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965343c8-1886-49df-b77b-08a765c8a7af admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:56.432876 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 877/1747] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:34:56 2022] PUT /identity/v3/projects/aeaf9951896946468fde68a6ce41eb82/users/56f1e553397d48aaaa9d311dfd2a618d/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:34:56.449112 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed50f66-e7c0-43f9-80ed-4a9d51bb37c1 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:56.449528 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed50f66-e7c0-43f9-80ed-4a9d51bb37c1 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:56.450269 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed50f66-e7c0-43f9-80ed-4a9d51bb37c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:56.571459 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-1ed50f66-e7c0-43f9-80ed-4a9d51bb37c1 None None] MFA Rules not processed for user `56f1e553397d48aaaa9d311dfd2a618d`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:56.585812 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-1ed50f66-e7c0-43f9-80ed-4a9d51bb37c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:56.610480 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 871/1748] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:56.795395 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 878/1749] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:34:56 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:56.806938 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf0623-de9f-4257-a0a8-ffc28790d080 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:56.809586 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-efcf0623-de9f-4257-a0a8-ffc28790d080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:57.081305 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf0623-de9f-4257-a0a8-ffc28790d080 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:57.268929 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85397fc-735e-4b3d-bfe4-2ba435acb4b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:57.269610 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85397fc-735e-4b3d-bfe4-2ba435acb4b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:57.269924 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85397fc-735e-4b3d-bfe4-2ba435acb4b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:57.270367 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85397fc-735e-4b3d-bfe4-2ba435acb4b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:57.291173 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85397fc-735e-4b3d-bfe4-2ba435acb4b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:57.293919 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85397fc-735e-4b3d-bfe4-2ba435acb4b8 service cinder] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:57.325454 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 872/1750] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:34:56 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:34:58.279821 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154532a0-9ca6-4c41-b3ec-f16809dcdc52 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:58.282528 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154532a0-9ca6-4c41-b3ec-f16809dcdc52 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:58.282528 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154532a0-9ca6-4c41-b3ec-f16809dcdc52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:58.338666 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-154532a0-9ca6-4c41-b3ec-f16809dcdc52 None None] MFA Rules not processed for user `097b991d67164cda94cc5aa24397f414`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:34:58.340707 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-154532a0-9ca6-4c41-b3ec-f16809dcdc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:58.504416 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:34:58.592929 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 879/1751] 10.222.0.69 () {58 vars in 1015 bytes} [Mon Jun 27 09:34:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:34:58.725324 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85397fc-735e-4b3d-bfe4-2ba435acb4b8 service cinder] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:58.733086 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-d85397fc-735e-4b3d-bfe4-2ba435acb4b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:58.753757 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85397fc-735e-4b3d-bfe4-2ba435acb4b8 service cinder] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:58.764147 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0cf140-7828-41d3-93b7-4a8e5e50250b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:58.765222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cf140-7828-41d3-93b7-4a8e5e50250b service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:58.766848 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cf140-7828-41d3-93b7-4a8e5e50250b service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:58.767076 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cf140-7828-41d3-93b7-4a8e5e50250b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:58.788902 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0cf140-7828-41d3-93b7-4a8e5e50250b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:58.790704 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0cf140-7828-41d3-93b7-4a8e5e50250b service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:58.810506 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 873/1752] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:34:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:34:59.040455 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:34:59.466802 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154532a0-9ca6-4c41-b3ec-f16809dcdc52 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:59.494818 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154532a0-9ca6-4c41-b3ec-f16809dcdc52 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:59.508437 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42512d5-ac62-48eb-a957-dd5d5d6b3b4f tempest-VolumeQuotaClassesTest-1101966720 tempest-VolumeQuotaClassesTest-1101966720-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56f1e553397d48aaaa9d311dfd2a618d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeaf9951896946468fde68a6ce41eb82', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:59.509725 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42512d5-ac62-48eb-a957-dd5d5d6b3b4f tempest-VolumeQuotaClassesTest-1101966720 tempest-VolumeQuotaClassesTest-1101966720-project-admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:59.509930 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42512d5-ac62-48eb-a957-dd5d5d6b3b4f tempest-VolumeQuotaClassesTest-1101966720 tempest-VolumeQuotaClassesTest-1101966720-project-admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:59.510234 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42512d5-ac62-48eb-a957-dd5d5d6b3b4f tempest-VolumeQuotaClassesTest-1101966720 tempest-VolumeQuotaClassesTest-1101966720-project-admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:59.511511 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42512d5-ac62-48eb-a957-dd5d5d6b3b4f tempest-VolumeQuotaClassesTest-1101966720 tempest-VolumeQuotaClassesTest-1101966720-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:34:59.512592 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42512d5-ac62-48eb-a957-dd5d5d6b3b4f tempest-VolumeQuotaClassesTest-1101966720 tempest-VolumeQuotaClassesTest-1101966720-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:59.518709 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42512d5-ac62-48eb-a957-dd5d5d6b3b4f tempest-VolumeQuotaClassesTest-1101966720 tempest-VolumeQuotaClassesTest-1101966720-project-admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:59.551663 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 880/1753] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:34:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:34:59.555686 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0cf140-7828-41d3-93b7-4a8e5e50250b service neutron] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:59.632372 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0cf140-7828-41d3-93b7-4a8e5e50250b service neutron] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:34:59.632372 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c691a-aa7b-4473-a764-510644153641 tempest-VolumeQuotaClassesTest-1101966720 tempest-VolumeQuotaClassesTest-1101966720-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56f1e553397d48aaaa9d311dfd2a618d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeaf9951896946468fde68a6ce41eb82', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:34:59.632372 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c691a-aa7b-4473-a764-510644153641 tempest-VolumeQuotaClassesTest-1101966720 tempest-VolumeQuotaClassesTest-1101966720-project-admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:34:59.632801 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c691a-aa7b-4473-a764-510644153641 tempest-VolumeQuotaClassesTest-1101966720 tempest-VolumeQuotaClassesTest-1101966720-project-admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:34:59.632801 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c691a-aa7b-4473-a764-510644153641 tempest-VolumeQuotaClassesTest-1101966720 tempest-VolumeQuotaClassesTest-1101966720-project-admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:34:59.632801 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c691a-aa7b-4473-a764-510644153641 tempest-VolumeQuotaClassesTest-1101966720 tempest-VolumeQuotaClassesTest-1101966720-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:34:59.632801 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c691a-aa7b-4473-a764-510644153641 tempest-VolumeQuotaClassesTest-1101966720 tempest-VolumeQuotaClassesTest-1101966720-project-admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:34:59.808651 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42512d5-ac62-48eb-a957-dd5d5d6b3b4f tempest-VolumeQuotaClassesTest-1101966720 tempest-VolumeQuotaClassesTest-1101966720-project-admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:34:59.811093 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-a42512d5-ac62-48eb-a957-dd5d5d6b3b4f tempest-VolumeQuotaClassesTest-1101966720 tempest-VolumeQuotaClassesTest-1101966720-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:34:59.867537 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 874/1754] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:34:59 2022] POST /identity/v3/projects => generated 355 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:34:59.872707 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c691a-aa7b-4473-a764-510644153641 tempest-VolumeQuotaClassesTest-1101966720 tempest-VolumeQuotaClassesTest-1101966720-project-admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:00.024008 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42512d5-ac62-48eb-a957-dd5d5d6b3b4f tempest-VolumeQuotaClassesTest-1101966720 tempest-VolumeQuotaClassesTest-1101966720-project-admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:00.131295 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c691a-aa7b-4473-a764-510644153641 tempest-VolumeQuotaClassesTest-1101966720 tempest-VolumeQuotaClassesTest-1101966720-project-admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:00.161192 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54f387-b4c5-4be2-8917-dacac3db2714 tempest-VolumeQuotaClassesTest-1101966720 tempest-VolumeQuotaClassesTest-1101966720-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56f1e553397d48aaaa9d311dfd2a618d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeaf9951896946468fde68a6ce41eb82', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:00.166070 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54f387-b4c5-4be2-8917-dacac3db2714 tempest-VolumeQuotaClassesTest-1101966720 tempest-VolumeQuotaClassesTest-1101966720-project-admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:00.166374 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54f387-b4c5-4be2-8917-dacac3db2714 tempest-VolumeQuotaClassesTest-1101966720 tempest-VolumeQuotaClassesTest-1101966720-project-admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:00.166694 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54f387-b4c5-4be2-8917-dacac3db2714 tempest-VolumeQuotaClassesTest-1101966720 tempest-VolumeQuotaClassesTest-1101966720-project-admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:00.172108 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e54f387-b4c5-4be2-8917-dacac3db2714 tempest-VolumeQuotaClassesTest-1101966720 tempest-VolumeQuotaClassesTest-1101966720-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:35:00.172795 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e54f387-b4c5-4be2-8917-dacac3db2714 tempest-VolumeQuotaClassesTest-1101966720 tempest-VolumeQuotaClassesTest-1101966720-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:00.179822 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e54f387-b4c5-4be2-8917-dacac3db2714 tempest-VolumeQuotaClassesTest-1101966720 tempest-VolumeQuotaClassesTest-1101966720-project-admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:00.272508 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 875/1755] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:34:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:35:00.273258 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91714f8e-18e3-42a0-b9eb-027462950fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:00.273258 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91714f8e-18e3-42a0-b9eb-027462950fa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:00.273258 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91714f8e-18e3-42a0-b9eb-027462950fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:00.273258 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91714f8e-18e3-42a0-b9eb-027462950fa9 admin admin] PATH_INFO: `/v3/users/df5054f21f1645eeae0be0c97bfeec30` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:00.273902 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91714f8e-18e3-42a0-b9eb-027462950fa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df5054f21f1645eeae0be0c97bfeec30)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:00.273902 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91714f8e-18e3-42a0-b9eb-027462950fa9 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:00.373859 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54f387-b4c5-4be2-8917-dacac3db2714 tempest-VolumeQuotaClassesTest-1101966720 tempest-VolumeQuotaClassesTest-1101966720-project-admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:00.387208 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54f387-b4c5-4be2-8917-dacac3db2714 tempest-VolumeQuotaClassesTest-1101966720 tempest-VolumeQuotaClassesTest-1101966720-project-admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:00.399431 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81277ec-b2d4-46b8-a398-5dbc55695e0d tempest-VolumeQuotaClassesTest-1101966720 tempest-VolumeQuotaClassesTest-1101966720-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56f1e553397d48aaaa9d311dfd2a618d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeaf9951896946468fde68a6ce41eb82', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:00.404250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81277ec-b2d4-46b8-a398-5dbc55695e0d tempest-VolumeQuotaClassesTest-1101966720 tempest-VolumeQuotaClassesTest-1101966720-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:00.404885 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81277ec-b2d4-46b8-a398-5dbc55695e0d tempest-VolumeQuotaClassesTest-1101966720 tempest-VolumeQuotaClassesTest-1101966720-project-admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:00.405403 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81277ec-b2d4-46b8-a398-5dbc55695e0d tempest-VolumeQuotaClassesTest-1101966720 tempest-VolumeQuotaClassesTest-1101966720-project-admin] PATH_INFO: `/v3/projects/eda28242daef4bf597caa8fb93d3f800` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:00.407220 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81277ec-b2d4-46b8-a398-5dbc55695e0d tempest-VolumeQuotaClassesTest-1101966720 tempest-VolumeQuotaClassesTest-1101966720-project-admin] RBAC: Authorizing `identity:delete_project(project_id=eda28242daef4bf597caa8fb93d3f800)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:00.409745 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81277ec-b2d4-46b8-a398-5dbc55695e0d tempest-VolumeQuotaClassesTest-1101966720 tempest-VolumeQuotaClassesTest-1101966720-project-admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:00.686993 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-d81277ec-b2d4-46b8-a398-5dbc55695e0d tempest-VolumeQuotaClassesTest-1101966720 tempest-VolumeQuotaClassesTest-1101966720-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eda28242daef4bf597caa8fb93d3f800', 'request_id': 'req-d81277ec-b2d4-46b8-a398-5dbc55695e0d'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:01.014390 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-d81277ec-b2d4-46b8-a398-5dbc55695e0d tempest-VolumeQuotaClassesTest-1101966720 tempest-VolumeQuotaClassesTest-1101966720-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eda28242daef4bf597caa8fb93d3f800', 'request_id': 'req-d81277ec-b2d4-46b8-a398-5dbc55695e0d'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:01.020579 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-91714f8e-18e3-42a0-b9eb-027462950fa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df5054f21f1645eeae0be0c97bfeec30'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:01.025148 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-91714f8e-18e3-42a0-b9eb-027462950fa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df5054f21f1645eeae0be0c97bfeec30'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:01.027330 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-d81277ec-b2d4-46b8-a398-5dbc55695e0d tempest-VolumeQuotaClassesTest-1101966720 tempest-VolumeQuotaClassesTest-1101966720-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eda28242daef4bf597caa8fb93d3f800', 'request_id': 'req-d81277ec-b2d4-46b8-a398-5dbc55695e0d'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:01.081217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-d81277ec-b2d4-46b8-a398-5dbc55695e0d tempest-VolumeQuotaClassesTest-1101966720 tempest-VolumeQuotaClassesTest-1101966720-project-admin] The token cache is being invalidate because project eda28242daef4bf597caa8fb93d3f800 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:35:01.081536 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-d81277ec-b2d4-46b8-a398-5dbc55695e0d tempest-VolumeQuotaClassesTest-1101966720 tempest-VolumeQuotaClassesTest-1101966720-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:01.086010 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:01.087528 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-d81277ec-b2d4-46b8-a398-5dbc55695e0d tempest-VolumeQuotaClassesTest-1101966720 tempest-VolumeQuotaClassesTest-1101966720-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:01.106839 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 876/1756] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:35:00 2022] DELETE /identity/v3/projects/eda28242daef4bf597caa8fb93d3f800 => generated 0 bytes in 733 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:35:01.141558 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-91714f8e-18e3-42a0-b9eb-027462950fa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df5054f21f1645eeae0be0c97bfeec30'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:01.144730 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-91714f8e-18e3-42a0-b9eb-027462950fa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df5054f21f1645eeae0be0c97bfeec30'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:01.159744 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-91714f8e-18e3-42a0-b9eb-027462950fa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df5054f21f1645eeae0be0c97bfeec30'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:01.228403 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f0921-10d7-47d7-857f-28e093e0d4a8 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:01.234775 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f0921-10d7-47d7-857f-28e093e0d4a8 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:01.234775 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f0921-10d7-47d7-857f-28e093e0d4a8 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:01.234775 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 877/1757] 10.222.0.62 () {54 vars in 921 bytes} [Mon Jun 27 09:35:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 09:35:01.247884 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 881/1758] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:34:59 2022] DELETE /identity/v3/users/df5054f21f1645eeae0be0c97bfeec30 => generated 0 bytes in 1436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:35:01.249655 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c73c81-1613-40b1-8c18-a583f1e550b1 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:01.249947 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c73c81-1613-40b1-8c18-a583f1e550b1 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:01.250708 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c73c81-1613-40b1-8c18-a583f1e550b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:01.258904 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d882a-2766-4acb-acc8-e4a6e4e031d8 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:01.263414 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d882a-2766-4acb-acc8-e4a6e4e031d8 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:01.263414 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d882a-2766-4acb-acc8-e4a6e4e031d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:01.357398 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-27c73c81-1613-40b1-8c18-a583f1e550b1 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:01.358656 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-27c73c81-1613-40b1-8c18-a583f1e550b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:01.363631 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-209d882a-2766-4acb-acc8-e4a6e4e031d8 None None] MFA Rules not processed for user `2c1434a85b30411c9c59cc50c3980cd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:01.365502 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-209d882a-2766-4acb-acc8-e4a6e4e031d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:01.576139 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 882/1759] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Jun 27 09:35:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:35:01.577177 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d882a-2766-4acb-acc8-e4a6e4e031d8 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:01.583401 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-209d882a-2766-4acb-acc8-e4a6e4e031d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:01.749493 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d882a-2766-4acb-acc8-e4a6e4e031d8 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:01.756784 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268559db-3c2d-4f6c-9ebf-7aa8bde99d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:01.758206 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268559db-3c2d-4f6c-9ebf-7aa8bde99d61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:01.758867 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268559db-3c2d-4f6c-9ebf-7aa8bde99d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:01.759595 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268559db-3c2d-4f6c-9ebf-7aa8bde99d61 admin admin] PATH_INFO: `/v3/users/5424ad4111f24708868e52063b8f4a6b` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:01.761681 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268559db-3c2d-4f6c-9ebf-7aa8bde99d61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5424ad4111f24708868e52063b8f4a6b)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:01.764594 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268559db-3c2d-4f6c-9ebf-7aa8bde99d61 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:01.835492 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 878/1760] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 587 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:35:01.836650 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c73c81-1613-40b1-8c18-a583f1e550b1 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:01.839080 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-27c73c81-1613-40b1-8c18-a583f1e550b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:01.856821 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c73c81-1613-40b1-8c18-a583f1e550b1 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:01.865261 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0db74c-cd0e-47f6-a345-2e9e54e8af4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:01.865942 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0db74c-cd0e-47f6-a345-2e9e54e8af4a service nova] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:01.866221 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0db74c-cd0e-47f6-a345-2e9e54e8af4a service nova] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:01.866764 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0db74c-cd0e-47f6-a345-2e9e54e8af4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:01.878420 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0db74c-cd0e-47f6-a345-2e9e54e8af4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:01.884684 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0db74c-cd0e-47f6-a345-2e9e54e8af4a service nova] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:01.894395 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 879/1761] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:35:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:35:01.895119 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0db74c-cd0e-47f6-a345-2e9e54e8af4a service nova] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:01.905708 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-0d0db74c-cd0e-47f6-a345-2e9e54e8af4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:02.053584 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0db74c-cd0e-47f6-a345-2e9e54e8af4a service nova] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:02.060156 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39598e10-ab9a-49de-b926-7acea50b3f45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:02.061306 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39598e10-ab9a-49de-b926-7acea50b3f45 service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:02.061775 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39598e10-ab9a-49de-b926-7acea50b3f45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:02.062191 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39598e10-ab9a-49de-b926-7acea50b3f45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:02.081713 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39598e10-ab9a-49de-b926-7acea50b3f45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:02.084483 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39598e10-ab9a-49de-b926-7acea50b3f45 service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:02.124433 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 880/1762] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:35:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:35:02.125499 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39598e10-ab9a-49de-b926-7acea50b3f45 service neutron] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:02.126964 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-39598e10-ab9a-49de-b926-7acea50b3f45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:02.160877 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39598e10-ab9a-49de-b926-7acea50b3f45 service neutron] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:02.166350 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb50de-f6fd-4ada-bd9f-89d6b787b18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:02.168099 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb50de-f6fd-4ada-bd9f-89d6b787b18a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:02.168573 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb50de-f6fd-4ada-bd9f-89d6b787b18a admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:02.169009 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb50de-f6fd-4ada-bd9f-89d6b787b18a admin admin] PATH_INFO: `/v3/users/2112716b5f424895bb2046a45b1f6fbc` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:02.170473 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fb50de-f6fd-4ada-bd9f-89d6b787b18a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2112716b5f424895bb2046a45b1f6fbc)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:02.172918 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fb50de-f6fd-4ada-bd9f-89d6b787b18a admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:02.269161 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-268559db-3c2d-4f6c-9ebf-7aa8bde99d61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5424ad4111f24708868e52063b8f4a6b'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:02.271539 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-268559db-3c2d-4f6c-9ebf-7aa8bde99d61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5424ad4111f24708868e52063b8f4a6b'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:02.658305 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-268559db-3c2d-4f6c-9ebf-7aa8bde99d61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5424ad4111f24708868e52063b8f4a6b'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:02.660381 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-268559db-3c2d-4f6c-9ebf-7aa8bde99d61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5424ad4111f24708868e52063b8f4a6b'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:02.685404 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-268559db-3c2d-4f6c-9ebf-7aa8bde99d61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5424ad4111f24708868e52063b8f4a6b'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:02.732612 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 883/1763] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:35:01 2022] DELETE /identity/v3/users/5424ad4111f24708868e52063b8f4a6b => generated 0 bytes in 1156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:35:02.737095 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea790792-01e8-4933-85dc-826dc36b6e55 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:02.737596 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea790792-01e8-4933-85dc-826dc36b6e55 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:02.738030 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea790792-01e8-4933-85dc-826dc36b6e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:02.764236 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-ea790792-01e8-4933-85dc-826dc36b6e55 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:02.771652 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:02.780572 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-a7fb50de-f6fd-4ada-bd9f-89d6b787b18a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2112716b5f424895bb2046a45b1f6fbc'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:02.782711 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-ea790792-01e8-4933-85dc-826dc36b6e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:02.800971 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-a7fb50de-f6fd-4ada-bd9f-89d6b787b18a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2112716b5f424895bb2046a45b1f6fbc'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:02.875797 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-a7fb50de-f6fd-4ada-bd9f-89d6b787b18a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2112716b5f424895bb2046a45b1f6fbc'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:02.876417 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-a7fb50de-f6fd-4ada-bd9f-89d6b787b18a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2112716b5f424895bb2046a45b1f6fbc'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:02.909283 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-a7fb50de-f6fd-4ada-bd9f-89d6b787b18a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2112716b5f424895bb2046a45b1f6fbc'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:02.931697 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 884/1764] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 09:35:02.933302 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea790792-01e8-4933-85dc-826dc36b6e55 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:02.945692 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 881/1765] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:35:02 2022] DELETE /identity/v3/users/2112716b5f424895bb2046a45b1f6fbc => generated 0 bytes in 818 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:35:02.948105 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082f280-fea2-46df-ad8d-d38dcc257c88 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:02.948985 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082f280-fea2-46df-ad8d-d38dcc257c88 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:02.949160 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082f280-fea2-46df-ad8d-d38dcc257c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:02.960564 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-ea790792-01e8-4933-85dc-826dc36b6e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:02.989825 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea790792-01e8-4933-85dc-826dc36b6e55 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:03.004157 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-e082f280-fea2-46df-ad8d-d38dcc257c88 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:03.005478 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-e082f280-fea2-46df-ad8d-d38dcc257c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:03.174865 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be90ad-221a-48a4-9817-212b566d9a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:03.176092 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be90ad-221a-48a4-9817-212b566d9a1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:03.176631 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be90ad-221a-48a4-9817-212b566d9a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:03.177019 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be90ad-221a-48a4-9817-212b566d9a1e admin admin] PATH_INFO: `/v3/users/d0225f96ecf94565941735ad53a26849` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:03.179396 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be90ad-221a-48a4-9817-212b566d9a1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0225f96ecf94565941735ad53a26849)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:03.182123 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be90ad-221a-48a4-9817-212b566d9a1e admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:03.213460 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 882/1766] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:35:03.220363 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082f280-fea2-46df-ad8d-d38dcc257c88 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:03.235233 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-e082f280-fea2-46df-ad8d-d38dcc257c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:03.362158 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082f280-fea2-46df-ad8d-d38dcc257c88 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:03.368621 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180dc0e-0f7b-4a80-abe8-4513e370bbd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:03.369305 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180dc0e-0f7b-4a80-abe8-4513e370bbd8 service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:03.369804 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180dc0e-0f7b-4a80-abe8-4513e370bbd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:03.370285 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180dc0e-0f7b-4a80-abe8-4513e370bbd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:03.388451 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e180dc0e-0f7b-4a80-abe8-4513e370bbd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:03.390326 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e180dc0e-0f7b-4a80-abe8-4513e370bbd8 service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:03.406771 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 883/1767] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:35:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:35:03.407682 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180dc0e-0f7b-4a80-abe8-4513e370bbd8 service neutron] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:03.409736 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-e180dc0e-0f7b-4a80-abe8-4513e370bbd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:03.424771 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180dc0e-0f7b-4a80-abe8-4513e370bbd8 service neutron] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:03.430538 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13c976-05b5-46c9-a3dc-658c1c78dfcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:03.431214 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13c976-05b5-46c9-a3dc-658c1c78dfcd service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:03.431497 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13c976-05b5-46c9-a3dc-658c1c78dfcd service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:03.431774 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13c976-05b5-46c9-a3dc-658c1c78dfcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:03.445013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb13c976-05b5-46c9-a3dc-658c1c78dfcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:03.446613 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb13c976-05b5-46c9-a3dc-658c1c78dfcd service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:03.465009 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 884/1768] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:35:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:35:03.853897 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:03.873576 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13c976-05b5-46c9-a3dc-658c1c78dfcd service neutron] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:03.873576 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-fb13c976-05b5-46c9-a3dc-658c1c78dfcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:03.902842 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13c976-05b5-46c9-a3dc-658c1c78dfcd service neutron] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:03.909644 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704945cd-8fb2-421d-a794-2cc846ef7d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:03.910767 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704945cd-8fb2-421d-a794-2cc846ef7d28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:03.911017 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704945cd-8fb2-421d-a794-2cc846ef7d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:03.911380 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704945cd-8fb2-421d-a794-2cc846ef7d28 admin admin] PATH_INFO: `/v3/projects/d673b7d1878a458ebbb964d637e2f4c3` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:03.915366 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704945cd-8fb2-421d-a794-2cc846ef7d28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d673b7d1878a458ebbb964d637e2f4c3)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:03.917557 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704945cd-8fb2-421d-a794-2cc846ef7d28 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:03.996679 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-51be90ad-221a-48a4-9817-212b566d9a1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0225f96ecf94565941735ad53a26849'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:03.999508 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-51be90ad-221a-48a4-9817-212b566d9a1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0225f96ecf94565941735ad53a26849'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:04.282371 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-51be90ad-221a-48a4-9817-212b566d9a1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0225f96ecf94565941735ad53a26849'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:04.283905 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-51be90ad-221a-48a4-9817-212b566d9a1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0225f96ecf94565941735ad53a26849'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:04.297439 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-51be90ad-221a-48a4-9817-212b566d9a1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0225f96ecf94565941735ad53a26849'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:04.311218 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-704945cd-8fb2-421d-a794-2cc846ef7d28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd673b7d1878a458ebbb964d637e2f4c3', 'request_id': 'req-704945cd-8fb2-421d-a794-2cc846ef7d28'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:04.337356 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 885/1769] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:35:02 2022] DELETE /identity/v3/users/d0225f96ecf94565941735ad53a26849 => generated 0 bytes in 1405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:35:04.345846 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1376f5-cd22-4d2f-9444-c301ac9d2996 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:04.346137 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1376f5-cd22-4d2f-9444-c301ac9d2996 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:04.346413 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1376f5-cd22-4d2f-9444-c301ac9d2996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:04.389787 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-7f1376f5-cd22-4d2f-9444-c301ac9d2996 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:04.391237 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-7f1376f5-cd22-4d2f-9444-c301ac9d2996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:04.474545 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 886/1770] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:35:04.490782 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1376f5-cd22-4d2f-9444-c301ac9d2996 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:04.493975 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-7f1376f5-cd22-4d2f-9444-c301ac9d2996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:04.598700 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1376f5-cd22-4d2f-9444-c301ac9d2996 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:04.603226 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4642b12-9d8f-4ed0-8348-4926b0e5ce33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:04.604221 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4642b12-9d8f-4ed0-8348-4926b0e5ce33 service neutron] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:04.610320 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4642b12-9d8f-4ed0-8348-4926b0e5ce33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:04.610320 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4642b12-9d8f-4ed0-8348-4926b0e5ce33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:04.617076 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4642b12-9d8f-4ed0-8348-4926b0e5ce33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:04.618533 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4642b12-9d8f-4ed0-8348-4926b0e5ce33 service neutron] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:04.630958 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-704945cd-8fb2-421d-a794-2cc846ef7d28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd673b7d1878a458ebbb964d637e2f4c3', 'request_id': 'req-704945cd-8fb2-421d-a794-2cc846ef7d28'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:04.661137 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 887/1771] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:35:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 09:35:04.661825 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-704945cd-8fb2-421d-a794-2cc846ef7d28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd673b7d1878a458ebbb964d637e2f4c3', 'request_id': 'req-704945cd-8fb2-421d-a794-2cc846ef7d28'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:04.687427 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-704945cd-8fb2-421d-a794-2cc846ef7d28 admin admin] The token cache is being invalidate because project d673b7d1878a458ebbb964d637e2f4c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:35:04.688889 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-704945cd-8fb2-421d-a794-2cc846ef7d28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:04.694255 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-704945cd-8fb2-421d-a794-2cc846ef7d28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:04.696399 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 885/1772] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:35:03 2022] DELETE /identity/v3/projects/d673b7d1878a458ebbb964d637e2f4c3 => generated 0 bytes in 834 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:35:04.702429 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4642b12-9d8f-4ed0-8348-4926b0e5ce33 service neutron] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:04.706220 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-c4642b12-9d8f-4ed0-8348-4926b0e5ce33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:04.747251 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4642b12-9d8f-4ed0-8348-4926b0e5ce33 service neutron] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:04.755491 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8eb5c2-a714-49fc-82cf-d93173c01350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:04.757411 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8eb5c2-a714-49fc-82cf-d93173c01350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:04.757788 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8eb5c2-a714-49fc-82cf-d93173c01350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:04.758262 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8eb5c2-a714-49fc-82cf-d93173c01350 admin admin] PATH_INFO: `/v3/users/3fe6460f24ab4eb9a818ec5090fcfdac` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:04.760093 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8eb5c2-a714-49fc-82cf-d93173c01350 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fe6460f24ab4eb9a818ec5090fcfdac)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:04.762940 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8eb5c2-a714-49fc-82cf-d93173c01350 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:04.839889 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704945cd-8fb2-421d-a794-2cc846ef7d28 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:04.841533 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-704945cd-8fb2-421d-a794-2cc846ef7d28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:04.966602 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704945cd-8fb2-421d-a794-2cc846ef7d28 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:04.971642 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f56417c-3bbb-4fbf-8c1d-588531f85391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:04.972623 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56417c-3bbb-4fbf-8c1d-588531f85391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:04.976710 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56417c-3bbb-4fbf-8c1d-588531f85391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:04.976710 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56417c-3bbb-4fbf-8c1d-588531f85391 admin admin] PATH_INFO: `/v3/projects/670abd28891b4e398972bcac9bcabb78` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:04.978432 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f56417c-3bbb-4fbf-8c1d-588531f85391 admin admin] RBAC: Authorizing `identity:delete_project(project_id=670abd28891b4e398972bcac9bcabb78)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:04.981391 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f56417c-3bbb-4fbf-8c1d-588531f85391 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:05.247821 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-2b8eb5c2-a714-49fc-82cf-d93173c01350 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fe6460f24ab4eb9a818ec5090fcfdac'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:05.250358 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-2b8eb5c2-a714-49fc-82cf-d93173c01350 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fe6460f24ab4eb9a818ec5090fcfdac'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:05.304349 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-4f56417c-3bbb-4fbf-8c1d-588531f85391 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '670abd28891b4e398972bcac9bcabb78', 'request_id': 'req-4f56417c-3bbb-4fbf-8c1d-588531f85391'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:05.545307 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-2b8eb5c2-a714-49fc-82cf-d93173c01350 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fe6460f24ab4eb9a818ec5090fcfdac'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:05.546022 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-2b8eb5c2-a714-49fc-82cf-d93173c01350 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fe6460f24ab4eb9a818ec5090fcfdac'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:05.556153 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-2b8eb5c2-a714-49fc-82cf-d93173c01350 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fe6460f24ab4eb9a818ec5090fcfdac'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:05.584187 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 888/1773] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:35:04 2022] DELETE /identity/v3/users/3fe6460f24ab4eb9a818ec5090fcfdac => generated 0 bytes in 878 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:35:05.585459 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8eb5c2-a714-49fc-82cf-d93173c01350 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:05.588459 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-2b8eb5c2-a714-49fc-82cf-d93173c01350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:05.641596 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-4f56417c-3bbb-4fbf-8c1d-588531f85391 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '670abd28891b4e398972bcac9bcabb78', 'request_id': 'req-4f56417c-3bbb-4fbf-8c1d-588531f85391'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:05.659341 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-4f56417c-3bbb-4fbf-8c1d-588531f85391 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '670abd28891b4e398972bcac9bcabb78', 'request_id': 'req-4f56417c-3bbb-4fbf-8c1d-588531f85391'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:05.689854 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-4f56417c-3bbb-4fbf-8c1d-588531f85391 admin admin] The token cache is being invalidate because project 670abd28891b4e398972bcac9bcabb78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:35:05.690703 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-4f56417c-3bbb-4fbf-8c1d-588531f85391 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:05.692862 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-4f56417c-3bbb-4fbf-8c1d-588531f85391 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:05.696997 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 886/1774] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:35:04 2022] DELETE /identity/v3/projects/670abd28891b4e398972bcac9bcabb78 => generated 0 bytes in 857 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:35:05.708396 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f56417c-3bbb-4fbf-8c1d-588531f85391 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:05.710663 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-4f56417c-3bbb-4fbf-8c1d-588531f85391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:05.750932 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8eb5c2-a714-49fc-82cf-d93173c01350 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:05.756713 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f51b9c-e40b-4042-b0bc-a659789b348a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:05.757601 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f51b9c-e40b-4042-b0bc-a659789b348a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:05.757884 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f51b9c-e40b-4042-b0bc-a659789b348a admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:05.758162 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f51b9c-e40b-4042-b0bc-a659789b348a admin admin] PATH_INFO: `/v3/projects/db923466cf984f5b8a8ad732373a6120` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:05.769187 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f51b9c-e40b-4042-b0bc-a659789b348a admin admin] RBAC: Authorizing `identity:delete_project(project_id=db923466cf984f5b8a8ad732373a6120)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:05.771287 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f51b9c-e40b-4042-b0bc-a659789b348a admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:05.865116 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f56417c-3bbb-4fbf-8c1d-588531f85391 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:05.874809 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994e1ac3-c7cf-406e-96ca-af59c5706c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:05.877233 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e1ac3-c7cf-406e-96ca-af59c5706c9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:05.877809 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e1ac3-c7cf-406e-96ca-af59c5706c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:05.878102 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e1ac3-c7cf-406e-96ca-af59c5706c9d admin admin] PATH_INFO: `/v3/users/f24b1ddf56554100beb36f2d3a5d3d81` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:05.880150 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994e1ac3-c7cf-406e-96ca-af59c5706c9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f24b1ddf56554100beb36f2d3a5d3d81)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:05.888577 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994e1ac3-c7cf-406e-96ca-af59c5706c9d admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:05.947403 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-23f51b9c-e40b-4042-b0bc-a659789b348a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db923466cf984f5b8a8ad732373a6120', 'request_id': 'req-23f51b9c-e40b-4042-b0bc-a659789b348a'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:05.985406 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:06.065722 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-23f51b9c-e40b-4042-b0bc-a659789b348a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db923466cf984f5b8a8ad732373a6120', 'request_id': 'req-23f51b9c-e40b-4042-b0bc-a659789b348a'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:06.079859 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-23f51b9c-e40b-4042-b0bc-a659789b348a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db923466cf984f5b8a8ad732373a6120', 'request_id': 'req-23f51b9c-e40b-4042-b0bc-a659789b348a'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:06.089021 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-23f51b9c-e40b-4042-b0bc-a659789b348a admin admin] The token cache is being invalidate because project db923466cf984f5b8a8ad732373a6120 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:35:06.089631 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-23f51b9c-e40b-4042-b0bc-a659789b348a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:06.090508 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-23f51b9c-e40b-4042-b0bc-a659789b348a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:06.092956 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 889/1775] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:35:05 2022] DELETE /identity/v3/projects/db923466cf984f5b8a8ad732373a6120 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:35:06.109171 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651934f-8b37-4791-91ce-545f4a869126 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:06.109171 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651934f-8b37-4791-91ce-545f4a869126 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:06.109171 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651934f-8b37-4791-91ce-545f4a869126 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:06.115988 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 890/1776] 10.222.0.62 () {54 vars in 921 bytes} [Mon Jun 27 09:35:06 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:35:06.130383 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb6607-be8c-4a83-a6f1-23a723cc5a67 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:06.137989 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb6607-be8c-4a83-a6f1-23a723cc5a67 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:06.137989 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb6607-be8c-4a83-a6f1-23a723cc5a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:06.138229 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-994e1ac3-c7cf-406e-96ca-af59c5706c9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f24b1ddf56554100beb36f2d3a5d3d81'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:06.159840 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-9afb6607-be8c-4a83-a6f1-23a723cc5a67 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:06.161731 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-9afb6607-be8c-4a83-a6f1-23a723cc5a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:06.166665 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-994e1ac3-c7cf-406e-96ca-af59c5706c9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f24b1ddf56554100beb36f2d3a5d3d81'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:06.260249 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 891/1777] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:35:06.260249 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb6607-be8c-4a83-a6f1-23a723cc5a67 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:06.260249 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-9afb6607-be8c-4a83-a6f1-23a723cc5a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:06.277244 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb6607-be8c-4a83-a6f1-23a723cc5a67 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:06.279869 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb28e1-3fc4-41bb-9c1a-16e2635a80d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:06.280890 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb28e1-3fc4-41bb-9c1a-16e2635a80d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:06.281212 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb28e1-3fc4-41bb-9c1a-16e2635a80d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:06.281565 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb28e1-3fc4-41bb-9c1a-16e2635a80d5 admin admin] PATH_INFO: `/v3/projects/f334edfead2746c2bff58f9b8de38590` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:06.283320 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebb28e1-3fc4-41bb-9c1a-16e2635a80d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f334edfead2746c2bff58f9b8de38590)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:06.286249 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebb28e1-3fc4-41bb-9c1a-16e2635a80d5 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:06.350546 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-994e1ac3-c7cf-406e-96ca-af59c5706c9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f24b1ddf56554100beb36f2d3a5d3d81'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:06.354831 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-994e1ac3-c7cf-406e-96ca-af59c5706c9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f24b1ddf56554100beb36f2d3a5d3d81'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:06.377509 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-994e1ac3-c7cf-406e-96ca-af59c5706c9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f24b1ddf56554100beb36f2d3a5d3d81'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:06.389964 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 887/1778] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:35:05 2022] DELETE /identity/v3/users/f24b1ddf56554100beb36f2d3a5d3d81 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:35:06.392223 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f88fd6-1f17-4ab8-8f90-e9c0fe9faca7 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:06.392919 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f88fd6-1f17-4ab8-8f90-e9c0fe9faca7 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:06.398491 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f88fd6-1f17-4ab8-8f90-e9c0fe9faca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:06.425315 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-56f88fd6-1f17-4ab8-8f90-e9c0fe9faca7 None None] MFA Rules not processed for user `2c1434a85b30411c9c59cc50c3980cd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:06.427875 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-56f88fd6-1f17-4ab8-8f90-e9c0fe9faca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:06.544924 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-bebb28e1-3fc4-41bb-9c1a-16e2635a80d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f334edfead2746c2bff58f9b8de38590', 'request_id': 'req-bebb28e1-3fc4-41bb-9c1a-16e2635a80d5'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:06.567119 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 888/1779] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Jun 27 09:35:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:35:06.568810 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6d4b0-2b2a-43b0-a839-644551a6b551 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:06.569245 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6d4b0-2b2a-43b0-a839-644551a6b551 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:06.569370 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6d4b0-2b2a-43b0-a839-644551a6b551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:06.595326 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-19a6d4b0-2b2a-43b0-a839-644551a6b551 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:06.596599 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-19a6d4b0-2b2a-43b0-a839-644551a6b551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:06.699626 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 889/1780] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:35:06.699626 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6d4b0-2b2a-43b0-a839-644551a6b551 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:06.705737 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-19a6d4b0-2b2a-43b0-a839-644551a6b551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:06.806284 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-bebb28e1-3fc4-41bb-9c1a-16e2635a80d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f334edfead2746c2bff58f9b8de38590', 'request_id': 'req-bebb28e1-3fc4-41bb-9c1a-16e2635a80d5'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:06.817005 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-bebb28e1-3fc4-41bb-9c1a-16e2635a80d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f334edfead2746c2bff58f9b8de38590', 'request_id': 'req-bebb28e1-3fc4-41bb-9c1a-16e2635a80d5'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:06.846790 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-bebb28e1-3fc4-41bb-9c1a-16e2635a80d5 admin admin] The token cache is being invalidate because project f334edfead2746c2bff58f9b8de38590 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:35:06.854873 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-bebb28e1-3fc4-41bb-9c1a-16e2635a80d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:06.854873 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-bebb28e1-3fc4-41bb-9c1a-16e2635a80d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:06.855178 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6d4b0-2b2a-43b0-a839-644551a6b551 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:06.855275 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 892/1781] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:35:06 2022] DELETE /identity/v3/projects/f334edfead2746c2bff58f9b8de38590 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:35:06.855275 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb28e1-3fc4-41bb-9c1a-16e2635a80d5 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:06.855275 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-bebb28e1-3fc4-41bb-9c1a-16e2635a80d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:06.866651 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db01bf7-9b5e-4b46-b036-450f088f046f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:06.867326 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db01bf7-9b5e-4b46-b036-450f088f046f service nova] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:06.867610 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db01bf7-9b5e-4b46-b036-450f088f046f service nova] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:06.868829 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db01bf7-9b5e-4b46-b036-450f088f046f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:06.870832 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-7db01bf7-9b5e-4b46-b036-450f088f046f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:06.889800 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db01bf7-9b5e-4b46-b036-450f088f046f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:06.891644 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db01bf7-9b5e-4b46-b036-450f088f046f service nova] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:06.894096 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb28e1-3fc4-41bb-9c1a-16e2635a80d5 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:06.909142 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 890/1782] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:35:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:35:06.910041 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db01bf7-9b5e-4b46-b036-450f088f046f service nova] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:06.913008 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-7db01bf7-9b5e-4b46-b036-450f088f046f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:06.920980 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974712f7-cb60-40b8-9127-ff057d049202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:06.921991 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974712f7-cb60-40b8-9127-ff057d049202 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:06.922285 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974712f7-cb60-40b8-9127-ff057d049202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:06.922563 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974712f7-cb60-40b8-9127-ff057d049202 admin admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:06.923313 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974712f7-cb60-40b8-9127-ff057d049202 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:35:06.923720 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974712f7-cb60-40b8-9127-ff057d049202 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:06.925609 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974712f7-cb60-40b8-9127-ff057d049202 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:06.956135 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 893/1783] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:35:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:35:06.958248 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974712f7-cb60-40b8-9127-ff057d049202 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:06.964614 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-974712f7-cb60-40b8-9127-ff057d049202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:06.984104 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db01bf7-9b5e-4b46-b036-450f088f046f service nova] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:06.995061 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974712f7-cb60-40b8-9127-ff057d049202 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:06.997188 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bbbb85-ead5-4be5-841d-19d470c63c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:07.000124 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbbb85-ead5-4be5-841d-19d470c63c05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:07.000693 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbbb85-ead5-4be5-841d-19d470c63c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:07.001591 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbbb85-ead5-4be5-841d-19d470c63c05 admin admin] PATH_INFO: `/v3/projects/cb98f414bd1545808f064ff3be44e50b` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:07.004740 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bbbb85-ead5-4be5-841d-19d470c63c05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb98f414bd1545808f064ff3be44e50b)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:07.007930 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bbbb85-ead5-4be5-841d-19d470c63c05 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:07.011414 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc1d1fb-35f2-43a9-8baf-b6094609e5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:07.012525 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1d1fb-35f2-43a9-8baf-b6094609e5bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:07.012810 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1d1fb-35f2-43a9-8baf-b6094609e5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:07.013087 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1d1fb-35f2-43a9-8baf-b6094609e5bf admin admin] PATH_INFO: `/v3/users/56f1e553397d48aaaa9d311dfd2a618d` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:07.018103 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc1d1fb-35f2-43a9-8baf-b6094609e5bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=56f1e553397d48aaaa9d311dfd2a618d)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:07.020333 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc1d1fb-35f2-43a9-8baf-b6094609e5bf admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:07.020979 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:07.790247 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-07bbbb85-ead5-4be5-841d-19d470c63c05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb98f414bd1545808f064ff3be44e50b', 'request_id': 'req-07bbbb85-ead5-4be5-841d-19d470c63c05'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:07.796040 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-4fc1d1fb-35f2-43a9-8baf-b6094609e5bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56f1e553397d48aaaa9d311dfd2a618d'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:07.798137 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-4fc1d1fb-35f2-43a9-8baf-b6094609e5bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56f1e553397d48aaaa9d311dfd2a618d'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:08.057869 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-07bbbb85-ead5-4be5-841d-19d470c63c05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb98f414bd1545808f064ff3be44e50b', 'request_id': 'req-07bbbb85-ead5-4be5-841d-19d470c63c05'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:08.064027 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-07bbbb85-ead5-4be5-841d-19d470c63c05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb98f414bd1545808f064ff3be44e50b', 'request_id': 'req-07bbbb85-ead5-4be5-841d-19d470c63c05'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:08.085051 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-07bbbb85-ead5-4be5-841d-19d470c63c05 admin admin] The token cache is being invalidate because project cb98f414bd1545808f064ff3be44e50b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:35:08.085497 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-07bbbb85-ead5-4be5-841d-19d470c63c05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:08.086284 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-07bbbb85-ead5-4be5-841d-19d470c63c05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:08.089317 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 891/1784] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:35:06 2022] DELETE /identity/v3/projects/cb98f414bd1545808f064ff3be44e50b => generated 0 bytes in 1178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:35:08.091409 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bbbb85-ead5-4be5-841d-19d470c63c05 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:08.092663 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-07bbbb85-ead5-4be5-841d-19d470c63c05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:08.114629 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-4fc1d1fb-35f2-43a9-8baf-b6094609e5bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56f1e553397d48aaaa9d311dfd2a618d'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:08.117919 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-4fc1d1fb-35f2-43a9-8baf-b6094609e5bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56f1e553397d48aaaa9d311dfd2a618d'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:08.132048 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-4fc1d1fb-35f2-43a9-8baf-b6094609e5bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56f1e553397d48aaaa9d311dfd2a618d'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:08.155015 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 894/1785] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:35:06 2022] DELETE /identity/v3/users/56f1e553397d48aaaa9d311dfd2a618d => generated 0 bytes in 1198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:35:08.156091 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc1d1fb-35f2-43a9-8baf-b6094609e5bf admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:08.161264 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-4fc1d1fb-35f2-43a9-8baf-b6094609e5bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:08.215546 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bbbb85-ead5-4be5-841d-19d470c63c05 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:08.291474 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc1d1fb-35f2-43a9-8baf-b6094609e5bf admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:08.299826 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae3563-bb0c-4ed9-8fd6-62bfdafa239b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:08.300774 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae3563-bb0c-4ed9-8fd6-62bfdafa239b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:08.301061 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae3563-bb0c-4ed9-8fd6-62bfdafa239b admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:08.301343 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae3563-bb0c-4ed9-8fd6-62bfdafa239b admin admin] PATH_INFO: `/v3/projects/f586faaa25bb4ca3a6f8dd404ae37aa2` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:08.302585 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae3563-bb0c-4ed9-8fd6-62bfdafa239b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f586faaa25bb4ca3a6f8dd404ae37aa2)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:08.303844 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac6cff8-8387-4082-8bf7-17b633285606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:08.304630 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6cff8-8387-4082-8bf7-17b633285606 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:08.304753 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae3563-bb0c-4ed9-8fd6-62bfdafa239b admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:08.304975 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6cff8-8387-4082-8bf7-17b633285606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:08.305259 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6cff8-8387-4082-8bf7-17b633285606 admin admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:08.305984 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac6cff8-8387-4082-8bf7-17b633285606 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:08.307966 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac6cff8-8387-4082-8bf7-17b633285606 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:08.353922 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:08.418045 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 892/1786] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:35:08 2022] POST /identity/v3/projects => generated 373 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:35:08.419591 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60350c-de46-4064-b51b-2581d5c409cc None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:08.419882 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60350c-de46-4064-b51b-2581d5c409cc None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:08.420156 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60350c-de46-4064-b51b-2581d5c409cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:08.435381 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-b1ae3563-bb0c-4ed9-8fd6-62bfdafa239b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f586faaa25bb4ca3a6f8dd404ae37aa2', 'request_id': 'req-b1ae3563-bb0c-4ed9-8fd6-62bfdafa239b'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:08.449633 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-3c60350c-de46-4064-b51b-2581d5c409cc None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:08.450367 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-3c60350c-de46-4064-b51b-2581d5c409cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:08.516788 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-b1ae3563-bb0c-4ed9-8fd6-62bfdafa239b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f586faaa25bb4ca3a6f8dd404ae37aa2', 'request_id': 'req-b1ae3563-bb0c-4ed9-8fd6-62bfdafa239b'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:08.532716 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-b1ae3563-bb0c-4ed9-8fd6-62bfdafa239b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f586faaa25bb4ca3a6f8dd404ae37aa2', 'request_id': 'req-b1ae3563-bb0c-4ed9-8fd6-62bfdafa239b'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:08.539050 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 893/1787] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:35:08.540560 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60350c-de46-4064-b51b-2581d5c409cc None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:08.546097 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-3c60350c-de46-4064-b51b-2581d5c409cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:08.552887 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-b1ae3563-bb0c-4ed9-8fd6-62bfdafa239b admin admin] The token cache is being invalidate because project f586faaa25bb4ca3a6f8dd404ae37aa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:35:08.553510 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-b1ae3563-bb0c-4ed9-8fd6-62bfdafa239b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:08.554448 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-b1ae3563-bb0c-4ed9-8fd6-62bfdafa239b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:08.557256 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 895/1788] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:35:08 2022] DELETE /identity/v3/projects/f586faaa25bb4ca3a6f8dd404ae37aa2 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:35:08.558896 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182fdc1-3248-4f8a-b451-293be8896f5e None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:08.562246 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182fdc1-3248-4f8a-b451-293be8896f5e None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:08.568613 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182fdc1-3248-4f8a-b451-293be8896f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:08.573775 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60350c-de46-4064-b51b-2581d5c409cc None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:08.579441 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207714c6-9966-459f-80a9-2c23c360151c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:08.580344 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207714c6-9966-459f-80a9-2c23c360151c admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:08.580709 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207714c6-9966-459f-80a9-2c23c360151c admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:08.581055 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207714c6-9966-459f-80a9-2c23c360151c admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:08.582830 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207714c6-9966-459f-80a9-2c23c360151c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:08.585079 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207714c6-9966-459f-80a9-2c23c360151c admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:08.599514 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-c182fdc1-3248-4f8a-b451-293be8896f5e None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:08.600774 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-c182fdc1-3248-4f8a-b451-293be8896f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:08.609794 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 896/1789] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:35:08.611081 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4906633-5f41-41d5-8289-35cf0b91e66c None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:08.611368 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4906633-5f41-41d5-8289-35cf0b91e66c None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:08.611654 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4906633-5f41-41d5-8289-35cf0b91e66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:08.630179 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-a4906633-5f41-41d5-8289-35cf0b91e66c None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:08.631390 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-a4906633-5f41-41d5-8289-35cf0b91e66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:08.640394 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 897/1790] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:35:08.641318 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4906633-5f41-41d5-8289-35cf0b91e66c None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:08.651747 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4906633-5f41-41d5-8289-35cf0b91e66c None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:08.656717 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d7ca3-4a6e-4ea7-9a68-5495cc3d69e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:08.657415 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d7ca3-4a6e-4ea7-9a68-5495cc3d69e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:08.657697 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d7ca3-4a6e-4ea7-9a68-5495cc3d69e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:08.658130 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d7ca3-4a6e-4ea7-9a68-5495cc3d69e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:08.658875 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d7ca3-4a6e-4ea7-9a68-5495cc3d69e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:35:08.659186 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d7ca3-4a6e-4ea7-9a68-5495cc3d69e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:08.660905 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d7ca3-4a6e-4ea7-9a68-5495cc3d69e9 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:08.678789 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 898/1791] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:35:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:35:08.682199 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 894/1792] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:35:08 2022] POST /identity/v3/users => generated 287 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:35:08.682446 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2917c2d-4dc7-4f5d-901b-d770b5013d84 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:08.682446 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2917c2d-4dc7-4f5d-901b-d770b5013d84 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:08.682446 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2917c2d-4dc7-4f5d-901b-d770b5013d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:08.682637 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207714c6-9966-459f-80a9-2c23c360151c admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:08.689420 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-207714c6-9966-459f-80a9-2c23c360151c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:08.704501 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-a2917c2d-4dc7-4f5d-901b-d770b5013d84 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:08.705995 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-a2917c2d-4dc7-4f5d-901b-d770b5013d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:08.715827 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207714c6-9966-459f-80a9-2c23c360151c admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:08.718027 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 899/1793] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:35:08.721650 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a42f05-2815-4f20-9a30-d7d2007aae37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:08.727717 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2917c2d-4dc7-4f5d-901b-d770b5013d84 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:08.727833 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a42f05-2815-4f20-9a30-d7d2007aae37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:08.727833 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a42f05-2815-4f20-9a30-d7d2007aae37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:08.727833 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a42f05-2815-4f20-9a30-d7d2007aae37 admin admin] PATH_INFO: `/v3/projects/aeaf9951896946468fde68a6ce41eb82` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:08.727833 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a42f05-2815-4f20-9a30-d7d2007aae37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aeaf9951896946468fde68a6ce41eb82)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:08.727833 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a42f05-2815-4f20-9a30-d7d2007aae37 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:08.737322 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2917c2d-4dc7-4f5d-901b-d770b5013d84 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:08.755142 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d9d56-22e6-45cb-aabe-7d931b2c1e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:08.755866 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d9d56-22e6-45cb-aabe-7d931b2c1e14 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:08.758081 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d9d56-22e6-45cb-aabe-7d931b2c1e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:08.758081 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d9d56-22e6-45cb-aabe-7d931b2c1e14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:08.758081 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d9d56-22e6-45cb-aabe-7d931b2c1e14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:08.759115 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d9d56-22e6-45cb-aabe-7d931b2c1e14 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:08.857494 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-c5a42f05-2815-4f20-9a30-d7d2007aae37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aeaf9951896946468fde68a6ce41eb82', 'request_id': 'req-c5a42f05-2815-4f20-9a30-d7d2007aae37'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:08.897758 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 900/1794] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:35:08 2022] POST /identity/v3/projects => generated 385 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:35:08.898599 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d9d56-22e6-45cb-aabe-7d931b2c1e14 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:08.900339 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-303d9d56-22e6-45cb-aabe-7d931b2c1e14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:08.964296 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d9d56-22e6-45cb-aabe-7d931b2c1e14 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:08.968934 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32650fd-301c-415a-a7d3-492068ae524f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:08.969633 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32650fd-301c-415a-a7d3-492068ae524f admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:08.969921 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32650fd-301c-415a-a7d3-492068ae524f admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:08.970201 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32650fd-301c-415a-a7d3-492068ae524f admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:08.970930 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32650fd-301c-415a-a7d3-492068ae524f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:08.971025 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-c5a42f05-2815-4f20-9a30-d7d2007aae37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aeaf9951896946468fde68a6ce41eb82', 'request_id': 'req-c5a42f05-2815-4f20-9a30-d7d2007aae37'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:08.972578 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32650fd-301c-415a-a7d3-492068ae524f admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:08.978373 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-c5a42f05-2815-4f20-9a30-d7d2007aae37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aeaf9951896946468fde68a6ce41eb82', 'request_id': 'req-c5a42f05-2815-4f20-9a30-d7d2007aae37'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:08.982496 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 901/1795] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:35:08.983335 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32650fd-301c-415a-a7d3-492068ae524f admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:08.992953 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-c5a42f05-2815-4f20-9a30-d7d2007aae37 admin admin] The token cache is being invalidate because project aeaf9951896946468fde68a6ce41eb82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:35:08.993166 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-c5a42f05-2815-4f20-9a30-d7d2007aae37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:08.994079 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-c5a42f05-2815-4f20-9a30-d7d2007aae37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:08.994473 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32650fd-301c-415a-a7d3-492068ae524f admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:08.996212 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 895/1796] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:35:08 2022] DELETE /identity/v3/projects/aeaf9951896946468fde68a6ce41eb82 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:35:08.997034 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a42f05-2815-4f20-9a30-d7d2007aae37 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:08.998555 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-c5a42f05-2815-4f20-9a30-d7d2007aae37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:08.999725 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b3476-fc8a-47d8-9cf4-502a56d6b7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:09.000412 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b3476-fc8a-47d8-9cf4-502a56d6b7e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:09.000698 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b3476-fc8a-47d8-9cf4-502a56d6b7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:09.000972 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b3476-fc8a-47d8-9cf4-502a56d6b7e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:09.001694 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08b3476-fc8a-47d8-9cf4-502a56d6b7e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:35:09.002001 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08b3476-fc8a-47d8-9cf4-502a56d6b7e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:09.003600 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08b3476-fc8a-47d8-9cf4-502a56d6b7e2 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:09.016750 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 902/1797] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:35:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:35:09.017636 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b3476-fc8a-47d8-9cf4-502a56d6b7e2 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:09.019389 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-d08b3476-fc8a-47d8-9cf4-502a56d6b7e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:09.033861 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b3476-fc8a-47d8-9cf4-502a56d6b7e2 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:09.038459 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c104313c-8e41-4ea9-8ad1-33237fd19148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:09.039111 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104313c-8e41-4ea9-8ad1-33237fd19148 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:09.039396 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104313c-8e41-4ea9-8ad1-33237fd19148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:09.039676 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104313c-8e41-4ea9-8ad1-33237fd19148 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:09.040431 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c104313c-8e41-4ea9-8ad1-33237fd19148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:09.042055 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c104313c-8e41-4ea9-8ad1-33237fd19148 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:09.051831 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 903/1798] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:35:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:35:09.055374 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4548ddc-2d0c-4c4f-a215-6bb896288f9f None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:09.055374 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4548ddc-2d0c-4c4f-a215-6bb896288f9f None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:09.055374 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4548ddc-2d0c-4c4f-a215-6bb896288f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:09.063698 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a42f05-2815-4f20-9a30-d7d2007aae37 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:09.068691 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6035a4fd-024e-4a2c-b469-ca92e5b3bf69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:09.069392 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035a4fd-024e-4a2c-b469-ca92e5b3bf69 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:09.069672 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035a4fd-024e-4a2c-b469-ca92e5b3bf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:09.069945 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035a4fd-024e-4a2c-b469-ca92e5b3bf69 admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:09.070626 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6035a4fd-024e-4a2c-b469-ca92e5b3bf69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:09.071597 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-b4548ddc-2d0c-4c4f-a215-6bb896288f9f None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:09.072652 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6035a4fd-024e-4a2c-b469-ca92e5b3bf69 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:09.073538 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-b4548ddc-2d0c-4c4f-a215-6bb896288f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:09.081776 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 904/1799] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:35:09.083180 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4548ddc-2d0c-4c4f-a215-6bb896288f9f None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:09.085500 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-b4548ddc-2d0c-4c4f-a215-6bb896288f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:09.096101 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4548ddc-2d0c-4c4f-a215-6bb896288f9f None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:09.100631 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5125a8af-850f-4724-b39e-cfb3e079a7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:09.101267 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125a8af-850f-4724-b39e-cfb3e079a7d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:09.101548 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125a8af-850f-4724-b39e-cfb3e079a7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:09.101823 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125a8af-850f-4724-b39e-cfb3e079a7d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:09.102694 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5125a8af-850f-4724-b39e-cfb3e079a7d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:09.104935 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5125a8af-850f-4724-b39e-cfb3e079a7d5 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:09.161873 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 896/1800] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:35:08 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:35:09.162694 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6035a4fd-024e-4a2c-b469-ca92e5b3bf69 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:09.172150 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6035a4fd-024e-4a2c-b469-ca92e5b3bf69 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:09.176813 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c4b8d3-80a3-411c-bb9f-e61add609321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:09.177693 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4b8d3-80a3-411c-bb9f-e61add609321 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:09.177971 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4b8d3-80a3-411c-bb9f-e61add609321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:09.178259 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4b8d3-80a3-411c-bb9f-e61add609321 admin admin] PATH_INFO: `/v3/projects/dba2f153ca744fdba30acdc938dec88f/users/2a57abee26714847b5cf06e6c67d303a/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:09.188216 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 905/1801] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:35:09 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:35:09.188216 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8ccbc-72dc-47e7-9bfc-adeb17b0779e None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:09.191059 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8ccbc-72dc-47e7-9bfc-adeb17b0779e None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:09.191059 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8ccbc-72dc-47e7-9bfc-adeb17b0779e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:09.194349 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c4b8d3-80a3-411c-bb9f-e61add609321 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dba2f153ca744fdba30acdc938dec88f, user_id=2a57abee26714847b5cf06e6c67d303a, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:09.197077 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c4b8d3-80a3-411c-bb9f-e61add609321 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:09.208276 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-77d8ccbc-72dc-47e7-9bfc-adeb17b0779e None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:09.211871 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-77d8ccbc-72dc-47e7-9bfc-adeb17b0779e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:09.270051 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 906/1802] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:35:09.271055 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d8ccbc-72dc-47e7-9bfc-adeb17b0779e None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:09.277315 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 897/1803] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:35:09 2022] PUT /identity/v3/projects/dba2f153ca744fdba30acdc938dec88f/users/2a57abee26714847b5cf06e6c67d303a/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:35:09.278715 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c4b8d3-80a3-411c-bb9f-e61add609321 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:09.280558 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d8ccbc-72dc-47e7-9bfc-adeb17b0779e None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:09.350363 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c4b8d3-80a3-411c-bb9f-e61add609321 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:09.351918 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569420d-8756-491b-8143-2073012dd57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:09.352823 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569420d-8756-491b-8143-2073012dd57f admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:09.353101 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569420d-8756-491b-8143-2073012dd57f admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:09.353375 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569420d-8756-491b-8143-2073012dd57f admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:09.354660 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6569420d-8756-491b-8143-2073012dd57f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:09.354776 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:09.356641 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6569420d-8756-491b-8143-2073012dd57f admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:09.358280 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d0ef4-017a-4ab5-a2f6-9c1cc9d920d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:09.358957 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d0ef4-017a-4ab5-a2f6-9c1cc9d920d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:09.359232 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d0ef4-017a-4ab5-a2f6-9c1cc9d920d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:09.359503 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d0ef4-017a-4ab5-a2f6-9c1cc9d920d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:09.360301 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d0ef4-017a-4ab5-a2f6-9c1cc9d920d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:09.366567 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d0ef4-017a-4ab5-a2f6-9c1cc9d920d4 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:09.368117 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 907/1804] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:35:09 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:35:09.368878 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569420d-8756-491b-8143-2073012dd57f admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:09.379523 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569420d-8756-491b-8143-2073012dd57f admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:09.387742 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4f032-5f28-47ea-a58c-ffc0aa2b94f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:09.388453 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4f032-5f28-47ea-a58c-ffc0aa2b94f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:09.388737 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4f032-5f28-47ea-a58c-ffc0aa2b94f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:09.389015 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4f032-5f28-47ea-a58c-ffc0aa2b94f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:09.389778 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f4f032-5f28-47ea-a58c-ffc0aa2b94f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:35:09.390087 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f4f032-5f28-47ea-a58c-ffc0aa2b94f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:09.391876 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f4f032-5f28-47ea-a58c-ffc0aa2b94f4 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:09.405106 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 908/1805] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:35:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:35:09.406375 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387b2b9-5b8c-42f3-a5f1-b22a3a419d26 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:09.406663 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387b2b9-5b8c-42f3-a5f1-b22a3a419d26 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:09.407450 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387b2b9-5b8c-42f3-a5f1-b22a3a419d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:09.436734 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-b387b2b9-5b8c-42f3-a5f1-b22a3a419d26 None None] MFA Rules not processed for user `2a57abee26714847b5cf06e6c67d303a`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:09.437972 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-b387b2b9-5b8c-42f3-a5f1-b22a3a419d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:09.485051 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 898/1806] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:35:09 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:35:09.485051 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d0ef4-017a-4ab5-a2f6-9c1cc9d920d4 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:09.493504 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d0ef4-017a-4ab5-a2f6-9c1cc9d920d4 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:09.498969 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80745555-4257-43c6-ac8d-d92ce9a7c40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:09.499565 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80745555-4257-43c6-ac8d-d92ce9a7c40b admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:09.499848 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80745555-4257-43c6-ac8d-d92ce9a7c40b admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:09.500214 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80745555-4257-43c6-ac8d-d92ce9a7c40b admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:09.500881 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80745555-4257-43c6-ac8d-d92ce9a7c40b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:09.502459 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80745555-4257-43c6-ac8d-d92ce9a7c40b admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:09.504494 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 909/1807] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:35:09.505315 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387b2b9-5b8c-42f3-a5f1-b22a3a419d26 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:09.514016 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 899/1808] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:35:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:35:09.514016 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80745555-4257-43c6-ac8d-d92ce9a7c40b admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:09.518380 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387b2b9-5b8c-42f3-a5f1-b22a3a419d26 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:09.523019 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c67a2-bb26-4875-b55a-243cd83edc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:09.523502 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80745555-4257-43c6-ac8d-d92ce9a7c40b admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:09.523671 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c67a2-bb26-4875-b55a-243cd83edc42 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:09.523955 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c67a2-bb26-4875-b55a-243cd83edc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:09.524263 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c67a2-bb26-4875-b55a-243cd83edc42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:09.524961 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c67a2-bb26-4875-b55a-243cd83edc42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:09.526960 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c67a2-bb26-4875-b55a-243cd83edc42 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:09.528322 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb809b6-831d-48e1-b26f-1d365cb0937d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:09.529008 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb809b6-831d-48e1-b26f-1d365cb0937d admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:09.529290 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb809b6-831d-48e1-b26f-1d365cb0937d admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:09.529565 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb809b6-831d-48e1-b26f-1d365cb0937d admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:09.530286 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb809b6-831d-48e1-b26f-1d365cb0937d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:09.531869 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb809b6-831d-48e1-b26f-1d365cb0937d admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:09.543615 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 900/1809] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:35:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:35:09.544695 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb809b6-831d-48e1-b26f-1d365cb0937d admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:09.555307 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb809b6-831d-48e1-b26f-1d365cb0937d admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:09.559783 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476abd50-0cda-4145-b26f-2b2da03ffa7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:09.560525 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476abd50-0cda-4145-b26f-2b2da03ffa7f admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:09.560806 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476abd50-0cda-4145-b26f-2b2da03ffa7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:09.561077 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476abd50-0cda-4145-b26f-2b2da03ffa7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:09.561782 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476abd50-0cda-4145-b26f-2b2da03ffa7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:09.563651 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476abd50-0cda-4145-b26f-2b2da03ffa7f admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:09.601120 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 910/1810] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:35:09 2022] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:35:09.601981 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c67a2-bb26-4875-b55a-243cd83edc42 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:09.661884 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c67a2-bb26-4875-b55a-243cd83edc42 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:09.667189 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0f9ae-9f2b-474b-9923-f2526424d09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:09.668073 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0f9ae-9f2b-474b-9923-f2526424d09a admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:09.668497 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0f9ae-9f2b-474b-9923-f2526424d09a admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:09.668659 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0f9ae-9f2b-474b-9923-f2526424d09a admin admin] PATH_INFO: `/v3/projects/09b258daaf764f4894dc90a4716c5bb0/users/09c6fda2efbf455eaa7dc6c93ac25968/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:09.677674 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 901/1811] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:35:09 2022] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:35:09.681527 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476abd50-0cda-4145-b26f-2b2da03ffa7f admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:09.688009 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0f9ae-9f2b-474b-9923-f2526424d09a admin admin] RBAC: Authorizing `identity:create_grant(project_id=09b258daaf764f4894dc90a4716c5bb0, user_id=09c6fda2efbf455eaa7dc6c93ac25968, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:09.691021 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0f9ae-9f2b-474b-9923-f2526424d09a admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:09.739273 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476abd50-0cda-4145-b26f-2b2da03ffa7f admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:09.744381 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430359e6-6c54-4840-951f-9d1d08b5c0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:09.745044 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430359e6-6c54-4840-951f-9d1d08b5c0fe admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:09.745326 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430359e6-6c54-4840-951f-9d1d08b5c0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:09.745604 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430359e6-6c54-4840-951f-9d1d08b5c0fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:09.746336 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430359e6-6c54-4840-951f-9d1d08b5c0fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:09.747938 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430359e6-6c54-4840-951f-9d1d08b5c0fe admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:09.765229 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 902/1812] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:35:09 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:35:09.765229 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430359e6-6c54-4840-951f-9d1d08b5c0fe admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:09.772362 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430359e6-6c54-4840-951f-9d1d08b5c0fe admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:09.776058 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 911/1813] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:35:09 2022] PUT /identity/v3/projects/09b258daaf764f4894dc90a4716c5bb0/users/09c6fda2efbf455eaa7dc6c93ac25968/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:35:09.778140 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0f9ae-9f2b-474b-9923-f2526424d09a admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:09.841962 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570a879-8268-4261-abc7-d37c136067fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:09.842997 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570a879-8268-4261-abc7-d37c136067fb admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:09.843493 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570a879-8268-4261-abc7-d37c136067fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:09.844384 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570a879-8268-4261-abc7-d37c136067fb admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:09.845132 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f570a879-8268-4261-abc7-d37c136067fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:09.847385 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f570a879-8268-4261-abc7-d37c136067fb admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:09.880179 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0f9ae-9f2b-474b-9923-f2526424d09a admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:09.884936 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc031443-7101-4035-9658-0f0651207d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:09.885636 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc031443-7101-4035-9658-0f0651207d4c admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:09.885927 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc031443-7101-4035-9658-0f0651207d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:09.886181 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc031443-7101-4035-9658-0f0651207d4c admin admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:09.886883 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc031443-7101-4035-9658-0f0651207d4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:09.888822 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc031443-7101-4035-9658-0f0651207d4c admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:09.972865 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 903/1814] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:35:09 2022] POST /identity/v3/users => generated 294 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:35:09.972865 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570a879-8268-4261-abc7-d37c136067fb admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:09.986293 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570a879-8268-4261-abc7-d37c136067fb admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:09.992261 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 912/1815] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:35:09 2022] POST /identity/v3/users => generated 293 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:35:09.992261 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f9993-5576-4a1c-bb23-3f10192a4523 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:09.992261 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f9993-5576-4a1c-bb23-3f10192a4523 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:09.992952 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f9993-5576-4a1c-bb23-3f10192a4523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:09.997380 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e786fa90-a806-453e-abad-e19fec8854a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:09.998287 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786fa90-a806-453e-abad-e19fec8854a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:09.998573 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786fa90-a806-453e-abad-e19fec8854a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:10.001768 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786fa90-a806-453e-abad-e19fec8854a8 admin admin] PATH_INFO: `/v3/projects/a9e284ef9de34d8295715e3148ed13c2/users/92f665cbd5694e4db714bdeeae9c37b3/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:10.018680 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e786fa90-a806-453e-abad-e19fec8854a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9e284ef9de34d8295715e3148ed13c2, user_id=92f665cbd5694e4db714bdeeae9c37b3, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:10.021673 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e786fa90-a806-453e-abad-e19fec8854a8 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:10.030990 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-336f9993-5576-4a1c-bb23-3f10192a4523 None None] MFA Rules not processed for user `09c6fda2efbf455eaa7dc6c93ac25968`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:10.032244 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-336f9993-5576-4a1c-bb23-3f10192a4523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:10.099367 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 913/1816] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:35:10.100066 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f9993-5576-4a1c-bb23-3f10192a4523 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:10.117811 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 904/1817] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:35:09 2022] PUT /identity/v3/projects/a9e284ef9de34d8295715e3148ed13c2/users/92f665cbd5694e4db714bdeeae9c37b3/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:35:10.117811 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e786fa90-a806-453e-abad-e19fec8854a8 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:10.120645 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f9993-5576-4a1c-bb23-3f10192a4523 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:10.181556 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:10.182276 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e786fa90-a806-453e-abad-e19fec8854a8 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:10.182849 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb1fb2-cd1d-4309-a92f-ccd713a3feae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:10.183791 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb1fb2-cd1d-4309-a92f-ccd713a3feae admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:10.184074 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb1fb2-cd1d-4309-a92f-ccd713a3feae admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:10.184386 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb1fb2-cd1d-4309-a92f-ccd713a3feae admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:10.190384 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb1fb2-cd1d-4309-a92f-ccd713a3feae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:10.190384 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb1fb2-cd1d-4309-a92f-ccd713a3feae admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:10.190599 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a90964-aa57-4601-a3f2-4628f940f4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:10.190599 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a90964-aa57-4601-a3f2-4628f940f4df admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:10.190599 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a90964-aa57-4601-a3f2-4628f940f4df admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:10.190599 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a90964-aa57-4601-a3f2-4628f940f4df admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:10.190928 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a90964-aa57-4601-a3f2-4628f940f4df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:10.191603 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a90964-aa57-4601-a3f2-4628f940f4df admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:10.200819 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 914/1818] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:35:10 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:35:10.201515 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb1fb2-cd1d-4309-a92f-ccd713a3feae admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:10.205531 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 905/1819] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:35:10 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:35:10.205531 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31c42b-f2f9-4334-8591-d5aba8d9b997 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:10.205531 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31c42b-f2f9-4334-8591-d5aba8d9b997 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:10.205531 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31c42b-f2f9-4334-8591-d5aba8d9b997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:10.211891 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb1fb2-cd1d-4309-a92f-ccd713a3feae admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:10.217221 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d09076f-7c54-494d-a489-55824bdaa767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:10.217871 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d09076f-7c54-494d-a489-55824bdaa767 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:10.218156 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d09076f-7c54-494d-a489-55824bdaa767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:10.218498 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d09076f-7c54-494d-a489-55824bdaa767 admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:10.219198 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d09076f-7c54-494d-a489-55824bdaa767 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:10.221199 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d09076f-7c54-494d-a489-55824bdaa767 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:10.231634 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-1a31c42b-f2f9-4334-8591-d5aba8d9b997 None None] MFA Rules not processed for user `92f665cbd5694e4db714bdeeae9c37b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:10.232892 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-1a31c42b-f2f9-4334-8591-d5aba8d9b997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:10.299441 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 906/1820] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:35:10.303440 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a31c42b-f2f9-4334-8591-d5aba8d9b997 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:10.314271 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a31c42b-f2f9-4334-8591-d5aba8d9b997 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:10.320537 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574b533-8943-444a-aec1-40dc13189711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:10.321698 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574b533-8943-444a-aec1-40dc13189711 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:10.322206 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574b533-8943-444a-aec1-40dc13189711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:10.323295 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574b533-8943-444a-aec1-40dc13189711 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:10.324181 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7574b533-8943-444a-aec1-40dc13189711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:10.327158 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7574b533-8943-444a-aec1-40dc13189711 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:10.345922 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 915/1821] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:35:10 2022] POST /identity/v3/projects => generated 387 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:35:10.345922 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d09076f-7c54-494d-a489-55824bdaa767 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:10.346237 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 907/1822] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:35:10 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:35:10.346859 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574b533-8943-444a-aec1-40dc13189711 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:10.349137 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-7574b533-8943-444a-aec1-40dc13189711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:10.407115 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d09076f-7c54-494d-a489-55824bdaa767 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:10.411889 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa6adf-b6b0-43e9-84b0-d5ab135ad923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:10.412829 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa6adf-b6b0-43e9-84b0-d5ab135ad923 admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:10.413107 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa6adf-b6b0-43e9-84b0-d5ab135ad923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:10.413384 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa6adf-b6b0-43e9-84b0-d5ab135ad923 admin admin] PATH_INFO: `/v3/projects/7498e5237efc45b9a53ed3fe10e9dbd3/users/60f9151d86a2462a94b7af1b7720cb9f/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:10.413635 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574b533-8943-444a-aec1-40dc13189711 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:10.433994 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa6adf-b6b0-43e9-84b0-d5ab135ad923 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7498e5237efc45b9a53ed3fe10e9dbd3, user_id=60f9151d86a2462a94b7af1b7720cb9f, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:10.436689 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa6adf-b6b0-43e9-84b0-d5ab135ad923 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:10.472992 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf498bbf-c89c-4543-8c30-4e8c080e9247 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:10.473713 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf498bbf-c89c-4543-8c30-4e8c080e9247 service cinder] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:10.473942 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf498bbf-c89c-4543-8c30-4e8c080e9247 service cinder] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:10.474192 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf498bbf-c89c-4543-8c30-4e8c080e9247 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:10.541464 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf498bbf-c89c-4543-8c30-4e8c080e9247 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:10.543549 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf498bbf-c89c-4543-8c30-4e8c080e9247 service cinder] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:10.555989 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 908/1823] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:35:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:35:10.556832 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf498bbf-c89c-4543-8c30-4e8c080e9247 service cinder] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:10.579507 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 916/1824] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:35:10 2022] PUT /identity/v3/projects/7498e5237efc45b9a53ed3fe10e9dbd3/users/60f9151d86a2462a94b7af1b7720cb9f/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:35:10.579507 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa6adf-b6b0-43e9-84b0-d5ab135ad923 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:10.580593 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf498bbf-c89c-4543-8c30-4e8c080e9247 service cinder] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:10.645025 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1658a0dc-5b91-4ea4-bbfb-fe0c1cdb4757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:10.645930 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658a0dc-5b91-4ea4-bbfb-fe0c1cdb4757 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:10.646226 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658a0dc-5b91-4ea4-bbfb-fe0c1cdb4757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:10.646468 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658a0dc-5b91-4ea4-bbfb-fe0c1cdb4757 admin admin] PATH_INFO: `/v3/projects/16c6132cad2141899af42c6a8d7b370f/users/298b697056f446fb841303d2132a5880/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:10.665716 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1658a0dc-5b91-4ea4-bbfb-fe0c1cdb4757 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16c6132cad2141899af42c6a8d7b370f, user_id=298b697056f446fb841303d2132a5880, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:10.665943 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa6adf-b6b0-43e9-84b0-d5ab135ad923 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:10.670112 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1658a0dc-5b91-4ea4-bbfb-fe0c1cdb4757 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:10.672381 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94dde14-0014-4a2c-aa1d-3d779d9a5ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:10.672758 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94dde14-0014-4a2c-aa1d-3d779d9a5ea9 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:10.673107 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94dde14-0014-4a2c-aa1d-3d779d9a5ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:10.673457 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94dde14-0014-4a2c-aa1d-3d779d9a5ea9 admin admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:10.674278 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94dde14-0014-4a2c-aa1d-3d779d9a5ea9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:10.676178 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94dde14-0014-4a2c-aa1d-3d779d9a5ea9 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:10.743060 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 909/1825] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:35:10 2022] PUT /identity/v3/projects/16c6132cad2141899af42c6a8d7b370f/users/298b697056f446fb841303d2132a5880/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:35:10.743956 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1658a0dc-5b91-4ea4-bbfb-fe0c1cdb4757 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:10.775314 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 917/1826] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:35:10 2022] POST /identity/v3/users => generated 300 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:35:10.775516 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c451d0-7b35-4a01-bfe3-1be0fa454b20 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:10.775831 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c451d0-7b35-4a01-bfe3-1be0fa454b20 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:10.781396 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c451d0-7b35-4a01-bfe3-1be0fa454b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:10.822001 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-d7c451d0-7b35-4a01-bfe3-1be0fa454b20 None None] MFA Rules not processed for user `298b697056f446fb841303d2132a5880`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:10.823243 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-d7c451d0-7b35-4a01-bfe3-1be0fa454b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:10.825874 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1658a0dc-5b91-4ea4-bbfb-fe0c1cdb4757 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:10.831172 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41b5d8-0f98-44fa-8c52-bd54c7cbcec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:10.831846 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41b5d8-0f98-44fa-8c52-bd54c7cbcec4 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:10.832349 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41b5d8-0f98-44fa-8c52-bd54c7cbcec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:10.832633 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41b5d8-0f98-44fa-8c52-bd54c7cbcec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:10.833399 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a41b5d8-0f98-44fa-8c52-bd54c7cbcec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:10.835234 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a41b5d8-0f98-44fa-8c52-bd54c7cbcec4 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:10.848678 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 910/1827] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:35:10 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:35:10.849553 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41b5d8-0f98-44fa-8c52-bd54c7cbcec4 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:10.862414 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41b5d8-0f98-44fa-8c52-bd54c7cbcec4 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:10.871786 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2294cb-6b62-4a1e-bd56-6a883ad7211e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:10.872493 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2294cb-6b62-4a1e-bd56-6a883ad7211e admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:10.872774 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2294cb-6b62-4a1e-bd56-6a883ad7211e admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:10.873049 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2294cb-6b62-4a1e-bd56-6a883ad7211e admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:10.873886 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2294cb-6b62-4a1e-bd56-6a883ad7211e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:10.875517 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2294cb-6b62-4a1e-bd56-6a883ad7211e admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:10.890184 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 911/1828] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:35:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:35:10.890184 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2294cb-6b62-4a1e-bd56-6a883ad7211e admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:10.902081 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2294cb-6b62-4a1e-bd56-6a883ad7211e admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:10.916476 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 918/1829] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:35:10.916476 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c451d0-7b35-4a01-bfe3-1be0fa454b20 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:10.919655 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf44ed6-c196-4f61-9579-13f67482ad8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:10.920769 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf44ed6-c196-4f61-9579-13f67482ad8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:10.921153 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf44ed6-c196-4f61-9579-13f67482ad8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:10.921597 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf44ed6-c196-4f61-9579-13f67482ad8f admin admin] PATH_INFO: `/v3/projects/7498e5237efc45b9a53ed3fe10e9dbd3/users/60f9151d86a2462a94b7af1b7720cb9f/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:10.924619 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf44ed6-c196-4f61-9579-13f67482ad8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7498e5237efc45b9a53ed3fe10e9dbd3, user_id=60f9151d86a2462a94b7af1b7720cb9f, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:10.927732 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf44ed6-c196-4f61-9579-13f67482ad8f admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:10.933985 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c451d0-7b35-4a01-bfe3-1be0fa454b20 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:10.939807 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071d287-9dba-48a8-a38b-593730da3c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:10.942575 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071d287-9dba-48a8-a38b-593730da3c3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:10.942575 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071d287-9dba-48a8-a38b-593730da3c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:10.942575 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071d287-9dba-48a8-a38b-593730da3c3e admin admin] PATH_INFO: `/v3/projects/bcee384970074580a68ed03f8a2b9de5/users/972df19ff5dd4c60a8b49d64ec559560/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:10.954222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 912/1830] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:35:10 2022] PUT /identity/v3/projects/7498e5237efc45b9a53ed3fe10e9dbd3/users/60f9151d86a2462a94b7af1b7720cb9f/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:35:10.955168 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf44ed6-c196-4f61-9579-13f67482ad8f admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:10.966088 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8071d287-9dba-48a8-a38b-593730da3c3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcee384970074580a68ed03f8a2b9de5, user_id=972df19ff5dd4c60a8b49d64ec559560, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:10.969076 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8071d287-9dba-48a8-a38b-593730da3c3e admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:11.058128 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 919/1831] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:35:10 2022] PUT /identity/v3/projects/bcee384970074580a68ed03f8a2b9de5/users/972df19ff5dd4c60a8b49d64ec559560/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:35:11.058128 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd7422-6174-4538-aa77-1d7c1c76e2de None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:11.058128 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd7422-6174-4538-aa77-1d7c1c76e2de None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:11.058128 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd7422-6174-4538-aa77-1d7c1c76e2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:11.128490 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf44ed6-c196-4f61-9579-13f67482ad8f admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:11.132341 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-abdd7422-6174-4538-aa77-1d7c1c76e2de None None] MFA Rules not processed for user `60f9151d86a2462a94b7af1b7720cb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:11.133938 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-abdd7422-6174-4538-aa77-1d7c1c76e2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:11.190532 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:11.224112 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638952f-667f-4c5d-a295-b53b0c6fb7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:11.226172 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638952f-667f-4c5d-a295-b53b0c6fb7b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:11.228735 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638952f-667f-4c5d-a295-b53b0c6fb7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:11.229527 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638952f-667f-4c5d-a295-b53b0c6fb7b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:11.234669 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638952f-667f-4c5d-a295-b53b0c6fb7b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:11.234669 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638952f-667f-4c5d-a295-b53b0c6fb7b7 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:11.256500 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 920/1832] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:11 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:35:11.258211 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd7422-6174-4538-aa77-1d7c1c76e2de None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:11.274378 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd7422-6174-4538-aa77-1d7c1c76e2de None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:11.279791 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ef7c1-3555-472a-8473-4463a06d68e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:11.280631 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ef7c1-3555-472a-8473-4463a06d68e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:11.280914 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ef7c1-3555-472a-8473-4463a06d68e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:11.281190 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ef7c1-3555-472a-8473-4463a06d68e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:11.281915 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ef7c1-3555-472a-8473-4463a06d68e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:11.283887 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ef7c1-3555-472a-8473-4463a06d68e8 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:11.300608 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 921/1833] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:35:11.300608 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ef7c1-3555-472a-8473-4463a06d68e8 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:11.300877 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-7b8ef7c1-3555-472a-8473-4463a06d68e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:11.367771 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 913/1834] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:35:10 2022] POST /identity/v3/projects => generated 387 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:35:11.367771 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638952f-667f-4c5d-a295-b53b0c6fb7b7 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:11.380944 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ef7c1-3555-472a-8473-4463a06d68e8 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:11.488553 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8302d00-149b-4335-affa-a57e8304a06d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:11.489426 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8302d00-149b-4335-affa-a57e8304a06d service cinder] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:11.489907 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8302d00-149b-4335-affa-a57e8304a06d service cinder] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:11.490193 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8302d00-149b-4335-affa-a57e8304a06d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:11.573431 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638952f-667f-4c5d-a295-b53b0c6fb7b7 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:11.580638 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172b72b-214b-4c35-8f10-b3bef413e269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:11.584965 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172b72b-214b-4c35-8f10-b3bef413e269 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:11.584965 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172b72b-214b-4c35-8f10-b3bef413e269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:11.584965 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172b72b-214b-4c35-8f10-b3bef413e269 admin admin] PATH_INFO: `/v3/projects/bcee384970074580a68ed03f8a2b9de5/users/972df19ff5dd4c60a8b49d64ec559560/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:11.584965 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9172b72b-214b-4c35-8f10-b3bef413e269 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcee384970074580a68ed03f8a2b9de5, user_id=972df19ff5dd4c60a8b49d64ec559560, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:11.594962 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9172b72b-214b-4c35-8f10-b3bef413e269 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:11.597287 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:11.641690 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 914/1835] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:35:11 2022] PUT /identity/v3/projects/bcee384970074580a68ed03f8a2b9de5/users/972df19ff5dd4c60a8b49d64ec559560/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:35:11.641690 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172b72b-214b-4c35-8f10-b3bef413e269 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:11.666431 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8302d00-149b-4335-affa-a57e8304a06d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:11.668080 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8302d00-149b-4335-affa-a57e8304a06d service cinder] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:11.688374 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 922/1836] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:35:11 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:35:11.693133 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10492664-ccce-48c9-8eae-1d8cdfb80739 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:11.693399 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10492664-ccce-48c9-8eae-1d8cdfb80739 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:11.693686 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10492664-ccce-48c9-8eae-1d8cdfb80739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:11.723837 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172b72b-214b-4c35-8f10-b3bef413e269 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:11.729984 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a58f2-5d72-4a38-85dc-57d239f003d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:11.730238 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a58f2-5d72-4a38-85dc-57d239f003d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:11.730618 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a58f2-5d72-4a38-85dc-57d239f003d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:11.731016 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a58f2-5d72-4a38-85dc-57d239f003d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:11.731808 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a58f2-5d72-4a38-85dc-57d239f003d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:11.734035 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a58f2-5d72-4a38-85dc-57d239f003d9 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:11.748854 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-10492664-ccce-48c9-8eae-1d8cdfb80739 None None] MFA Rules not processed for user `972df19ff5dd4c60a8b49d64ec559560`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:11.750295 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-10492664-ccce-48c9-8eae-1d8cdfb80739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:11.841867 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 915/1837] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:35:11 2022] POST /identity/v3/users => generated 294 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:35:11.848379 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 923/1838] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:11 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:35:11.850504 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a58f2-5d72-4a38-85dc-57d239f003d9 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:11.870286 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a58f2-5d72-4a38-85dc-57d239f003d9 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:11.873016 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10492664-ccce-48c9-8eae-1d8cdfb80739 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:11.875343 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a261ac-abe8-4281-ba79-504c39f620a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:11.876090 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a261ac-abe8-4281-ba79-504c39f620a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:11.876496 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a261ac-abe8-4281-ba79-504c39f620a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:11.876836 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a261ac-abe8-4281-ba79-504c39f620a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:11.878332 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a261ac-abe8-4281-ba79-504c39f620a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:11.880192 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a261ac-abe8-4281-ba79-504c39f620a0 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:11.891541 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 916/1839] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:35:11.895474 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a261ac-abe8-4281-ba79-504c39f620a0 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:11.905922 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a261ac-abe8-4281-ba79-504c39f620a0 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:11.911011 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2400a-ed53-4ce1-8fb0-c9c718a58636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:11.911670 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2400a-ed53-4ce1-8fb0-c9c718a58636 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:11.911953 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2400a-ed53-4ce1-8fb0-c9c718a58636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:11.912255 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2400a-ed53-4ce1-8fb0-c9c718a58636 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:11.912977 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b2400a-ed53-4ce1-8fb0-c9c718a58636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:11.914635 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b2400a-ed53-4ce1-8fb0-c9c718a58636 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:11.925356 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 917/1840] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 09:35:11.930023 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2400a-ed53-4ce1-8fb0-c9c718a58636 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:11.932105 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10492664-ccce-48c9-8eae-1d8cdfb80739 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:11.935767 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ba787-bbff-4f7f-9cec-aa100a9057ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:11.936469 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ba787-bbff-4f7f-9cec-aa100a9057ce service cinder] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:11.936750 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ba787-bbff-4f7f-9cec-aa100a9057ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:11.937025 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ba787-bbff-4f7f-9cec-aa100a9057ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:11.940170 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2400a-ed53-4ce1-8fb0-c9c718a58636 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:11.944883 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84abd46-ae07-4d20-b3ad-c1ecb5f94d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:11.945758 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84abd46-ae07-4d20-b3ad-c1ecb5f94d43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:11.946040 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84abd46-ae07-4d20-b3ad-c1ecb5f94d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:11.946392 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ba787-bbff-4f7f-9cec-aa100a9057ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:11.946985 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84abd46-ae07-4d20-b3ad-c1ecb5f94d43 admin admin] PATH_INFO: `/v3/projects/b0e5f27f9db74fa793a36054846c70bb/users/51854c81b84641fab64421e5de3a3bb4/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:11.947828 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ba787-bbff-4f7f-9cec-aa100a9057ce service cinder] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:11.957743 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 924/1841] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:35:11 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:35:11.963169 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84abd46-ae07-4d20-b3ad-c1ecb5f94d43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0e5f27f9db74fa793a36054846c70bb, user_id=51854c81b84641fab64421e5de3a3bb4, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:11.966445 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84abd46-ae07-4d20-b3ad-c1ecb5f94d43 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:11.997111 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ba787-bbff-4f7f-9cec-aa100a9057ce service cinder] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:12.007289 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ba787-bbff-4f7f-9cec-aa100a9057ce service cinder] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:12.014113 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2088c5-82d5-4861-8d30-155f239cb206 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:12.014546 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2088c5-82d5-4861-8d30-155f239cb206 service cinder] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:12.014919 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2088c5-82d5-4861-8d30-155f239cb206 service cinder] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:12.015612 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2088c5-82d5-4861-8d30-155f239cb206 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:12.041124 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 918/1842] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:35:11 2022] PUT /identity/v3/projects/b0e5f27f9db74fa793a36054846c70bb/users/51854c81b84641fab64421e5de3a3bb4/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:35:12.043396 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d6356-48df-43e7-a150-c6e8536e9971 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:12.043970 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d6356-48df-43e7-a150-c6e8536e9971 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:12.044173 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d6356-48df-43e7-a150-c6e8536e9971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:12.084364 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-fc1d6356-48df-43e7-a150-c6e8536e9971 None None] MFA Rules not processed for user `51854c81b84641fab64421e5de3a3bb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:12.085965 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-fc1d6356-48df-43e7-a150-c6e8536e9971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:12.130020 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2088c5-82d5-4861-8d30-155f239cb206 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:12.132251 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2088c5-82d5-4861-8d30-155f239cb206 service cinder] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:12.144843 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 925/1843] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:35:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 09:35:12.146754 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2088c5-82d5-4861-8d30-155f239cb206 service cinder] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:12.165985 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2088c5-82d5-4861-8d30-155f239cb206 service cinder] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:12.221626 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 919/1844] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:35:12.226612 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d6356-48df-43e7-a150-c6e8536e9971 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:12.245935 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f06d5b-1827-4e99-b96a-b3310feabf79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:12.246817 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f06d5b-1827-4e99-b96a-b3310feabf79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:12.247095 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f06d5b-1827-4e99-b96a-b3310feabf79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:12.247365 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f06d5b-1827-4e99-b96a-b3310feabf79 admin admin] PATH_INFO: `/v3/users/09c6fda2efbf455eaa7dc6c93ac25968` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:12.248917 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f06d5b-1827-4e99-b96a-b3310feabf79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09c6fda2efbf455eaa7dc6c93ac25968)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:12.252397 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f06d5b-1827-4e99-b96a-b3310feabf79 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:12.297927 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d6356-48df-43e7-a150-c6e8536e9971 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:12.302984 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1334a-4db5-4e41-b3c3-d3a0cca08546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:12.303700 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1334a-4db5-4e41-b3c3-d3a0cca08546 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:12.303966 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1334a-4db5-4e41-b3c3-d3a0cca08546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:12.304302 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1334a-4db5-4e41-b3c3-d3a0cca08546 admin admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:12.305016 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1334a-4db5-4e41-b3c3-d3a0cca08546 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:12.307059 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1334a-4db5-4e41-b3c3-d3a0cca08546 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:12.396790 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 920/1845] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:35:12 2022] POST /identity/v3/projects => generated 385 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 09:35:12.397822 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1334a-4db5-4e41-b3c3-d3a0cca08546 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:12.469297 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1334a-4db5-4e41-b3c3-d3a0cca08546 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:12.475630 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110bb656-e4cc-4208-b078-8ba6fb62a170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:12.476544 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bb656-e4cc-4208-b078-8ba6fb62a170 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:12.476930 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bb656-e4cc-4208-b078-8ba6fb62a170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:12.477339 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bb656-e4cc-4208-b078-8ba6fb62a170 admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:12.478201 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110bb656-e4cc-4208-b078-8ba6fb62a170 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:12.481004 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110bb656-e4cc-4208-b078-8ba6fb62a170 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:12.506385 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-e5f06d5b-1827-4e99-b96a-b3310feabf79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09c6fda2efbf455eaa7dc6c93ac25968'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:12.507550 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-e5f06d5b-1827-4e99-b96a-b3310feabf79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09c6fda2efbf455eaa7dc6c93ac25968'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:12.584383 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-e5f06d5b-1827-4e99-b96a-b3310feabf79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09c6fda2efbf455eaa7dc6c93ac25968'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:12.585239 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-e5f06d5b-1827-4e99-b96a-b3310feabf79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09c6fda2efbf455eaa7dc6c93ac25968'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:12.602455 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 921/1846] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:35:12 2022] POST /identity/v3/users => generated 299 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:35:12.602637 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-e5f06d5b-1827-4e99-b96a-b3310feabf79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09c6fda2efbf455eaa7dc6c93ac25968'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:12.602749 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110bb656-e4cc-4208-b078-8ba6fb62a170 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:12.605549 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-110bb656-e4cc-4208-b078-8ba6fb62a170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:12.623481 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110bb656-e4cc-4208-b078-8ba6fb62a170 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:12.632837 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 926/1847] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:35:12 2022] DELETE /identity/v3/users/09c6fda2efbf455eaa7dc6c93ac25968 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:35:12.633542 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c2dee6-c492-4196-90e1-0008c83aa14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:12.637273 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e1d22-0a78-4103-8790-19c581449714 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:12.637641 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e1d22-0a78-4103-8790-19c581449714 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:12.637987 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e1d22-0a78-4103-8790-19c581449714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:12.639296 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2dee6-c492-4196-90e1-0008c83aa14a admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:12.639296 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2dee6-c492-4196-90e1-0008c83aa14a admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:12.640325 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2dee6-c492-4196-90e1-0008c83aa14a admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:12.641220 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c2dee6-c492-4196-90e1-0008c83aa14a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:12.643236 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c2dee6-c492-4196-90e1-0008c83aa14a admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:12.657312 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 922/1848] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:35:12.661024 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-204e1d22-0a78-4103-8790-19c581449714 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:12.662366 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-204e1d22-0a78-4103-8790-19c581449714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:12.664521 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c2dee6-c492-4196-90e1-0008c83aa14a admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:12.681818 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c2dee6-c492-4196-90e1-0008c83aa14a admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:12.757225 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 927/1849] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:35:12.766719 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e1d22-0a78-4103-8790-19c581449714 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:12.773745 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-204e1d22-0a78-4103-8790-19c581449714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:12.784784 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:12.791166 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70454b8e-e581-48d6-a882-de2934a38b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:12.793021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70454b8e-e581-48d6-a882-de2934a38b7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:12.793776 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70454b8e-e581-48d6-a882-de2934a38b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:12.794203 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70454b8e-e581-48d6-a882-de2934a38b7d admin admin] PATH_INFO: `/v3/projects/fdd02a45b0eb400ab1e88a23374d10fd/users/537783683fae4ee198e49958aca62d1d/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:12.816060 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70454b8e-e581-48d6-a882-de2934a38b7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdd02a45b0eb400ab1e88a23374d10fd, user_id=537783683fae4ee198e49958aca62d1d, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:12.819345 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70454b8e-e581-48d6-a882-de2934a38b7d admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:12.871968 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e1d22-0a78-4103-8790-19c581449714 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:12.876606 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b2b27-b5b6-4971-8f06-15059f3d372b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:12.877206 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b2b27-b5b6-4971-8f06-15059f3d372b service neutron] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:12.877493 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b2b27-b5b6-4971-8f06-15059f3d372b service neutron] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:12.877777 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b2b27-b5b6-4971-8f06-15059f3d372b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:12.893227 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3b2b27-b5b6-4971-8f06-15059f3d372b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:12.894069 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3b2b27-b5b6-4971-8f06-15059f3d372b service neutron] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:12.909979 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 928/1850] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:35:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:35:12.918809 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 923/1851] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:35:12 2022] PUT /identity/v3/projects/fdd02a45b0eb400ab1e88a23374d10fd/users/537783683fae4ee198e49958aca62d1d/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:35:12.922656 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b2b27-b5b6-4971-8f06-15059f3d372b service neutron] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:12.933386 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b2b27-b5b6-4971-8f06-15059f3d372b service neutron] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:12.991467 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1acecc2-088a-4547-aedb-cc1e9013ce10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:12.992134 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acecc2-088a-4547-aedb-cc1e9013ce10 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:12.992463 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acecc2-088a-4547-aedb-cc1e9013ce10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:12.992743 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acecc2-088a-4547-aedb-cc1e9013ce10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:12.993489 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1acecc2-088a-4547-aedb-cc1e9013ce10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:12.995116 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1acecc2-088a-4547-aedb-cc1e9013ce10 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:13.005694 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 929/1852] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:35:13.005911 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:13.009972 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70454b8e-e581-48d6-a882-de2934a38b7d admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:13.020930 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70454b8e-e581-48d6-a882-de2934a38b7d admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:13.025610 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5eac1-0606-4163-afc8-ed78dca94f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:13.027104 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5eac1-0606-4163-afc8-ed78dca94f56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:13.027383 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5eac1-0606-4163-afc8-ed78dca94f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:13.027677 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5eac1-0606-4163-afc8-ed78dca94f56 admin admin] PATH_INFO: `/v3/projects/fdd02a45b0eb400ab1e88a23374d10fd/users/537783683fae4ee198e49958aca62d1d/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:13.029748 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f5eac1-0606-4163-afc8-ed78dca94f56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdd02a45b0eb400ab1e88a23374d10fd, user_id=537783683fae4ee198e49958aca62d1d, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:13.032408 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f5eac1-0606-4163-afc8-ed78dca94f56 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:13.043527 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 924/1853] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:35:13 2022] PUT /identity/v3/projects/fdd02a45b0eb400ab1e88a23374d10fd/users/537783683fae4ee198e49958aca62d1d/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:35:13.053624 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61205292-365e-4752-9643-c96b45e5b5ac None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:13.053911 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61205292-365e-4752-9643-c96b45e5b5ac None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:13.054188 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61205292-365e-4752-9643-c96b45e5b5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:13.081288 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-61205292-365e-4752-9643-c96b45e5b5ac None None] MFA Rules not processed for user `537783683fae4ee198e49958aca62d1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:13.082509 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-61205292-365e-4752-9643-c96b45e5b5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:13.164542 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 930/1854] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:35:13.175178 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5eac1-0606-4163-afc8-ed78dca94f56 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:13.176999 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-b1f5eac1-0606-4163-afc8-ed78dca94f56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:13.240580 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5eac1-0606-4163-afc8-ed78dca94f56 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:13.245343 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b014367-c4c8-4eed-a151-692b3eeffb60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:13.245998 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b014367-c4c8-4eed-a151-692b3eeffb60 service cinder] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:13.246282 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b014367-c4c8-4eed-a151-692b3eeffb60 service cinder] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:13.246555 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b014367-c4c8-4eed-a151-692b3eeffb60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:13.257241 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b014367-c4c8-4eed-a151-692b3eeffb60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:13.258799 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b014367-c4c8-4eed-a151-692b3eeffb60 service cinder] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:13.269434 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 925/1855] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:35:13 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:35:13.385781 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61205292-365e-4752-9643-c96b45e5b5ac None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:13.387327 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-61205292-365e-4752-9643-c96b45e5b5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:13.456466 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61205292-365e-4752-9643-c96b45e5b5ac None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:13.461018 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfead936-b746-46f3-ab06-3f8d688f86c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:13.461884 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfead936-b746-46f3-ab06-3f8d688f86c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:13.462169 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfead936-b746-46f3-ab06-3f8d688f86c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:13.462446 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfead936-b746-46f3-ab06-3f8d688f86c3 admin admin] PATH_INFO: `/v3/projects/09b258daaf764f4894dc90a4716c5bb0` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:13.464241 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfead936-b746-46f3-ab06-3f8d688f86c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09b258daaf764f4894dc90a4716c5bb0)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:13.466177 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfead936-b746-46f3-ab06-3f8d688f86c3 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:13.601911 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-bfead936-b746-46f3-ab06-3f8d688f86c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09b258daaf764f4894dc90a4716c5bb0', 'request_id': 'req-bfead936-b746-46f3-ab06-3f8d688f86c3'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:13.673818 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-bfead936-b746-46f3-ab06-3f8d688f86c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09b258daaf764f4894dc90a4716c5bb0', 'request_id': 'req-bfead936-b746-46f3-ab06-3f8d688f86c3'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:13.681243 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-bfead936-b746-46f3-ab06-3f8d688f86c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09b258daaf764f4894dc90a4716c5bb0', 'request_id': 'req-bfead936-b746-46f3-ab06-3f8d688f86c3'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:13.693652 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-bfead936-b746-46f3-ab06-3f8d688f86c3 admin admin] The token cache is being invalidate because project 09b258daaf764f4894dc90a4716c5bb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:35:13.693942 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-bfead936-b746-46f3-ab06-3f8d688f86c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:13.694617 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-bfead936-b746-46f3-ab06-3f8d688f86c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:13.700916 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 931/1856] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:35:13 2022] DELETE /identity/v3/projects/09b258daaf764f4894dc90a4716c5bb0 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:35:13.705105 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b014367-c4c8-4eed-a151-692b3eeffb60 service cinder] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:13.716541 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b014367-c4c8-4eed-a151-692b3eeffb60 service cinder] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:13.771996 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4879656-84d7-487e-93ad-6945e4b7af5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:13.772906 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4879656-84d7-487e-93ad-6945e4b7af5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:13.773187 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4879656-84d7-487e-93ad-6945e4b7af5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:13.773461 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4879656-84d7-487e-93ad-6945e4b7af5a admin admin] PATH_INFO: `/v3/users/972df19ff5dd4c60a8b49d64ec559560` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:13.774654 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4879656-84d7-487e-93ad-6945e4b7af5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=972df19ff5dd4c60a8b49d64ec559560)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:13.777181 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4879656-84d7-487e-93ad-6945e4b7af5a admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:14.014839 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-e4879656-84d7-487e-93ad-6945e4b7af5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '972df19ff5dd4c60a8b49d64ec559560'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:14.035644 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-e4879656-84d7-487e-93ad-6945e4b7af5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '972df19ff5dd4c60a8b49d64ec559560'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:14.150597 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-e4879656-84d7-487e-93ad-6945e4b7af5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '972df19ff5dd4c60a8b49d64ec559560'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:14.150597 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-e4879656-84d7-487e-93ad-6945e4b7af5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '972df19ff5dd4c60a8b49d64ec559560'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:14.169192 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-e4879656-84d7-487e-93ad-6945e4b7af5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '972df19ff5dd4c60a8b49d64ec559560'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:14.182679 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 926/1857] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:35:13 2022] DELETE /identity/v3/users/972df19ff5dd4c60a8b49d64ec559560 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:35:14.570248 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfead936-b746-46f3-ab06-3f8d688f86c3 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:14.576166 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-bfead936-b746-46f3-ab06-3f8d688f86c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:14.664135 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfead936-b746-46f3-ab06-3f8d688f86c3 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:14.727507 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05807e96-476d-4dc6-875e-4a5012cd96ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:14.729486 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05807e96-476d-4dc6-875e-4a5012cd96ab service cinder] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:14.729978 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05807e96-476d-4dc6-875e-4a5012cd96ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:14.730397 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05807e96-476d-4dc6-875e-4a5012cd96ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:14.732763 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-05807e96-476d-4dc6-875e-4a5012cd96ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:14.805320 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05807e96-476d-4dc6-875e-4a5012cd96ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:14.807936 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05807e96-476d-4dc6-875e-4a5012cd96ab service cinder] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:14.823955 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 932/1858] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:35:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:35:15.035667 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4879656-84d7-487e-93ad-6945e4b7af5a admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:15.037235 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-e4879656-84d7-487e-93ad-6945e4b7af5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:15.099598 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:15.139928 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4879656-84d7-487e-93ad-6945e4b7af5a admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:15.145241 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb1b91-9834-49a8-9ed9-6460885c7bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:15.146150 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb1b91-9834-49a8-9ed9-6460885c7bfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:15.146420 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb1b91-9834-49a8-9ed9-6460885c7bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:15.146689 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb1b91-9834-49a8-9ed9-6460885c7bfb admin admin] PATH_INFO: `/v3/users/92f665cbd5694e4db714bdeeae9c37b3` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:15.148179 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdb1b91-9834-49a8-9ed9-6460885c7bfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=92f665cbd5694e4db714bdeeae9c37b3)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:15.150361 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdb1b91-9834-49a8-9ed9-6460885c7bfb admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:15.300476 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05807e96-476d-4dc6-875e-4a5012cd96ab service cinder] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:15.302542 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-05807e96-476d-4dc6-875e-4a5012cd96ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:15.318271 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05807e96-476d-4dc6-875e-4a5012cd96ab service cinder] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:15.373191 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75b48f-3ff0-4645-8281-4e7454d255da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:15.374149 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75b48f-3ff0-4645-8281-4e7454d255da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:15.374433 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75b48f-3ff0-4645-8281-4e7454d255da admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:15.374708 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75b48f-3ff0-4645-8281-4e7454d255da admin admin] PATH_INFO: `/v3/projects/bcee384970074580a68ed03f8a2b9de5` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:15.376022 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75b48f-3ff0-4645-8281-4e7454d255da admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcee384970074580a68ed03f8a2b9de5)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:15.378196 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75b48f-3ff0-4645-8281-4e7454d255da admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:15.660702 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-7fdb1b91-9834-49a8-9ed9-6460885c7bfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92f665cbd5694e4db714bdeeae9c37b3'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:15.668755 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-6f75b48f-3ff0-4645-8281-4e7454d255da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcee384970074580a68ed03f8a2b9de5', 'request_id': 'req-6f75b48f-3ff0-4645-8281-4e7454d255da'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:15.671228 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-7fdb1b91-9834-49a8-9ed9-6460885c7bfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92f665cbd5694e4db714bdeeae9c37b3'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:15.823818 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-6f75b48f-3ff0-4645-8281-4e7454d255da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcee384970074580a68ed03f8a2b9de5', 'request_id': 'req-6f75b48f-3ff0-4645-8281-4e7454d255da'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:15.829876 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-6f75b48f-3ff0-4645-8281-4e7454d255da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcee384970074580a68ed03f8a2b9de5', 'request_id': 'req-6f75b48f-3ff0-4645-8281-4e7454d255da'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:15.842796 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-6f75b48f-3ff0-4645-8281-4e7454d255da admin admin] The token cache is being invalidate because project bcee384970074580a68ed03f8a2b9de5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:35:15.843155 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-6f75b48f-3ff0-4645-8281-4e7454d255da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:15.843879 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-6f75b48f-3ff0-4645-8281-4e7454d255da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:15.845746 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 933/1859] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:35:15 2022] DELETE /identity/v3/projects/bcee384970074580a68ed03f8a2b9de5 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:35:15.851015 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5bc9b-499f-4c6a-80d4-5c55d093199d None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:15.854937 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5bc9b-499f-4c6a-80d4-5c55d093199d None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:15.854937 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5bc9b-499f-4c6a-80d4-5c55d093199d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:15.874244 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-1ac5bc9b-499f-4c6a-80d4-5c55d093199d None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:15.875622 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-1ac5bc9b-499f-4c6a-80d4-5c55d093199d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:15.926707 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-7fdb1b91-9834-49a8-9ed9-6460885c7bfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92f665cbd5694e4db714bdeeae9c37b3'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:15.927430 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-7fdb1b91-9834-49a8-9ed9-6460885c7bfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92f665cbd5694e4db714bdeeae9c37b3'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:15.941142 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 934/1860] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:35:15.942887 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-7fdb1b91-9834-49a8-9ed9-6460885c7bfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92f665cbd5694e4db714bdeeae9c37b3'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:15.948774 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3067d-8159-48b1-a3f6-c4d6d64422db None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:15.949070 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3067d-8159-48b1-a3f6-c4d6d64422db None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:15.949984 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3067d-8159-48b1-a3f6-c4d6d64422db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:15.951850 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 927/1861] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:35:15 2022] DELETE /identity/v3/users/92f665cbd5694e4db714bdeeae9c37b3 => generated 0 bytes in 916 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:35:15.955975 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:15.959232 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee83ce80-4adf-4c4e-a7e8-e7146927190b None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:15.959704 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee83ce80-4adf-4c4e-a7e8-e7146927190b None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:15.961072 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee83ce80-4adf-4c4e-a7e8-e7146927190b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:15.971282 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-60e3067d-8159-48b1-a3f6-c4d6d64422db None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:15.972066 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-60e3067d-8159-48b1-a3f6-c4d6d64422db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:15.993369 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-ee83ce80-4adf-4c4e-a7e8-e7146927190b None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:15.994828 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-ee83ce80-4adf-4c4e-a7e8-e7146927190b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:16.060992 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 935/1862] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 09:35:16.065014 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e3067d-8159-48b1-a3f6-c4d6d64422db None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:16.081764 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e3067d-8159-48b1-a3f6-c4d6d64422db None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:16.095816 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 928/1863] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:35:16.103357 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d83bc-8004-43e6-8862-d56f2d6a9e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:16.105356 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee83ce80-4adf-4c4e-a7e8-e7146927190b None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:16.106763 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d83bc-8004-43e6-8862-d56f2d6a9e01 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:16.107048 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d83bc-8004-43e6-8862-d56f2d6a9e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:16.107323 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d83bc-8004-43e6-8862-d56f2d6a9e01 admin admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:16.108672 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-ee83ce80-4adf-4c4e-a7e8-e7146927190b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:16.110859 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d83bc-8004-43e6-8862-d56f2d6a9e01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:35:16.111176 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d83bc-8004-43e6-8862-d56f2d6a9e01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:16.118106 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d83bc-8004-43e6-8862-d56f2d6a9e01 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:16.145347 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 936/1864] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:35:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:35:16.149984 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d83bc-8004-43e6-8862-d56f2d6a9e01 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:16.164428 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d83bc-8004-43e6-8862-d56f2d6a9e01 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:16.176037 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26447365-25ad-4a0c-abf3-10b4f5868d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:16.177016 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26447365-25ad-4a0c-abf3-10b4f5868d8f admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:16.177453 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26447365-25ad-4a0c-abf3-10b4f5868d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:16.177888 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26447365-25ad-4a0c-abf3-10b4f5868d8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:16.179095 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26447365-25ad-4a0c-abf3-10b4f5868d8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:16.182234 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26447365-25ad-4a0c-abf3-10b4f5868d8f admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:16.199514 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee83ce80-4adf-4c4e-a7e8-e7146927190b None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:16.202866 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5185b203-6dd3-4f71-8649-6632ca05cdc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:16.203608 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185b203-6dd3-4f71-8649-6632ca05cdc8 service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:16.204568 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185b203-6dd3-4f71-8649-6632ca05cdc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:16.204568 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185b203-6dd3-4f71-8649-6632ca05cdc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:16.217427 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5185b203-6dd3-4f71-8649-6632ca05cdc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:16.219077 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5185b203-6dd3-4f71-8649-6632ca05cdc8 service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:16.231156 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 929/1865] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:35:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:35:16.354562 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 937/1866] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:35:16 2022] POST /identity/v3/projects => generated 381 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:35:16.358548 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5185b203-6dd3-4f71-8649-6632ca05cdc8 service neutron] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:16.369678 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5185b203-6dd3-4f71-8649-6632ca05cdc8 service neutron] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:16.464002 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2acf4-35f1-4949-b5b0-382367dc40d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:16.465016 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2acf4-35f1-4949-b5b0-382367dc40d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:16.466047 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2acf4-35f1-4949-b5b0-382367dc40d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:16.466520 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2acf4-35f1-4949-b5b0-382367dc40d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:16.467410 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed2acf4-35f1-4949-b5b0-382367dc40d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:16.471199 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed2acf4-35f1-4949-b5b0-382367dc40d0 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:16.573717 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 930/1867] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:35:16 2022] POST /identity/v3/users => generated 291 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:35:16.579532 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26447365-25ad-4a0c-abf3-10b4f5868d8f admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:16.593832 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26447365-25ad-4a0c-abf3-10b4f5868d8f admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:16.599271 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb1ccc-0608-4a07-b09d-5fbbe1ba2514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:16.600322 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb1ccc-0608-4a07-b09d-5fbbe1ba2514 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:16.604888 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb1ccc-0608-4a07-b09d-5fbbe1ba2514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:16.604888 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb1ccc-0608-4a07-b09d-5fbbe1ba2514 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:16.604888 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bb1ccc-0608-4a07-b09d-5fbbe1ba2514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:16.604888 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bb1ccc-0608-4a07-b09d-5fbbe1ba2514 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:16.619857 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 938/1868] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:35:16.625100 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2acf4-35f1-4949-b5b0-382367dc40d0 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:16.638587 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2acf4-35f1-4949-b5b0-382367dc40d0 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:16.644448 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b82af76-5028-4760-b033-3df0fdd97b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:16.645183 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82af76-5028-4760-b033-3df0fdd97b41 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:16.645455 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82af76-5028-4760-b033-3df0fdd97b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:16.645865 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82af76-5028-4760-b033-3df0fdd97b41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:16.646609 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b82af76-5028-4760-b033-3df0fdd97b41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:16.648981 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b82af76-5028-4760-b033-3df0fdd97b41 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:16.663055 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 931/1869] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:35:16.667564 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb1ccc-0608-4a07-b09d-5fbbe1ba2514 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:16.690504 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb1ccc-0608-4a07-b09d-5fbbe1ba2514 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:16.694208 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d0321-e71d-4375-bc8d-955fbda8308e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:16.695339 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d0321-e71d-4375-bc8d-955fbda8308e admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:16.695463 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d0321-e71d-4375-bc8d-955fbda8308e admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:16.695659 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d0321-e71d-4375-bc8d-955fbda8308e admin admin] PATH_INFO: `/v3/projects/6ce4e30857014ab09aeb62519a3e8f30/users/21d20ad9a522468fa3627f55f7b10bb8/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:16.712379 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94d0321-e71d-4375-bc8d-955fbda8308e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ce4e30857014ab09aeb62519a3e8f30, user_id=21d20ad9a522468fa3627f55f7b10bb8, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:16.715927 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94d0321-e71d-4375-bc8d-955fbda8308e admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:16.899474 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 939/1870] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:35:16 2022] PUT /identity/v3/projects/6ce4e30857014ab09aeb62519a3e8f30/users/21d20ad9a522468fa3627f55f7b10bb8/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:35:16.911191 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72f8c0-a655-44f7-8ee7-792b3499bdbe None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:16.911596 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72f8c0-a655-44f7-8ee7-792b3499bdbe None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:16.911883 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72f8c0-a655-44f7-8ee7-792b3499bdbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:16.933514 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d0321-e71d-4375-bc8d-955fbda8308e admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:16.937545 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-b94d0321-e71d-4375-bc8d-955fbda8308e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:16.982176 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-fb72f8c0-a655-44f7-8ee7-792b3499bdbe None None] MFA Rules not processed for user `21d20ad9a522468fa3627f55f7b10bb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:16.983768 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-fb72f8c0-a655-44f7-8ee7-792b3499bdbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:17.030076 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d0321-e71d-4375-bc8d-955fbda8308e admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:17.030949 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed78b9-c57a-416c-9c8c-027c68e3aded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:17.031996 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed78b9-c57a-416c-9c8c-027c68e3aded admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:17.033214 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed78b9-c57a-416c-9c8c-027c68e3aded admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:17.033214 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed78b9-c57a-416c-9c8c-027c68e3aded admin admin] PATH_INFO: `/v3/projects/a9e284ef9de34d8295715e3148ed13c2` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:17.034197 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed78b9-c57a-416c-9c8c-027c68e3aded admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9e284ef9de34d8295715e3148ed13c2)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:17.036253 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed78b9-c57a-416c-9c8c-027c68e3aded admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:17.062433 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 932/1871] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:35:17.067048 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb72f8c0-a655-44f7-8ee7-792b3499bdbe None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:17.077858 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb72f8c0-a655-44f7-8ee7-792b3499bdbe None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:17.082635 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523efe16-114d-4dd3-ad4d-6b96872b4b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:17.083299 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523efe16-114d-4dd3-ad4d-6b96872b4b8c admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:17.083583 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523efe16-114d-4dd3-ad4d-6b96872b4b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:17.083861 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523efe16-114d-4dd3-ad4d-6b96872b4b8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:17.084609 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523efe16-114d-4dd3-ad4d-6b96872b4b8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:17.086509 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523efe16-114d-4dd3-ad4d-6b96872b4b8c admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:17.135588 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-11ed78b9-c57a-416c-9c8c-027c68e3aded admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9e284ef9de34d8295715e3148ed13c2', 'request_id': 'req-11ed78b9-c57a-416c-9c8c-027c68e3aded'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:17.221052 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 933/1872] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:35:17 2022] POST /identity/v3/projects => generated 383 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 09:35:17.231569 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523efe16-114d-4dd3-ad4d-6b96872b4b8c admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:17.252981 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-11ed78b9-c57a-416c-9c8c-027c68e3aded admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9e284ef9de34d8295715e3148ed13c2', 'request_id': 'req-11ed78b9-c57a-416c-9c8c-027c68e3aded'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:17.260596 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-11ed78b9-c57a-416c-9c8c-027c68e3aded admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9e284ef9de34d8295715e3148ed13c2', 'request_id': 'req-11ed78b9-c57a-416c-9c8c-027c68e3aded'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:17.272447 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-11ed78b9-c57a-416c-9c8c-027c68e3aded admin admin] The token cache is being invalidate because project a9e284ef9de34d8295715e3148ed13c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:35:17.272738 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-11ed78b9-c57a-416c-9c8c-027c68e3aded admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:17.273617 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-11ed78b9-c57a-416c-9c8c-027c68e3aded admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:17.275337 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 940/1873] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:35:16 2022] DELETE /identity/v3/projects/a9e284ef9de34d8295715e3148ed13c2 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:35:17.280589 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962b6c3-dd95-41ed-9ec7-53f8f0fad7a0 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:17.280815 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962b6c3-dd95-41ed-9ec7-53f8f0fad7a0 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:17.281090 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962b6c3-dd95-41ed-9ec7-53f8f0fad7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:17.300317 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523efe16-114d-4dd3-ad4d-6b96872b4b8c admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:17.305096 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-0962b6c3-dd95-41ed-9ec7-53f8f0fad7a0 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:17.305244 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e2772-472d-4303-9459-458b13b4d5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:17.305902 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e2772-472d-4303-9459-458b13b4d5b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:17.306186 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e2772-472d-4303-9459-458b13b4d5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:17.306357 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-0962b6c3-dd95-41ed-9ec7-53f8f0fad7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:17.306463 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e2772-472d-4303-9459-458b13b4d5b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:17.307142 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768e2772-472d-4303-9459-458b13b4d5b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:17.309721 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768e2772-472d-4303-9459-458b13b4d5b9 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:17.325646 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 941/1874] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 09:35:17.328190 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37f511-c79e-4531-85f4-c7353a735564 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:17.328520 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37f511-c79e-4531-85f4-c7353a735564 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:17.328815 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37f511-c79e-4531-85f4-c7353a735564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:17.347166 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-7e37f511-c79e-4531-85f4-c7353a735564 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:17.348420 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-7e37f511-c79e-4531-85f4-c7353a735564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:17.364471 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 942/1875] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:35:17.367428 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e37f511-c79e-4531-85f4-c7353a735564 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:17.376776 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e37f511-c79e-4531-85f4-c7353a735564 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:17.381580 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae9dab-b92a-4603-8e29-37b5e2d6ae71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:17.382539 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae9dab-b92a-4603-8e29-37b5e2d6ae71 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:17.382822 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae9dab-b92a-4603-8e29-37b5e2d6ae71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:17.383099 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae9dab-b92a-4603-8e29-37b5e2d6ae71 admin admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:17.383831 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae9dab-b92a-4603-8e29-37b5e2d6ae71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:35:17.384140 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae9dab-b92a-4603-8e29-37b5e2d6ae71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:17.395061 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae9dab-b92a-4603-8e29-37b5e2d6ae71 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:17.397645 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 943/1876] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:35:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:35:17.402882 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae9dab-b92a-4603-8e29-37b5e2d6ae71 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:17.412831 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae9dab-b92a-4603-8e29-37b5e2d6ae71 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:17.418060 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210700f-0006-4569-8596-88a26fc64e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:17.418728 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210700f-0006-4569-8596-88a26fc64e98 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:17.419013 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210700f-0006-4569-8596-88a26fc64e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:17.419289 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210700f-0006-4569-8596-88a26fc64e98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:17.419982 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3210700f-0006-4569-8596-88a26fc64e98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:17.421924 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3210700f-0006-4569-8596-88a26fc64e98 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:17.448445 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 934/1877] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:35:17 2022] POST /identity/v3/users => generated 298 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 09:35:17.453671 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e2772-472d-4303-9459-458b13b4d5b9 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:17.453671 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-768e2772-472d-4303-9459-458b13b4d5b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:17.466059 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e2772-472d-4303-9459-458b13b4d5b9 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:17.470713 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fbc362-a39d-4775-85be-e7693ea3576a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:17.471363 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbc362-a39d-4775-85be-e7693ea3576a admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:17.471647 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbc362-a39d-4775-85be-e7693ea3576a admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:17.472070 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbc362-a39d-4775-85be-e7693ea3576a admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:17.472951 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fbc362-a39d-4775-85be-e7693ea3576a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:17.474552 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fbc362-a39d-4775-85be-e7693ea3576a admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:17.485442 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 935/1878] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:35:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 09:35:17.497014 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fbc362-a39d-4775-85be-e7693ea3576a admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:17.506985 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fbc362-a39d-4775-85be-e7693ea3576a admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:17.512129 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565343c-2350-454b-abd9-7aaff5cb752b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:17.513033 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565343c-2350-454b-abd9-7aaff5cb752b admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:17.513313 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565343c-2350-454b-abd9-7aaff5cb752b admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:17.513663 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565343c-2350-454b-abd9-7aaff5cb752b admin admin] PATH_INFO: `/v3/projects/f62019110faf42c5850002546a32f4ea/users/7fe211e441284f9b96b837a43cccecd4/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:17.522527 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 944/1879] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:35:17 2022] POST /identity/v3/projects => generated 365 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 09:35:17.529476 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5565343c-2350-454b-abd9-7aaff5cb752b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f62019110faf42c5850002546a32f4ea, user_id=7fe211e441284f9b96b837a43cccecd4, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:17.531270 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210700f-0006-4569-8596-88a26fc64e98 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:17.532145 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5565343c-2350-454b-abd9-7aaff5cb752b admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:17.593528 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210700f-0006-4569-8596-88a26fc64e98 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:17.598305 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd941555-1479-4772-8195-60abe17b037b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:17.598990 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd941555-1479-4772-8195-60abe17b037b admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:17.599387 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd941555-1479-4772-8195-60abe17b037b admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:17.599691 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd941555-1479-4772-8195-60abe17b037b admin admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:17.600390 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd941555-1479-4772-8195-60abe17b037b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:17.602313 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd941555-1479-4772-8195-60abe17b037b admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:17.606677 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 936/1880] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:35:17 2022] PUT /identity/v3/projects/f62019110faf42c5850002546a32f4ea/users/7fe211e441284f9b96b837a43cccecd4/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:35:17.610640 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565343c-2350-454b-abd9-7aaff5cb752b admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:17.677233 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565343c-2350-454b-abd9-7aaff5cb752b admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:17.685947 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22671e-4fe9-4090-a783-8f3743a6edb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:17.687183 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22671e-4fe9-4090-a783-8f3743a6edb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:17.687443 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22671e-4fe9-4090-a783-8f3743a6edb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:17.687696 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22671e-4fe9-4090-a783-8f3743a6edb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:17.688456 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e22671e-4fe9-4090-a783-8f3743a6edb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:17.690078 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e22671e-4fe9-4090-a783-8f3743a6edb7 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:17.704655 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 937/1881] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:35:17 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 09:35:17.708360 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22671e-4fe9-4090-a783-8f3743a6edb7 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:17.717641 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 945/1882] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:35:17 2022] POST /identity/v3/users => generated 283 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:35:17.718157 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22671e-4fe9-4090-a783-8f3743a6edb7 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:17.719442 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd941555-1479-4772-8195-60abe17b037b admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:17.723695 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de916c0-55c8-4995-b16f-2f2346028ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:17.725020 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de916c0-55c8-4995-b16f-2f2346028ba4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:17.725305 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de916c0-55c8-4995-b16f-2f2346028ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:17.725580 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de916c0-55c8-4995-b16f-2f2346028ba4 admin admin] PATH_INFO: `/v3/projects/f62019110faf42c5850002546a32f4ea/users/7fe211e441284f9b96b837a43cccecd4/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:17.727651 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de916c0-55c8-4995-b16f-2f2346028ba4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f62019110faf42c5850002546a32f4ea, user_id=7fe211e441284f9b96b837a43cccecd4, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:17.730932 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de916c0-55c8-4995-b16f-2f2346028ba4 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:17.734175 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd941555-1479-4772-8195-60abe17b037b admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:17.742780 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 938/1883] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:35:17 2022] PUT /identity/v3/projects/f62019110faf42c5850002546a32f4ea/users/7fe211e441284f9b96b837a43cccecd4/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:35:17.749591 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5691322-14ff-47f8-ac6b-e2ef2ad026f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:17.750263 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5691322-14ff-47f8-ac6b-e2ef2ad026f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:17.750722 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5691322-14ff-47f8-ac6b-e2ef2ad026f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:17.751159 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5691322-14ff-47f8-ac6b-e2ef2ad026f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:17.752127 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5691322-14ff-47f8-ac6b-e2ef2ad026f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:17.753775 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01eca0b-db63-49bc-8262-982a99f29333 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:17.754618 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01eca0b-db63-49bc-8262-982a99f29333 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:17.754618 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01eca0b-db63-49bc-8262-982a99f29333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:17.757914 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5691322-14ff-47f8-ac6b-e2ef2ad026f2 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:17.787260 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 946/1884] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:35:17 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:35:17.788168 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5691322-14ff-47f8-ac6b-e2ef2ad026f2 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:17.791261 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-a01eca0b-db63-49bc-8262-982a99f29333 None None] MFA Rules not processed for user `7fe211e441284f9b96b837a43cccecd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:17.793916 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-a01eca0b-db63-49bc-8262-982a99f29333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:17.800225 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5691322-14ff-47f8-ac6b-e2ef2ad026f2 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:17.886442 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d180714-d821-4304-899a-f53a4035f57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:17.887141 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d180714-d821-4304-899a-f53a4035f57c admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:17.887432 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d180714-d821-4304-899a-f53a4035f57c admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:17.887713 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d180714-d821-4304-899a-f53a4035f57c admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:17.888659 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d180714-d821-4304-899a-f53a4035f57c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:17.890619 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d180714-d821-4304-899a-f53a4035f57c admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:17.893460 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 939/1885] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:17 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:35:17.902975 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 947/1886] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:35:17 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:35:17.907413 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01eca0b-db63-49bc-8262-982a99f29333 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:17.911290 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d180714-d821-4304-899a-f53a4035f57c admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:17.918805 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-4d180714-d821-4304-899a-f53a4035f57c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:17.923623 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01eca0b-db63-49bc-8262-982a99f29333 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:17.932336 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb205951-1580-4ec0-8365-9b11685e9071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:17.933421 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb205951-1580-4ec0-8365-9b11685e9071 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:17.933802 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb205951-1580-4ec0-8365-9b11685e9071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:17.934342 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb205951-1580-4ec0-8365-9b11685e9071 admin admin] PATH_INFO: `/v3/projects/55698077cdf64f2c919b7a0d5e00148d/users/312b8bd31e6c4ae68067da1e3ab67a88/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:17.971002 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb205951-1580-4ec0-8365-9b11685e9071 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55698077cdf64f2c919b7a0d5e00148d, user_id=312b8bd31e6c4ae68067da1e3ab67a88, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:17.975826 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb205951-1580-4ec0-8365-9b11685e9071 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:18.037476 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d180714-d821-4304-899a-f53a4035f57c admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:18.045649 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51dfa73-afc0-435a-860f-51e84bdcc492 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:18.047333 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51dfa73-afc0-435a-860f-51e84bdcc492 service cinder] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:18.048221 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51dfa73-afc0-435a-860f-51e84bdcc492 service cinder] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:18.050591 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51dfa73-afc0-435a-860f-51e84bdcc492 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:18.076296 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 940/1887] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:35:17 2022] PUT /identity/v3/projects/55698077cdf64f2c919b7a0d5e00148d/users/312b8bd31e6c4ae68067da1e3ab67a88/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:35:18.078391 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96def49e-6324-48a4-a694-f728e3c7067c None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:18.078819 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96def49e-6324-48a4-a694-f728e3c7067c None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:18.079211 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96def49e-6324-48a4-a694-f728e3c7067c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:18.097941 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51dfa73-afc0-435a-860f-51e84bdcc492 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:18.101114 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51dfa73-afc0-435a-860f-51e84bdcc492 service cinder] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:18.127156 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 948/1888] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:35:17 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:35:18.134097 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-96def49e-6324-48a4-a694-f728e3c7067c None None] MFA Rules not processed for user `312b8bd31e6c4ae68067da1e3ab67a88`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:18.135961 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-96def49e-6324-48a4-a694-f728e3c7067c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:18.268540 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 941/1889] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:18 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:35:18.277716 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51dfa73-afc0-435a-860f-51e84bdcc492 service cinder] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:18.281564 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-e51dfa73-afc0-435a-860f-51e84bdcc492 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:18.305742 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51dfa73-afc0-435a-860f-51e84bdcc492 service cinder] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:18.374274 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96def49e-6324-48a4-a694-f728e3c7067c None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:18.391849 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e230f-d020-4930-a4ea-ba75d3ea7c9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:18.392567 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e230f-d020-4930-a4ea-ba75d3ea7c9c service cinder] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:18.392851 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e230f-d020-4930-a4ea-ba75d3ea7c9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:18.393133 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e230f-d020-4930-a4ea-ba75d3ea7c9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:18.403324 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e230f-d020-4930-a4ea-ba75d3ea7c9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:18.405000 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e230f-d020-4930-a4ea-ba75d3ea7c9c service cinder] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:18.417446 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 949/1890] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:35:18 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:35:18.439320 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:18.441361 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96def49e-6324-48a4-a694-f728e3c7067c None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:18.445756 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000b9d2-3a75-4aa7-9a1f-811d3cb9e3c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:18.446611 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000b9d2-3a75-4aa7-9a1f-811d3cb9e3c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:18.446897 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000b9d2-3a75-4aa7-9a1f-811d3cb9e3c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:18.447172 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000b9d2-3a75-4aa7-9a1f-811d3cb9e3c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:18.449213 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-8000b9d2-3a75-4aa7-9a1f-811d3cb9e3c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:18.521899 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8000b9d2-3a75-4aa7-9a1f-811d3cb9e3c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:18.523537 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8000b9d2-3a75-4aa7-9a1f-811d3cb9e3c5 service cinder] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:18.534866 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 942/1891] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:35:18 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:35:18.578253 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:19.547379 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb890eec-7c95-4d6f-abf4-c6c4336baf15 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:19.548139 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb890eec-7c95-4d6f-abf4-c6c4336baf15 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:19.548575 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb890eec-7c95-4d6f-abf4-c6c4336baf15 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:19.550484 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 950/1892] 10.222.0.62 () {54 vars in 921 bytes} [Mon Jun 27 09:35:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:35:19.591602 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b6006-bf96-4c08-a5af-dfdcb352990d None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:19.592051 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b6006-bf96-4c08-a5af-dfdcb352990d None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:19.592188 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b6006-bf96-4c08-a5af-dfdcb352990d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:19.647529 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-b58b6006-bf96-4c08-a5af-dfdcb352990d None None] MFA Rules not processed for user `2c1434a85b30411c9c59cc50c3980cd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:19.672615 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-b58b6006-bf96-4c08-a5af-dfdcb352990d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:19.876312 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 943/1893] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Jun 27 09:35:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:35:20.037853 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb890eec-7c95-4d6f-abf4-c6c4336baf15 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:20.040052 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-cb890eec-7c95-4d6f-abf4-c6c4336baf15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:20.065716 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb890eec-7c95-4d6f-abf4-c6c4336baf15 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:20.072345 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14f24a-ee65-4af6-9f73-24a004c5181e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:20.073033 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14f24a-ee65-4af6-9f73-24a004c5181e service nova] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:20.073338 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14f24a-ee65-4af6-9f73-24a004c5181e service nova] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:20.073604 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14f24a-ee65-4af6-9f73-24a004c5181e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:20.084677 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c14f24a-ee65-4af6-9f73-24a004c5181e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:20.087608 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c14f24a-ee65-4af6-9f73-24a004c5181e service nova] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:20.098387 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 951/1894] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:35:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:35:21.308929 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:21.504373 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:23.069855 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b6006-bf96-4c08-a5af-dfdcb352990d None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:23.092735 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b6006-bf96-4c08-a5af-dfdcb352990d None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:23.096072 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf5a5d-e1fe-4cb4-a524-3baa8c732fba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:23.096738 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf5a5d-e1fe-4cb4-a524-3baa8c732fba service cinder] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:23.096953 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf5a5d-e1fe-4cb4-a524-3baa8c732fba service cinder] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:23.097579 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf5a5d-e1fe-4cb4-a524-3baa8c732fba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:23.100266 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-2eaf5a5d-e1fe-4cb4-a524-3baa8c732fba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:23.122970 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14f24a-ee65-4af6-9f73-24a004c5181e service nova] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:23.220496 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaf5a5d-e1fe-4cb4-a524-3baa8c732fba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:23.223523 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaf5a5d-e1fe-4cb4-a524-3baa8c732fba service cinder] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:23.231752 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14f24a-ee65-4af6-9f73-24a004c5181e service nova] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:23.240080 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096e569-7537-487e-ab1f-d023f5ab66bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:23.240944 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 944/1895] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:35:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:35:23.242902 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096e569-7537-487e-ab1f-d023f5ab66bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:23.243304 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096e569-7537-487e-ab1f-d023f5ab66bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:23.243651 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096e569-7537-487e-ab1f-d023f5ab66bf admin admin] PATH_INFO: `/v3/users/21d20ad9a522468fa3627f55f7b10bb8` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:23.245585 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0096e569-7537-487e-ab1f-d023f5ab66bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=21d20ad9a522468fa3627f55f7b10bb8)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:23.247729 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0096e569-7537-487e-ab1f-d023f5ab66bf admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:23.586312 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-0096e569-7537-487e-ab1f-d023f5ab66bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21d20ad9a522468fa3627f55f7b10bb8'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:23.586993 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-0096e569-7537-487e-ab1f-d023f5ab66bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21d20ad9a522468fa3627f55f7b10bb8'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:23.703722 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-0096e569-7537-487e-ab1f-d023f5ab66bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21d20ad9a522468fa3627f55f7b10bb8'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:23.705142 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-0096e569-7537-487e-ab1f-d023f5ab66bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21d20ad9a522468fa3627f55f7b10bb8'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:23.713370 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-0096e569-7537-487e-ab1f-d023f5ab66bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21d20ad9a522468fa3627f55f7b10bb8'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:23.731856 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 952/1896] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:35:23 2022] DELETE /identity/v3/users/21d20ad9a522468fa3627f55f7b10bb8 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:35:23.736513 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51359c53-4b57-4c0b-9d7f-b3bee7dfdbce None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:23.743503 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51359c53-4b57-4c0b-9d7f-b3bee7dfdbce None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:23.743503 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51359c53-4b57-4c0b-9d7f-b3bee7dfdbce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:23.755882 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-51359c53-4b57-4c0b-9d7f-b3bee7dfdbce None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:23.757076 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-51359c53-4b57-4c0b-9d7f-b3bee7dfdbce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:23.858157 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 945/1897] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:35:23.872473 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096e569-7537-487e-ab1f-d023f5ab66bf admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:23.873998 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-0096e569-7537-487e-ab1f-d023f5ab66bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:23.944012 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096e569-7537-487e-ab1f-d023f5ab66bf admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:23.947892 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d04e6a-620b-45f7-addd-84f396d17858 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:23.948779 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d04e6a-620b-45f7-addd-84f396d17858 service neutron] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:23.949070 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d04e6a-620b-45f7-addd-84f396d17858 service neutron] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:23.949351 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d04e6a-620b-45f7-addd-84f396d17858 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:23.962534 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d04e6a-620b-45f7-addd-84f396d17858 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:23.964756 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d04e6a-620b-45f7-addd-84f396d17858 service neutron] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:23.982519 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 953/1898] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:35:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:35:24.217605 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:24.496359 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51359c53-4b57-4c0b-9d7f-b3bee7dfdbce None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:24.497913 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-51359c53-4b57-4c0b-9d7f-b3bee7dfdbce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:24.509735 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51359c53-4b57-4c0b-9d7f-b3bee7dfdbce None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:24.514926 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ff304-2fec-4cf4-a065-d4ded71df3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:24.515785 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ff304-2fec-4cf4-a065-d4ded71df3f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:24.516260 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ff304-2fec-4cf4-a065-d4ded71df3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:24.516709 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ff304-2fec-4cf4-a065-d4ded71df3f8 admin admin] PATH_INFO: `/v3/projects/6ce4e30857014ab09aeb62519a3e8f30` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:24.518081 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ff304-2fec-4cf4-a065-d4ded71df3f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ce4e30857014ab09aeb62519a3e8f30)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:24.520368 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ff304-2fec-4cf4-a065-d4ded71df3f8 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:24.524789 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=88,keystone:DELETE=4,keystone:INSERT=8 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:24.661870 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-296ff304-2fec-4cf4-a065-d4ded71df3f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ce4e30857014ab09aeb62519a3e8f30', 'request_id': 'req-296ff304-2fec-4cf4-a065-d4ded71df3f8'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:24.759303 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-296ff304-2fec-4cf4-a065-d4ded71df3f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ce4e30857014ab09aeb62519a3e8f30', 'request_id': 'req-296ff304-2fec-4cf4-a065-d4ded71df3f8'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:24.767215 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-296ff304-2fec-4cf4-a065-d4ded71df3f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ce4e30857014ab09aeb62519a3e8f30', 'request_id': 'req-296ff304-2fec-4cf4-a065-d4ded71df3f8'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:24.778981 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-296ff304-2fec-4cf4-a065-d4ded71df3f8 admin admin] The token cache is being invalidate because project 6ce4e30857014ab09aeb62519a3e8f30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:35:24.779268 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-296ff304-2fec-4cf4-a065-d4ded71df3f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:24.779927 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-296ff304-2fec-4cf4-a065-d4ded71df3f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:24.781489 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 946/1899] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:35:24 2022] DELETE /identity/v3/projects/6ce4e30857014ab09aeb62519a3e8f30 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:35:24.785473 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d04e6a-620b-45f7-addd-84f396d17858 service neutron] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:24.795221 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d04e6a-620b-45f7-addd-84f396d17858 service neutron] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:24.853137 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39bf2d-03f3-4854-a5b3-fe1c5c41f754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:24.854015 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39bf2d-03f3-4854-a5b3-fe1c5c41f754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:24.854300 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39bf2d-03f3-4854-a5b3-fe1c5c41f754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:24.854571 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39bf2d-03f3-4854-a5b3-fe1c5c41f754 admin admin] PATH_INFO: `/v3/users/7fe211e441284f9b96b837a43cccecd4` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:24.855768 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a39bf2d-03f3-4854-a5b3-fe1c5c41f754 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fe211e441284f9b96b837a43cccecd4)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:24.857717 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a39bf2d-03f3-4854-a5b3-fe1c5c41f754 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:25.083161 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-1a39bf2d-03f3-4854-a5b3-fe1c5c41f754 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fe211e441284f9b96b837a43cccecd4'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:25.083921 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-1a39bf2d-03f3-4854-a5b3-fe1c5c41f754 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fe211e441284f9b96b837a43cccecd4'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:25.184968 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-1a39bf2d-03f3-4854-a5b3-fe1c5c41f754 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fe211e441284f9b96b837a43cccecd4'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:25.199012 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-1a39bf2d-03f3-4854-a5b3-fe1c5c41f754 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fe211e441284f9b96b837a43cccecd4'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:25.206855 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-1a39bf2d-03f3-4854-a5b3-fe1c5c41f754 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fe211e441284f9b96b837a43cccecd4'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:25.224551 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 954/1900] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:35:24 2022] DELETE /identity/v3/users/7fe211e441284f9b96b837a43cccecd4 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:35:25.893323 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ff304-2fec-4cf4-a065-d4ded71df3f8 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:25.896377 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-296ff304-2fec-4cf4-a065-d4ded71df3f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:25.910634 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ff304-2fec-4cf4-a065-d4ded71df3f8 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:25.977633 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f536722e-a0dd-4fbb-b0a3-010bdb164595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:25.978492 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536722e-a0dd-4fbb-b0a3-010bdb164595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:25.979350 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536722e-a0dd-4fbb-b0a3-010bdb164595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:25.979635 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536722e-a0dd-4fbb-b0a3-010bdb164595 admin admin] PATH_INFO: `/v3/projects/f62019110faf42c5850002546a32f4ea` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:25.980838 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f536722e-a0dd-4fbb-b0a3-010bdb164595 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f62019110faf42c5850002546a32f4ea)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:25.982746 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f536722e-a0dd-4fbb-b0a3-010bdb164595 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:26.093089 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-f536722e-a0dd-4fbb-b0a3-010bdb164595 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f62019110faf42c5850002546a32f4ea', 'request_id': 'req-f536722e-a0dd-4fbb-b0a3-010bdb164595'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:26.160510 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-f536722e-a0dd-4fbb-b0a3-010bdb164595 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f62019110faf42c5850002546a32f4ea', 'request_id': 'req-f536722e-a0dd-4fbb-b0a3-010bdb164595'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:26.169592 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-f536722e-a0dd-4fbb-b0a3-010bdb164595 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f62019110faf42c5850002546a32f4ea', 'request_id': 'req-f536722e-a0dd-4fbb-b0a3-010bdb164595'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:26.185568 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-f536722e-a0dd-4fbb-b0a3-010bdb164595 admin admin] The token cache is being invalidate because project f62019110faf42c5850002546a32f4ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:35:26.185900 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-f536722e-a0dd-4fbb-b0a3-010bdb164595 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:26.186570 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-f536722e-a0dd-4fbb-b0a3-010bdb164595 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:26.188189 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 947/1901] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:35:25 2022] DELETE /identity/v3/projects/f62019110faf42c5850002546a32f4ea => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:35:26.197490 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2100e-d9e6-4efe-8e3f-a223199eb061 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:26.198367 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2100e-d9e6-4efe-8e3f-a223199eb061 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:26.198890 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2100e-d9e6-4efe-8e3f-a223199eb061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:26.220043 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-5bb2100e-d9e6-4efe-8e3f-a223199eb061 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:26.222624 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-5bb2100e-d9e6-4efe-8e3f-a223199eb061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:26.310026 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 955/1902] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:35:26.318272 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f70e6-2445-427a-b79d-df551a8e913f None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:26.322466 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f70e6-2445-427a-b79d-df551a8e913f None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:26.322466 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f70e6-2445-427a-b79d-df551a8e913f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:26.341034 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-d48f70e6-2445-427a-b79d-df551a8e913f None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:26.342907 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-d48f70e6-2445-427a-b79d-df551a8e913f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:26.356875 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 948/1903] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:35:26.360769 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb2100e-d9e6-4efe-8e3f-a223199eb061 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:26.372758 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb2100e-d9e6-4efe-8e3f-a223199eb061 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:26.378588 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53405f-8177-428a-96ed-a0ab3cd81c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:26.379715 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53405f-8177-428a-96ed-a0ab3cd81c55 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:26.380373 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53405f-8177-428a-96ed-a0ab3cd81c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:26.380657 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53405f-8177-428a-96ed-a0ab3cd81c55 admin admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:26.381441 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d53405f-8177-428a-96ed-a0ab3cd81c55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:35:26.381694 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d53405f-8177-428a-96ed-a0ab3cd81c55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:26.383815 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d53405f-8177-428a-96ed-a0ab3cd81c55 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:26.399643 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 956/1904] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:35:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:35:26.402728 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f70e6-2445-427a-b79d-df551a8e913f None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:26.412846 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f70e6-2445-427a-b79d-df551a8e913f None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:26.419998 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e9ed2-7dfb-401f-ac4c-d6bb7a505ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:26.421048 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e9ed2-7dfb-401f-ac4c-d6bb7a505ccc admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:26.421671 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e9ed2-7dfb-401f-ac4c-d6bb7a505ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:26.421951 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e9ed2-7dfb-401f-ac4c-d6bb7a505ccc admin admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:26.422771 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23e9ed2-7dfb-401f-ac4c-d6bb7a505ccc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:26.424798 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23e9ed2-7dfb-401f-ac4c-d6bb7a505ccc admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:26.625774 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 949/1905] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:35:26 2022] POST /identity/v3/projects => generated 373 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:35:26.629331 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53405f-8177-428a-96ed-a0ab3cd81c55 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:26.640076 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53405f-8177-428a-96ed-a0ab3cd81c55 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:26.702042 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1d2c1-3700-4fb7-8e4d-811e4ee1af08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:26.702713 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1d2c1-3700-4fb7-8e4d-811e4ee1af08 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:26.702991 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1d2c1-3700-4fb7-8e4d-811e4ee1af08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:26.703261 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1d2c1-3700-4fb7-8e4d-811e4ee1af08 admin admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:26.703954 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1d2c1-3700-4fb7-8e4d-811e4ee1af08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:26.705898 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1d2c1-3700-4fb7-8e4d-811e4ee1af08 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:26.841553 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 957/1906] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:35:26 2022] POST /identity/v3/users => generated 287 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:35:26.846097 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e9ed2-7dfb-401f-ac4c-d6bb7a505ccc admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:26.856558 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e9ed2-7dfb-401f-ac4c-d6bb7a505ccc admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:26.861984 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8d192-15cf-43a7-b30d-1533d7e0e8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:26.862673 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8d192-15cf-43a7-b30d-1533d7e0e8a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:26.862956 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8d192-15cf-43a7-b30d-1533d7e0e8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:26.863224 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8d192-15cf-43a7-b30d-1533d7e0e8a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:26.863964 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f8d192-15cf-43a7-b30d-1533d7e0e8a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:26.865827 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f8d192-15cf-43a7-b30d-1533d7e0e8a9 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:26.879657 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 950/1907] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:35:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:35:26.882403 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1d2c1-3700-4fb7-8e4d-811e4ee1af08 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:26.896485 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1d2c1-3700-4fb7-8e4d-811e4ee1af08 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:26.904162 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee5398-4a82-4865-9de8-f7ed7203b893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:26.904162 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee5398-4a82-4865-9de8-f7ed7203b893 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:26.904967 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee5398-4a82-4865-9de8-f7ed7203b893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:26.904967 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee5398-4a82-4865-9de8-f7ed7203b893 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:26.905609 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ee5398-4a82-4865-9de8-f7ed7203b893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:26.907386 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ee5398-4a82-4865-9de8-f7ed7203b893 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:26.926614 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 958/1908] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:35:26 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:35:26.931105 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8d192-15cf-43a7-b30d-1533d7e0e8a9 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:26.941540 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8d192-15cf-43a7-b30d-1533d7e0e8a9 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:26.958436 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b3619-e9ec-424a-abc4-3c1db064e759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:26.959551 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b3619-e9ec-424a-abc4-3c1db064e759 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:26.960260 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b3619-e9ec-424a-abc4-3c1db064e759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:26.960686 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b3619-e9ec-424a-abc4-3c1db064e759 admin admin] PATH_INFO: `/v3/projects/463d4c542b844c3aa0ff21fd7b455670/users/53f0fa68d99341e685ade3449a5c6ece/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:26.985626 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b3619-e9ec-424a-abc4-3c1db064e759 admin admin] RBAC: Authorizing `identity:create_grant(project_id=463d4c542b844c3aa0ff21fd7b455670, user_id=53f0fa68d99341e685ade3449a5c6ece, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:26.988333 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b3619-e9ec-424a-abc4-3c1db064e759 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:27.087566 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:27.096751 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 951/1909] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:35:26 2022] PUT /identity/v3/projects/463d4c542b844c3aa0ff21fd7b455670/users/53f0fa68d99341e685ade3449a5c6ece/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:35:27.110294 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3898cea-5cb9-4959-be0f-9239ec0502a7 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:27.110680 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3898cea-5cb9-4959-be0f-9239ec0502a7 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:27.110975 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3898cea-5cb9-4959-be0f-9239ec0502a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:27.143883 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-d3898cea-5cb9-4959-be0f-9239ec0502a7 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:27.145268 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-d3898cea-5cb9-4959-be0f-9239ec0502a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:27.207348 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:27.213444 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 959/1910] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:35:27.222994 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b3619-e9ec-424a-abc4-3c1db064e759 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:27.224710 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-909b3619-e9ec-424a-abc4-3c1db064e759 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:27.281290 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b3619-e9ec-424a-abc4-3c1db064e759 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:27.285134 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348f5ba-71cd-4681-981c-d9141b4729d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:27.285868 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348f5ba-71cd-4681-981c-d9141b4729d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:27.286062 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348f5ba-71cd-4681-981c-d9141b4729d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:27.286351 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348f5ba-71cd-4681-981c-d9141b4729d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:27.296223 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f348f5ba-71cd-4681-981c-d9141b4729d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:27.297719 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f348f5ba-71cd-4681-981c-d9141b4729d0 service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:27.307950 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 952/1911] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:35:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:35:28.844265 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be6734-eef0-4d6f-b1a5-e2b66298c044 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:28.844729 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be6734-eef0-4d6f-b1a5-e2b66298c044 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:28.844806 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be6734-eef0-4d6f-b1a5-e2b66298c044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:28.883148 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-f5be6734-eef0-4d6f-b1a5-e2b66298c044 None None] MFA Rules not processed for user `53f0fa68d99341e685ade3449a5c6ece`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:28.884387 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-f5be6734-eef0-4d6f-b1a5-e2b66298c044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:28.919453 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:28.958897 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 960/1912] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:35:29.097405 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348f5ba-71cd-4681-981c-d9141b4729d0 service neutron] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:29.098785 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-f348f5ba-71cd-4681-981c-d9141b4729d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:29.100785 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be6734-eef0-4d6f-b1a5-e2b66298c044 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:29.103239 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-f5be6734-eef0-4d6f-b1a5-e2b66298c044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:29.115750 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348f5ba-71cd-4681-981c-d9141b4729d0 service neutron] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:29.122452 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4418f4-b9ec-4e70-91c8-4ca558b4d9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:29.123708 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4418f4-b9ec-4e70-91c8-4ca558b4d9ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:29.124308 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4418f4-b9ec-4e70-91c8-4ca558b4d9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:29.125005 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4418f4-b9ec-4e70-91c8-4ca558b4d9ff admin admin] PATH_INFO: `/v3/users/298b697056f446fb841303d2132a5880` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:29.126556 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4418f4-b9ec-4e70-91c8-4ca558b4d9ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=298b697056f446fb841303d2132a5880)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:29.128988 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4418f4-b9ec-4e70-91c8-4ca558b4d9ff admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:29.199920 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be6734-eef0-4d6f-b1a5-e2b66298c044 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:29.203692 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f487f6d-0b38-4989-a9f4-b9c8d3870f2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:29.204384 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f487f6d-0b38-4989-a9f4-b9c8d3870f2c service cinder] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:29.204810 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f487f6d-0b38-4989-a9f4-b9c8d3870f2c service cinder] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:29.204929 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f487f6d-0b38-4989-a9f4-b9c8d3870f2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:29.214147 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f487f6d-0b38-4989-a9f4-b9c8d3870f2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:29.215589 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f487f6d-0b38-4989-a9f4-b9c8d3870f2c service cinder] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:29.224720 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 961/1913] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:35:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 09:35:29.456576 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-3b4418f4-b9ec-4e70-91c8-4ca558b4d9ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '298b697056f446fb841303d2132a5880'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:29.466718 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-3b4418f4-b9ec-4e70-91c8-4ca558b4d9ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '298b697056f446fb841303d2132a5880'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:29.554920 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-3b4418f4-b9ec-4e70-91c8-4ca558b4d9ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '298b697056f446fb841303d2132a5880'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:29.555563 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-3b4418f4-b9ec-4e70-91c8-4ca558b4d9ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '298b697056f446fb841303d2132a5880'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:29.556313 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:29.570456 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-3b4418f4-b9ec-4e70-91c8-4ca558b4d9ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '298b697056f446fb841303d2132a5880'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:29.586443 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 953/1914] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:35:29 2022] DELETE /identity/v3/users/298b697056f446fb841303d2132a5880 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:35:29.592149 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f162be1-9b8c-415c-a7c9-9d77ca4ef718 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:29.592582 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f162be1-9b8c-415c-a7c9-9d77ca4ef718 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:29.592798 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f162be1-9b8c-415c-a7c9-9d77ca4ef718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:29.610508 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-3f162be1-9b8c-415c-a7c9-9d77ca4ef718 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:29.611726 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-3f162be1-9b8c-415c-a7c9-9d77ca4ef718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:29.685198 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 962/1915] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 09:35:29.695906 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4418f4-b9ec-4e70-91c8-4ca558b4d9ff admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:29.698234 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-3b4418f4-b9ec-4e70-91c8-4ca558b4d9ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:29.775432 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4418f4-b9ec-4e70-91c8-4ca558b4d9ff admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:29.779682 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ebfaa-f3da-4411-97a3-8f70fe970d43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:29.780504 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ebfaa-f3da-4411-97a3-8f70fe970d43 service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:29.780873 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ebfaa-f3da-4411-97a3-8f70fe970d43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:29.781255 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ebfaa-f3da-4411-97a3-8f70fe970d43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:29.792569 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ebfaa-f3da-4411-97a3-8f70fe970d43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:29.802600 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ebfaa-f3da-4411-97a3-8f70fe970d43 service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:29.814872 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 954/1916] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:35:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:35:29.924354 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:30.360482 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f162be1-9b8c-415c-a7c9-9d77ca4ef718 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:30.362047 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-3f162be1-9b8c-415c-a7c9-9d77ca4ef718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:30.376764 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f162be1-9b8c-415c-a7c9-9d77ca4ef718 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:30.383216 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b252411-310c-4406-acd5-ddacc87aa197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:30.384230 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b252411-310c-4406-acd5-ddacc87aa197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:30.384596 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b252411-310c-4406-acd5-ddacc87aa197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:30.385504 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b252411-310c-4406-acd5-ddacc87aa197 admin admin] PATH_INFO: `/v3/projects/16c6132cad2141899af42c6a8d7b370f` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:30.386916 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b252411-310c-4406-acd5-ddacc87aa197 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16c6132cad2141899af42c6a8d7b370f)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:30.388920 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b252411-310c-4406-acd5-ddacc87aa197 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:30.520412 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-5b252411-310c-4406-acd5-ddacc87aa197 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16c6132cad2141899af42c6a8d7b370f', 'request_id': 'req-5b252411-310c-4406-acd5-ddacc87aa197'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:30.577904 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-5b252411-310c-4406-acd5-ddacc87aa197 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16c6132cad2141899af42c6a8d7b370f', 'request_id': 'req-5b252411-310c-4406-acd5-ddacc87aa197'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:30.584474 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-5b252411-310c-4406-acd5-ddacc87aa197 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16c6132cad2141899af42c6a8d7b370f', 'request_id': 'req-5b252411-310c-4406-acd5-ddacc87aa197'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:30.597164 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-5b252411-310c-4406-acd5-ddacc87aa197 admin admin] The token cache is being invalidate because project 16c6132cad2141899af42c6a8d7b370f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:35:30.597689 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-5b252411-310c-4406-acd5-ddacc87aa197 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:30.598668 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-5b252411-310c-4406-acd5-ddacc87aa197 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:30.600777 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 963/1917] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:35:30 2022] DELETE /identity/v3/projects/16c6132cad2141899af42c6a8d7b370f => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:35:30.604663 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ebfaa-f3da-4411-97a3-8f70fe970d43 service neutron] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:30.617347 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ebfaa-f3da-4411-97a3-8f70fe970d43 service neutron] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:30.681357 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69491a1-6d46-4edc-8e26-086ba461f81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:30.682902 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69491a1-6d46-4edc-8e26-086ba461f81d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:30.683188 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69491a1-6d46-4edc-8e26-086ba461f81d admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:30.683480 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69491a1-6d46-4edc-8e26-086ba461f81d admin admin] PATH_INFO: `/v3/users/51854c81b84641fab64421e5de3a3bb4` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:30.684775 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69491a1-6d46-4edc-8e26-086ba461f81d admin admin] RBAC: Authorizing `identity:delete_user(user_id=51854c81b84641fab64421e5de3a3bb4)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:30.686837 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69491a1-6d46-4edc-8e26-086ba461f81d admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:30.907254 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-f69491a1-6d46-4edc-8e26-086ba461f81d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51854c81b84641fab64421e5de3a3bb4'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:30.915319 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-f69491a1-6d46-4edc-8e26-086ba461f81d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51854c81b84641fab64421e5de3a3bb4'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:30.993002 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-f69491a1-6d46-4edc-8e26-086ba461f81d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51854c81b84641fab64421e5de3a3bb4'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:30.994129 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-f69491a1-6d46-4edc-8e26-086ba461f81d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51854c81b84641fab64421e5de3a3bb4'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:31.006328 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-f69491a1-6d46-4edc-8e26-086ba461f81d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51854c81b84641fab64421e5de3a3bb4'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:31.013125 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 955/1918] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:35:30 2022] DELETE /identity/v3/users/51854c81b84641fab64421e5de3a3bb4 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:35:31.530387 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b252411-310c-4406-acd5-ddacc87aa197 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:31.533586 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-5b252411-310c-4406-acd5-ddacc87aa197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:31.598854 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b252411-310c-4406-acd5-ddacc87aa197 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:31.687950 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07149b5d-3d62-4480-b14c-ae1082333be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:31.688876 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07149b5d-3d62-4480-b14c-ae1082333be6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:31.689315 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07149b5d-3d62-4480-b14c-ae1082333be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:31.689749 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07149b5d-3d62-4480-b14c-ae1082333be6 admin admin] PATH_INFO: `/v3/projects/b0e5f27f9db74fa793a36054846c70bb` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:31.692173 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07149b5d-3d62-4480-b14c-ae1082333be6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0e5f27f9db74fa793a36054846c70bb)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:31.694414 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07149b5d-3d62-4480-b14c-ae1082333be6 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:31.868773 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-07149b5d-3d62-4480-b14c-ae1082333be6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0e5f27f9db74fa793a36054846c70bb', 'request_id': 'req-07149b5d-3d62-4480-b14c-ae1082333be6'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:31.922800 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:31.949293 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-07149b5d-3d62-4480-b14c-ae1082333be6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0e5f27f9db74fa793a36054846c70bb', 'request_id': 'req-07149b5d-3d62-4480-b14c-ae1082333be6'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:31.971275 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-07149b5d-3d62-4480-b14c-ae1082333be6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0e5f27f9db74fa793a36054846c70bb', 'request_id': 'req-07149b5d-3d62-4480-b14c-ae1082333be6'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:32.005724 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-07149b5d-3d62-4480-b14c-ae1082333be6 admin admin] The token cache is being invalidate because project b0e5f27f9db74fa793a36054846c70bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:35:32.006528 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-07149b5d-3d62-4480-b14c-ae1082333be6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:32.007513 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-07149b5d-3d62-4480-b14c-ae1082333be6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:32.012799 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 964/1919] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:35:31 2022] DELETE /identity/v3/projects/b0e5f27f9db74fa793a36054846c70bb => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:35:32.016950 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69491a1-6d46-4edc-8e26-086ba461f81d admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:32.018545 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-f69491a1-6d46-4edc-8e26-086ba461f81d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:32.038714 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69491a1-6d46-4edc-8e26-086ba461f81d admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:32.225104 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f635fb6-3ed1-49d9-ba1a-605ef722cf25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:32.225958 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f635fb6-3ed1-49d9-ba1a-605ef722cf25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:32.226512 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f635fb6-3ed1-49d9-ba1a-605ef722cf25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:32.228270 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f635fb6-3ed1-49d9-ba1a-605ef722cf25 admin admin] PATH_INFO: `/v3/users/537783683fae4ee198e49958aca62d1d` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:32.234662 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f635fb6-3ed1-49d9-ba1a-605ef722cf25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=537783683fae4ee198e49958aca62d1d)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:32.242438 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f635fb6-3ed1-49d9-ba1a-605ef722cf25 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:32.283562 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa1789-c4b5-40db-9d04-b45530601b6e None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:32.283849 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa1789-c4b5-40db-9d04-b45530601b6e None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:32.284125 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa1789-c4b5-40db-9d04-b45530601b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:32.307014 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-6daa1789-c4b5-40db-9d04-b45530601b6e None None] MFA Rules not processed for user `53f0fa68d99341e685ade3449a5c6ece`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:32.308443 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-6daa1789-c4b5-40db-9d04-b45530601b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:32.373431 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 965/1920] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:35:32.484914 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:32.528781 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-6f635fb6-3ed1-49d9-ba1a-605ef722cf25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '537783683fae4ee198e49958aca62d1d'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:32.537057 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-6f635fb6-3ed1-49d9-ba1a-605ef722cf25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '537783683fae4ee198e49958aca62d1d'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:32.640728 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-6f635fb6-3ed1-49d9-ba1a-605ef722cf25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '537783683fae4ee198e49958aca62d1d'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:32.642113 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-6f635fb6-3ed1-49d9-ba1a-605ef722cf25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '537783683fae4ee198e49958aca62d1d'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:32.658206 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-6f635fb6-3ed1-49d9-ba1a-605ef722cf25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '537783683fae4ee198e49958aca62d1d'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:32.664639 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 956/1921] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:35:32 2022] DELETE /identity/v3/users/537783683fae4ee198e49958aca62d1d => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:35:33.346840 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa1789-c4b5-40db-9d04-b45530601b6e None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:33.349575 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-6daa1789-c4b5-40db-9d04-b45530601b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:33.382945 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa1789-c4b5-40db-9d04-b45530601b6e None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:33.497200 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc4429-9cb7-4123-a7c3-d191690318f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:33.498200 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc4429-9cb7-4123-a7c3-d191690318f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:33.501049 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc4429-9cb7-4123-a7c3-d191690318f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:33.501049 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc4429-9cb7-4123-a7c3-d191690318f9 admin admin] PATH_INFO: `/v3/projects/fdd02a45b0eb400ab1e88a23374d10fd` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:33.501049 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dc4429-9cb7-4123-a7c3-d191690318f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdd02a45b0eb400ab1e88a23374d10fd)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:33.505030 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dc4429-9cb7-4123-a7c3-d191690318f9 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:33.524940 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:33.672942 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-e3dc4429-9cb7-4123-a7c3-d191690318f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdd02a45b0eb400ab1e88a23374d10fd', 'request_id': 'req-e3dc4429-9cb7-4123-a7c3-d191690318f9'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:33.754461 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-e3dc4429-9cb7-4123-a7c3-d191690318f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdd02a45b0eb400ab1e88a23374d10fd', 'request_id': 'req-e3dc4429-9cb7-4123-a7c3-d191690318f9'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:33.761395 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-e3dc4429-9cb7-4123-a7c3-d191690318f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdd02a45b0eb400ab1e88a23374d10fd', 'request_id': 'req-e3dc4429-9cb7-4123-a7c3-d191690318f9'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:33.772698 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-e3dc4429-9cb7-4123-a7c3-d191690318f9 admin admin] The token cache is being invalidate because project fdd02a45b0eb400ab1e88a23374d10fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:35:33.772984 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-e3dc4429-9cb7-4123-a7c3-d191690318f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:33.773620 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-e3dc4429-9cb7-4123-a7c3-d191690318f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:33.775210 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 966/1922] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:35:33 2022] DELETE /identity/v3/projects/fdd02a45b0eb400ab1e88a23374d10fd => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:35:33.781350 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c95da-1f12-4132-9ffe-c196338f4433 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:33.781706 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c95da-1f12-4132-9ffe-c196338f4433 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:33.781985 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c95da-1f12-4132-9ffe-c196338f4433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:33.799913 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-488c95da-1f12-4132-9ffe-c196338f4433 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:33.801141 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-488c95da-1f12-4132-9ffe-c196338f4433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:33.888558 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 957/1923] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:35:33.897065 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de313b7-f4d5-41ad-896d-051d4e7ed323 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:33.897358 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de313b7-f4d5-41ad-896d-051d4e7ed323 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:33.897640 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de313b7-f4d5-41ad-896d-051d4e7ed323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:33.915662 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-7de313b7-f4d5-41ad-896d-051d4e7ed323 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:33.916841 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-7de313b7-f4d5-41ad-896d-051d4e7ed323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:33.938237 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 967/1924] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:35:33.942664 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488c95da-1f12-4132-9ffe-c196338f4433 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:33.953246 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488c95da-1f12-4132-9ffe-c196338f4433 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:33.958081 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f146d-58ac-424a-9656-e30ab521dce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:33.958736 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f146d-58ac-424a-9656-e30ab521dce0 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:33.959023 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f146d-58ac-424a-9656-e30ab521dce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:33.959301 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f146d-58ac-424a-9656-e30ab521dce0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:33.960064 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4f146d-58ac-424a-9656-e30ab521dce0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:35:33.960406 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4f146d-58ac-424a-9656-e30ab521dce0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:33.962010 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4f146d-58ac-424a-9656-e30ab521dce0 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:33.978253 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 958/1925] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:35:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:35:33.984709 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de313b7-f4d5-41ad-896d-051d4e7ed323 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:33.989482 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de313b7-f4d5-41ad-896d-051d4e7ed323 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:33.995077 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31738281-6d14-4586-9071-424534215668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:33.995732 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31738281-6d14-4586-9071-424534215668 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:33.996012 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31738281-6d14-4586-9071-424534215668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:33.996360 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31738281-6d14-4586-9071-424534215668 admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:33.997052 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31738281-6d14-4586-9071-424534215668 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:33.998951 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31738281-6d14-4586-9071-424534215668 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:34.147580 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 968/1926] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:35:33 2022] POST /identity/v3/projects => generated 387 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:35:34.149171 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f146d-58ac-424a-9656-e30ab521dce0 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:34.169092 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f146d-58ac-424a-9656-e30ab521dce0 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:34.234001 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:34.238438 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e2175-1323-4937-8535-2bf056f39ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:34.239255 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e2175-1323-4937-8535-2bf056f39ff3 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:34.239537 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e2175-1323-4937-8535-2bf056f39ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:34.242310 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e2175-1323-4937-8535-2bf056f39ff3 admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:34.242310 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e2175-1323-4937-8535-2bf056f39ff3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:34.242697 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e2175-1323-4937-8535-2bf056f39ff3 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:34.342667 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 959/1927] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:35:34 2022] POST /identity/v3/users => generated 294 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 09:35:34.346482 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31738281-6d14-4586-9071-424534215668 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:34.360500 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31738281-6d14-4586-9071-424534215668 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:34.365932 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742674f9-3447-4e01-a4a0-6f02afb7c7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:34.368030 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742674f9-3447-4e01-a4a0-6f02afb7c7bc admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:34.368606 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742674f9-3447-4e01-a4a0-6f02afb7c7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:34.368972 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742674f9-3447-4e01-a4a0-6f02afb7c7bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:34.369809 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742674f9-3447-4e01-a4a0-6f02afb7c7bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:34.371876 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742674f9-3447-4e01-a4a0-6f02afb7c7bc admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:34.384071 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 969/1928] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:35:34.388400 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e2175-1323-4937-8535-2bf056f39ff3 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:34.400945 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e2175-1323-4937-8535-2bf056f39ff3 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:34.406981 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b020b1-3d2e-4b9d-a403-819f04722a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:34.407930 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b020b1-3d2e-4b9d-a403-819f04722a9a admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:34.408246 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b020b1-3d2e-4b9d-a403-819f04722a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:34.408531 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b020b1-3d2e-4b9d-a403-819f04722a9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:34.409266 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b020b1-3d2e-4b9d-a403-819f04722a9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:34.411616 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b020b1-3d2e-4b9d-a403-819f04722a9a admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:34.423976 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 960/1929] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:35:34.428275 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742674f9-3447-4e01-a4a0-6f02afb7c7bc admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:34.438883 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742674f9-3447-4e01-a4a0-6f02afb7c7bc admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:34.443705 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082bd0f-1f59-4db3-bd42-bd7cb95b9b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:34.444624 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082bd0f-1f59-4db3-bd42-bd7cb95b9b24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:34.444905 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082bd0f-1f59-4db3-bd42-bd7cb95b9b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:34.445181 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082bd0f-1f59-4db3-bd42-bd7cb95b9b24 admin admin] PATH_INFO: `/v3/projects/69573c6a3d4545619b428929ba255f5f/users/db1c8df2077d45f094913409d0e3cd53/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:34.460919 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c082bd0f-1f59-4db3-bd42-bd7cb95b9b24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69573c6a3d4545619b428929ba255f5f, user_id=db1c8df2077d45f094913409d0e3cd53, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:34.464494 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c082bd0f-1f59-4db3-bd42-bd7cb95b9b24 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:34.560486 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 970/1930] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:35:34 2022] PUT /identity/v3/projects/69573c6a3d4545619b428929ba255f5f/users/db1c8df2077d45f094913409d0e3cd53/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:35:34.567092 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ada9db-67b5-4559-a7dd-58cea6286c79 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:34.567570 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ada9db-67b5-4559-a7dd-58cea6286c79 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:34.567650 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ada9db-67b5-4559-a7dd-58cea6286c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:34.597917 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-b8ada9db-67b5-4559-a7dd-58cea6286c79 None None] MFA Rules not processed for user `db1c8df2077d45f094913409d0e3cd53`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:34.601500 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-b8ada9db-67b5-4559-a7dd-58cea6286c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:34.673121 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 961/1931] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 09:35:34.674607 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082bd0f-1f59-4db3-bd42-bd7cb95b9b24 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:34.745063 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082bd0f-1f59-4db3-bd42-bd7cb95b9b24 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:34.749887 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9617b-5e0d-4218-930d-518dabe6d43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:34.750553 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9617b-5e0d-4218-930d-518dabe6d43c admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:34.750832 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9617b-5e0d-4218-930d-518dabe6d43c admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:34.751104 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9617b-5e0d-4218-930d-518dabe6d43c admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:34.751805 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f9617b-5e0d-4218-930d-518dabe6d43c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:34.753852 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f9617b-5e0d-4218-930d-518dabe6d43c admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:34.831643 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 971/1932] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:35:34 2022] POST /identity/v3/projects => generated 389 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:35:34.835964 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ada9db-67b5-4559-a7dd-58cea6286c79 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:34.848524 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ada9db-67b5-4559-a7dd-58cea6286c79 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:34.864183 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:34.925966 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598c03c-c2e6-46d8-97d6-842c72da30fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:34.928110 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598c03c-c2e6-46d8-97d6-842c72da30fc admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:34.928110 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598c03c-c2e6-46d8-97d6-842c72da30fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:34.928110 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598c03c-c2e6-46d8-97d6-842c72da30fc admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:34.929679 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6598c03c-c2e6-46d8-97d6-842c72da30fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:34.931927 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6598c03c-c2e6-46d8-97d6-842c72da30fc admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:35.040913 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 962/1933] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:35:34 2022] POST /identity/v3/users => generated 301 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:35:35.045190 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9617b-5e0d-4218-930d-518dabe6d43c admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:35.055888 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9617b-5e0d-4218-930d-518dabe6d43c admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:35.060908 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7b972-de8a-406f-b292-e3f5d9c5537f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:35.061671 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7b972-de8a-406f-b292-e3f5d9c5537f admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:35.061958 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7b972-de8a-406f-b292-e3f5d9c5537f admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:35.062233 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7b972-de8a-406f-b292-e3f5d9c5537f admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:35.062959 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d7b972-de8a-406f-b292-e3f5d9c5537f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:35.064638 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d7b972-de8a-406f-b292-e3f5d9c5537f admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:35.090012 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 972/1934] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:35:35.093920 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598c03c-c2e6-46d8-97d6-842c72da30fc admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:35.113746 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598c03c-c2e6-46d8-97d6-842c72da30fc admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:35.122973 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3505c3-2e58-4868-8541-2586affbf221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:35.124045 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3505c3-2e58-4868-8541-2586affbf221 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:35.124373 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3505c3-2e58-4868-8541-2586affbf221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:35.124687 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3505c3-2e58-4868-8541-2586affbf221 admin admin] PATH_INFO: `/v3/projects/14e3c1569bf3486e8c151e51d40ecc10/users/484a04427f8445b9846c587b43c01d71/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:35.152217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3505c3-2e58-4868-8541-2586affbf221 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14e3c1569bf3486e8c151e51d40ecc10, user_id=484a04427f8445b9846c587b43c01d71, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:35.158738 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3505c3-2e58-4868-8541-2586affbf221 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:35.166400 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:35.301317 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 963/1935] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:35:35 2022] PUT /identity/v3/projects/14e3c1569bf3486e8c151e51d40ecc10/users/484a04427f8445b9846c587b43c01d71/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:35:35.307507 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7b972-de8a-406f-b292-e3f5d9c5537f admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:35.321565 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7b972-de8a-406f-b292-e3f5d9c5537f admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:35.409505 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98729c-b51d-4f30-8d4a-1aca21fd79a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:35.410201 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98729c-b51d-4f30-8d4a-1aca21fd79a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:35.410458 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98729c-b51d-4f30-8d4a-1aca21fd79a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:35.410737 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98729c-b51d-4f30-8d4a-1aca21fd79a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:35.411944 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d98729c-b51d-4f30-8d4a-1aca21fd79a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:35.413630 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d98729c-b51d-4f30-8d4a-1aca21fd79a1 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:35.437618 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 973/1936] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:35:35.438488 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3505c3-2e58-4868-8541-2586affbf221 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:35.443148 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3505c3-2e58-4868-8541-2586affbf221 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:35.453689 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc2fd0-89a4-48f4-9816-dd896dcc56a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:35.453689 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc2fd0-89a4-48f4-9816-dd896dcc56a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:35.453689 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc2fd0-89a4-48f4-9816-dd896dcc56a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:35.453689 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc2fd0-89a4-48f4-9816-dd896dcc56a0 admin admin] PATH_INFO: `/v3/projects/14e3c1569bf3486e8c151e51d40ecc10/users/484a04427f8445b9846c587b43c01d71/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:35.454043 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cc2fd0-89a4-48f4-9816-dd896dcc56a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14e3c1569bf3486e8c151e51d40ecc10, user_id=484a04427f8445b9846c587b43c01d71, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:35.456338 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cc2fd0-89a4-48f4-9816-dd896dcc56a0 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:35.467560 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 964/1937] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:35:35 2022] PUT /identity/v3/projects/14e3c1569bf3486e8c151e51d40ecc10/users/484a04427f8445b9846c587b43c01d71/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:35:35.477832 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49923b78-20e0-4a45-af96-95160d31d7a6 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:35.483666 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49923b78-20e0-4a45-af96-95160d31d7a6 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:35.483666 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49923b78-20e0-4a45-af96-95160d31d7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:35.511061 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-49923b78-20e0-4a45-af96-95160d31d7a6 None None] MFA Rules not processed for user `484a04427f8445b9846c587b43c01d71`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:35.512406 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-49923b78-20e0-4a45-af96-95160d31d7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:35.607786 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 974/1938] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:35 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:35:36.029330 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc2fd0-89a4-48f4-9816-dd896dcc56a0 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:36.031042 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-50cc2fd0-89a4-48f4-9816-dd896dcc56a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:36.092610 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc2fd0-89a4-48f4-9816-dd896dcc56a0 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:36.096688 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f49023-d9a0-41e2-8470-ca6b724c95ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:36.097346 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f49023-d9a0-41e2-8470-ca6b724c95ea service cinder] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:36.101298 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f49023-d9a0-41e2-8470-ca6b724c95ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:36.101298 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f49023-d9a0-41e2-8470-ca6b724c95ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:36.108730 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f49023-d9a0-41e2-8470-ca6b724c95ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:36.110649 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f49023-d9a0-41e2-8470-ca6b724c95ea service cinder] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:36.123521 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 965/1939] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:35:36 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:35:36.244300 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:36.304872 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49923b78-20e0-4a45-af96-95160d31d7a6 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:36.388760 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49923b78-20e0-4a45-af96-95160d31d7a6 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:36.395827 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12224267-7df0-44cf-9e13-d4cbec27f297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:36.396917 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12224267-7df0-44cf-9e13-d4cbec27f297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:36.397270 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12224267-7df0-44cf-9e13-d4cbec27f297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:36.397610 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12224267-7df0-44cf-9e13-d4cbec27f297 admin admin] PATH_INFO: `/v3/users/db1c8df2077d45f094913409d0e3cd53` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:36.399384 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12224267-7df0-44cf-9e13-d4cbec27f297 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db1c8df2077d45f094913409d0e3cd53)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:36.402077 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12224267-7df0-44cf-9e13-d4cbec27f297 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:36.605550 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-12224267-7df0-44cf-9e13-d4cbec27f297 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db1c8df2077d45f094913409d0e3cd53'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:36.606239 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-12224267-7df0-44cf-9e13-d4cbec27f297 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db1c8df2077d45f094913409d0e3cd53'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:36.703331 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-12224267-7df0-44cf-9e13-d4cbec27f297 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db1c8df2077d45f094913409d0e3cd53'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:36.704258 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-12224267-7df0-44cf-9e13-d4cbec27f297 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db1c8df2077d45f094913409d0e3cd53'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:36.713496 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-12224267-7df0-44cf-9e13-d4cbec27f297 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db1c8df2077d45f094913409d0e3cd53'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:36.738520 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 975/1940] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:35:36 2022] DELETE /identity/v3/users/db1c8df2077d45f094913409d0e3cd53 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:35:36.743357 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bcbc67-ea08-49eb-b3db-b15f7e980326 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:36.743751 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bcbc67-ea08-49eb-b3db-b15f7e980326 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:36.747299 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bcbc67-ea08-49eb-b3db-b15f7e980326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:36.768960 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-58bcbc67-ea08-49eb-b3db-b15f7e980326 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:36.771865 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:36.774323 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-58bcbc67-ea08-49eb-b3db-b15f7e980326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:36.891520 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 966/1941] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:35:36.901342 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12224267-7df0-44cf-9e13-d4cbec27f297 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:36.903850 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-12224267-7df0-44cf-9e13-d4cbec27f297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:36.967485 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12224267-7df0-44cf-9e13-d4cbec27f297 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:36.971562 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591340a6-1d82-4efa-a0dd-3e29b2183d55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:36.972247 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591340a6-1d82-4efa-a0dd-3e29b2183d55 service neutron] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:36.974955 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591340a6-1d82-4efa-a0dd-3e29b2183d55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:36.974955 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591340a6-1d82-4efa-a0dd-3e29b2183d55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:36.983454 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591340a6-1d82-4efa-a0dd-3e29b2183d55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:36.985340 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591340a6-1d82-4efa-a0dd-3e29b2183d55 service neutron] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:36.997167 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 976/1942] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:35:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 09:35:37.670877 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bcbc67-ea08-49eb-b3db-b15f7e980326 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:37.670877 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-58bcbc67-ea08-49eb-b3db-b15f7e980326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:37.674765 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:37.685727 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bcbc67-ea08-49eb-b3db-b15f7e980326 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:37.691177 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a575b-9d2a-41c4-b53a-a4fdbfde10f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:37.692314 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a575b-9d2a-41c4-b53a-a4fdbfde10f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:37.692866 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a575b-9d2a-41c4-b53a-a4fdbfde10f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:37.693315 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a575b-9d2a-41c4-b53a-a4fdbfde10f4 admin admin] PATH_INFO: `/v3/projects/69573c6a3d4545619b428929ba255f5f` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:37.695079 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a575b-9d2a-41c4-b53a-a4fdbfde10f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69573c6a3d4545619b428929ba255f5f)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:37.698429 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a575b-9d2a-41c4-b53a-a4fdbfde10f4 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:37.819660 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-7a5a575b-9d2a-41c4-b53a-a4fdbfde10f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69573c6a3d4545619b428929ba255f5f', 'request_id': 'req-7a5a575b-9d2a-41c4-b53a-a4fdbfde10f4'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:37.903386 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-7a5a575b-9d2a-41c4-b53a-a4fdbfde10f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69573c6a3d4545619b428929ba255f5f', 'request_id': 'req-7a5a575b-9d2a-41c4-b53a-a4fdbfde10f4'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:37.911276 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-7a5a575b-9d2a-41c4-b53a-a4fdbfde10f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69573c6a3d4545619b428929ba255f5f', 'request_id': 'req-7a5a575b-9d2a-41c4-b53a-a4fdbfde10f4'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:37.926836 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-7a5a575b-9d2a-41c4-b53a-a4fdbfde10f4 admin admin] The token cache is being invalidate because project 69573c6a3d4545619b428929ba255f5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:35:37.927278 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-7a5a575b-9d2a-41c4-b53a-a4fdbfde10f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:37.928158 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-7a5a575b-9d2a-41c4-b53a-a4fdbfde10f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:37.932462 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 967/1943] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:35:37 2022] DELETE /identity/v3/projects/69573c6a3d4545619b428929ba255f5f => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:35:37.934817 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591340a6-1d82-4efa-a0dd-3e29b2183d55 service neutron] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:37.945781 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591340a6-1d82-4efa-a0dd-3e29b2183d55 service neutron] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:37.982967 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:38.016357 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b5b61-fc20-4163-88ec-8b4d071d87c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:38.017252 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b5b61-fc20-4163-88ec-8b4d071d87c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:38.017531 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b5b61-fc20-4163-88ec-8b4d071d87c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:38.017805 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b5b61-fc20-4163-88ec-8b4d071d87c5 admin admin] PATH_INFO: `/v3/users/484a04427f8445b9846c587b43c01d71` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:38.019076 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b5b61-fc20-4163-88ec-8b4d071d87c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=484a04427f8445b9846c587b43c01d71)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:38.021074 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b5b61-fc20-4163-88ec-8b4d071d87c5 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:38.201331 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-cb9b5b61-fc20-4163-88ec-8b4d071d87c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '484a04427f8445b9846c587b43c01d71'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:38.202381 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-cb9b5b61-fc20-4163-88ec-8b4d071d87c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '484a04427f8445b9846c587b43c01d71'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:38.269429 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:38.309111 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-cb9b5b61-fc20-4163-88ec-8b4d071d87c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '484a04427f8445b9846c587b43c01d71'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:38.309743 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-cb9b5b61-fc20-4163-88ec-8b4d071d87c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '484a04427f8445b9846c587b43c01d71'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:38.318679 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-cb9b5b61-fc20-4163-88ec-8b4d071d87c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '484a04427f8445b9846c587b43c01d71'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:38.336304 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 977/1944] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:35:37 2022] DELETE /identity/v3/users/484a04427f8445b9846c587b43c01d71 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:35:38.931121 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a575b-9d2a-41c4-b53a-a4fdbfde10f4 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:38.932475 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-7a5a575b-9d2a-41c4-b53a-a4fdbfde10f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:38.957929 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a575b-9d2a-41c4-b53a-a4fdbfde10f4 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:39.054763 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a1c3b-a9d2-4ed0-9747-af8572127836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:39.055705 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a1c3b-a9d2-4ed0-9747-af8572127836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:39.056165 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a1c3b-a9d2-4ed0-9747-af8572127836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:39.057151 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a1c3b-a9d2-4ed0-9747-af8572127836 admin admin] PATH_INFO: `/v3/projects/14e3c1569bf3486e8c151e51d40ecc10` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:39.058598 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a1c3b-a9d2-4ed0-9747-af8572127836 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14e3c1569bf3486e8c151e51d40ecc10)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:39.060819 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a1c3b-a9d2-4ed0-9747-af8572127836 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:39.172529 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-339a1c3b-a9d2-4ed0-9747-af8572127836 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14e3c1569bf3486e8c151e51d40ecc10', 'request_id': 'req-339a1c3b-a9d2-4ed0-9747-af8572127836'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:39.286990 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-339a1c3b-a9d2-4ed0-9747-af8572127836 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14e3c1569bf3486e8c151e51d40ecc10', 'request_id': 'req-339a1c3b-a9d2-4ed0-9747-af8572127836'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:39.302999 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-339a1c3b-a9d2-4ed0-9747-af8572127836 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14e3c1569bf3486e8c151e51d40ecc10', 'request_id': 'req-339a1c3b-a9d2-4ed0-9747-af8572127836'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:39.335108 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-339a1c3b-a9d2-4ed0-9747-af8572127836 admin admin] The token cache is being invalidate because project 14e3c1569bf3486e8c151e51d40ecc10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:35:39.339731 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-339a1c3b-a9d2-4ed0-9747-af8572127836 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:39.342017 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-339a1c3b-a9d2-4ed0-9747-af8572127836 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:39.345623 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 968/1945] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:35:38 2022] DELETE /identity/v3/projects/14e3c1569bf3486e8c151e51d40ecc10 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:35:39.351087 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce3349-b880-4fcd-9dd3-0117e99f5442 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:39.351610 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce3349-b880-4fcd-9dd3-0117e99f5442 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:39.351893 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce3349-b880-4fcd-9dd3-0117e99f5442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:39.373685 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-49ce3349-b880-4fcd-9dd3-0117e99f5442 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:39.375471 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-49ce3349-b880-4fcd-9dd3-0117e99f5442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:39.441987 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 978/1946] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:35:39.453270 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc19f0-ca0d-4ca5-b8be-e427a18b237d None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:39.453663 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc19f0-ca0d-4ca5-b8be-e427a18b237d None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:39.454103 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc19f0-ca0d-4ca5-b8be-e427a18b237d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:39.483959 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-4ccc19f0-ca0d-4ca5-b8be-e427a18b237d None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:39.485359 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-4ccc19f0-ca0d-4ca5-b8be-e427a18b237d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:39.496678 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 969/1947] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:35:39.501077 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce3349-b880-4fcd-9dd3-0117e99f5442 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:39.511515 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce3349-b880-4fcd-9dd3-0117e99f5442 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:39.525586 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57688e97-592b-4fb3-9c54-d8adff3d923c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:39.526469 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57688e97-592b-4fb3-9c54-d8adff3d923c admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:39.526753 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57688e97-592b-4fb3-9c54-d8adff3d923c admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:39.527024 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57688e97-592b-4fb3-9c54-d8adff3d923c admin admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:39.527757 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57688e97-592b-4fb3-9c54-d8adff3d923c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:35:39.528142 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57688e97-592b-4fb3-9c54-d8adff3d923c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:39.530948 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57688e97-592b-4fb3-9c54-d8adff3d923c admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:39.551919 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 979/1948] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:35:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:35:39.557100 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc19f0-ca0d-4ca5-b8be-e427a18b237d None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:39.568046 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc19f0-ca0d-4ca5-b8be-e427a18b237d None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:39.573399 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc562389-b568-4e71-a486-d80920ee7276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:39.576337 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc562389-b568-4e71-a486-d80920ee7276 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:39.576337 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc562389-b568-4e71-a486-d80920ee7276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:39.576337 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc562389-b568-4e71-a486-d80920ee7276 admin admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:39.576337 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc562389-b568-4e71-a486-d80920ee7276 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:39.577797 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc562389-b568-4e71-a486-d80920ee7276 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:39.710287 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 970/1949] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:35:39 2022] POST /identity/v3/projects => generated 387 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:35:39.714651 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57688e97-592b-4fb3-9c54-d8adff3d923c admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:39.725037 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57688e97-592b-4fb3-9c54-d8adff3d923c admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:39.843544 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b8b80-a3b0-458c-ae12-f6808a444000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:39.843839 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b8b80-a3b0-458c-ae12-f6808a444000 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:39.844083 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b8b80-a3b0-458c-ae12-f6808a444000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:39.844400 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b8b80-a3b0-458c-ae12-f6808a444000 admin admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:39.845247 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64b8b80-a3b0-458c-ae12-f6808a444000 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:39.849096 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64b8b80-a3b0-458c-ae12-f6808a444000 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:39.927349 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:39.976605 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 980/1950] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:35:39 2022] POST /identity/v3/users => generated 294 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 09:35:39.980400 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc562389-b568-4e71-a486-d80920ee7276 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:39.995042 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc562389-b568-4e71-a486-d80920ee7276 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:40.010364 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaff8cc-9250-4292-a87a-2f5dfab2491a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:40.011350 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaff8cc-9250-4292-a87a-2f5dfab2491a admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:40.011792 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaff8cc-9250-4292-a87a-2f5dfab2491a admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:40.012284 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaff8cc-9250-4292-a87a-2f5dfab2491a admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:40.013318 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaff8cc-9250-4292-a87a-2f5dfab2491a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:40.015158 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaff8cc-9250-4292-a87a-2f5dfab2491a admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:40.029556 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 971/1951] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:35:40.039330 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b8b80-a3b0-458c-ae12-f6808a444000 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:40.059095 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b8b80-a3b0-458c-ae12-f6808a444000 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:40.074216 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081ccfe-63c7-40f3-b32f-51c90686b858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:40.075804 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081ccfe-63c7-40f3-b32f-51c90686b858 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:40.076292 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081ccfe-63c7-40f3-b32f-51c90686b858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:40.076711 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081ccfe-63c7-40f3-b32f-51c90686b858 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:40.077620 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5081ccfe-63c7-40f3-b32f-51c90686b858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:40.079547 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5081ccfe-63c7-40f3-b32f-51c90686b858 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:40.093419 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 981/1952] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:35:40.097297 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaff8cc-9250-4292-a87a-2f5dfab2491a admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:40.110322 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaff8cc-9250-4292-a87a-2f5dfab2491a admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:40.125970 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d78fe7-ea0e-4082-afc7-ba5f5c129019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:40.126930 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d78fe7-ea0e-4082-afc7-ba5f5c129019 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:40.127226 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d78fe7-ea0e-4082-afc7-ba5f5c129019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:40.127503 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d78fe7-ea0e-4082-afc7-ba5f5c129019 admin admin] PATH_INFO: `/v3/projects/407fce435fa34f5d96c2b1c2f40874cf/users/a841adbf7dac487a81e4e452f16042e2/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:40.175533 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d78fe7-ea0e-4082-afc7-ba5f5c129019 admin admin] RBAC: Authorizing `identity:create_grant(project_id=407fce435fa34f5d96c2b1c2f40874cf, user_id=a841adbf7dac487a81e4e452f16042e2, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:40.178891 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d78fe7-ea0e-4082-afc7-ba5f5c129019 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:40.248417 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:40.277288 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 972/1953] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:35:40 2022] PUT /identity/v3/projects/407fce435fa34f5d96c2b1c2f40874cf/users/a841adbf7dac487a81e4e452f16042e2/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:35:40.287763 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80466573-07c8-4af2-a979-1552e9c1b270 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:40.288337 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80466573-07c8-4af2-a979-1552e9c1b270 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:40.288711 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80466573-07c8-4af2-a979-1552e9c1b270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:40.329142 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-80466573-07c8-4af2-a979-1552e9c1b270 None None] MFA Rules not processed for user `a841adbf7dac487a81e4e452f16042e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:40.330674 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-80466573-07c8-4af2-a979-1552e9c1b270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:40.416900 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 982/1954] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:35:40.428302 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d78fe7-ea0e-4082-afc7-ba5f5c129019 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:40.514203 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d78fe7-ea0e-4082-afc7-ba5f5c129019 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:40.520136 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee51062-f695-429e-9a77-4b0ef8b63b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:40.521007 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee51062-f695-429e-9a77-4b0ef8b63b3f admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:40.521294 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee51062-f695-429e-9a77-4b0ef8b63b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:40.521592 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee51062-f695-429e-9a77-4b0ef8b63b3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:40.522343 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee51062-f695-429e-9a77-4b0ef8b63b3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:40.524762 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee51062-f695-429e-9a77-4b0ef8b63b3f admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:40.797638 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 973/1955] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:35:40 2022] POST /identity/v3/projects => generated 387 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 09:35:40.797943 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80466573-07c8-4af2-a979-1552e9c1b270 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:40.797943 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80466573-07c8-4af2-a979-1552e9c1b270 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:40.848137 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99475b45-244c-4023-9e82-f29c87fe46d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:40.848979 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99475b45-244c-4023-9e82-f29c87fe46d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:40.849479 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99475b45-244c-4023-9e82-f29c87fe46d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:40.849604 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99475b45-244c-4023-9e82-f29c87fe46d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:40.850270 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99475b45-244c-4023-9e82-f29c87fe46d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:40.852458 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99475b45-244c-4023-9e82-f29c87fe46d4 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:40.955244 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 983/1956] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:35:40 2022] POST /identity/v3/users => generated 300 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:35:40.966780 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee51062-f695-429e-9a77-4b0ef8b63b3f admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:40.977628 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee51062-f695-429e-9a77-4b0ef8b63b3f admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:40.988583 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ef6b5-c522-4143-9f13-8781b6528763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:40.992575 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ef6b5-c522-4143-9f13-8781b6528763 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:40.992575 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ef6b5-c522-4143-9f13-8781b6528763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:40.992575 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ef6b5-c522-4143-9f13-8781b6528763 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:40.993384 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535ef6b5-c522-4143-9f13-8781b6528763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:40.995746 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535ef6b5-c522-4143-9f13-8781b6528763 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:41.011840 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 974/1957] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:35:41.016243 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99475b45-244c-4023-9e82-f29c87fe46d4 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:41.027872 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99475b45-244c-4023-9e82-f29c87fe46d4 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:41.035589 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb102a-cdbc-4a45-badc-f088515fcb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:41.035589 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb102a-cdbc-4a45-badc-f088515fcb35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:41.035589 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb102a-cdbc-4a45-badc-f088515fcb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:41.035912 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb102a-cdbc-4a45-badc-f088515fcb35 admin admin] PATH_INFO: `/v3/projects/1a2ca45bb79948d4a9674bf4aac0cb74/users/31af822da1d441249bb81b03e008b247/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:41.062992 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb102a-cdbc-4a45-badc-f088515fcb35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a2ca45bb79948d4a9674bf4aac0cb74, user_id=31af822da1d441249bb81b03e008b247, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:41.065793 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb102a-cdbc-4a45-badc-f088515fcb35 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:41.097712 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:41.167863 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 984/1958] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:35:41 2022] PUT /identity/v3/projects/1a2ca45bb79948d4a9674bf4aac0cb74/users/31af822da1d441249bb81b03e008b247/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:35:41.172469 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ef6b5-c522-4143-9f13-8781b6528763 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:41.186333 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ef6b5-c522-4143-9f13-8781b6528763 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:41.216944 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:41.288878 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9336619-9c88-4ee8-b4eb-940f2f3a0f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:41.290685 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9336619-9c88-4ee8-b4eb-940f2f3a0f50 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:41.291408 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9336619-9c88-4ee8-b4eb-940f2f3a0f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:41.292306 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9336619-9c88-4ee8-b4eb-940f2f3a0f50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:41.294388 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9336619-9c88-4ee8-b4eb-940f2f3a0f50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:41.297886 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9336619-9c88-4ee8-b4eb-940f2f3a0f50 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:41.328565 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 975/1959] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:35:41.330605 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb102a-cdbc-4a45-badc-f088515fcb35 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:41.343155 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb102a-cdbc-4a45-badc-f088515fcb35 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:41.348858 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e336ca04-ad55-4616-af80-52bbbc95303c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:41.350379 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336ca04-ad55-4616-af80-52bbbc95303c admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:41.350379 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336ca04-ad55-4616-af80-52bbbc95303c admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:41.350957 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336ca04-ad55-4616-af80-52bbbc95303c admin admin] PATH_INFO: `/v3/projects/1a2ca45bb79948d4a9674bf4aac0cb74/users/31af822da1d441249bb81b03e008b247/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:41.353756 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e336ca04-ad55-4616-af80-52bbbc95303c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a2ca45bb79948d4a9674bf4aac0cb74, user_id=31af822da1d441249bb81b03e008b247, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:41.356586 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e336ca04-ad55-4616-af80-52bbbc95303c admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:41.369640 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 985/1960] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:35:41 2022] PUT /identity/v3/projects/1a2ca45bb79948d4a9674bf4aac0cb74/users/31af822da1d441249bb81b03e008b247/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:35:41.381510 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750cc74-0845-4754-9a28-78c042028afa None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:41.382973 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750cc74-0845-4754-9a28-78c042028afa None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:41.382973 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750cc74-0845-4754-9a28-78c042028afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:41.449261 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-9750cc74-0845-4754-9a28-78c042028afa None None] MFA Rules not processed for user `31af822da1d441249bb81b03e008b247`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:41.451368 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-9750cc74-0845-4754-9a28-78c042028afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:41.561904 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 976/1961] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:41 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:35:41.600084 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e336ca04-ad55-4616-af80-52bbbc95303c admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:41.605113 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-e336ca04-ad55-4616-af80-52bbbc95303c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:41.799018 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e336ca04-ad55-4616-af80-52bbbc95303c admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:41.807700 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25672da2-d1e7-4535-a608-fc8f625f0f0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:41.809291 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25672da2-d1e7-4535-a608-fc8f625f0f0f service cinder] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:41.810126 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25672da2-d1e7-4535-a608-fc8f625f0f0f service cinder] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:41.810889 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25672da2-d1e7-4535-a608-fc8f625f0f0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:41.830757 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25672da2-d1e7-4535-a608-fc8f625f0f0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:41.833650 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25672da2-d1e7-4535-a608-fc8f625f0f0f service cinder] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:41.850774 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 986/1962] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:35:41 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 09:35:42.308931 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:42.886590 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:43.028799 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:43.230964 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750cc74-0845-4754-9a28-78c042028afa None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:43.328230 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750cc74-0845-4754-9a28-78c042028afa None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:43.333341 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea1d5f0-594a-472e-a7d2-e7590cc75c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:43.343456 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1d5f0-594a-472e-a7d2-e7590cc75c96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:43.343456 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1d5f0-594a-472e-a7d2-e7590cc75c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:43.343456 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1d5f0-594a-472e-a7d2-e7590cc75c96 admin admin] PATH_INFO: `/v3/users/a841adbf7dac487a81e4e452f16042e2` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:43.343456 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea1d5f0-594a-472e-a7d2-e7590cc75c96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a841adbf7dac487a81e4e452f16042e2)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:43.343456 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea1d5f0-594a-472e-a7d2-e7590cc75c96 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:43.552018 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-6ea1d5f0-594a-472e-a7d2-e7590cc75c96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a841adbf7dac487a81e4e452f16042e2'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:43.559295 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-6ea1d5f0-594a-472e-a7d2-e7590cc75c96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a841adbf7dac487a81e4e452f16042e2'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:43.640030 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-6ea1d5f0-594a-472e-a7d2-e7590cc75c96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a841adbf7dac487a81e4e452f16042e2'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:43.640706 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-6ea1d5f0-594a-472e-a7d2-e7590cc75c96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a841adbf7dac487a81e4e452f16042e2'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:43.654564 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-6ea1d5f0-594a-472e-a7d2-e7590cc75c96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a841adbf7dac487a81e4e452f16042e2'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:43.661007 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 977/1963] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:35:43 2022] DELETE /identity/v3/users/a841adbf7dac487a81e4e452f16042e2 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:35:43.666653 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9e945-24cf-49b8-91d3-4389fdd924c3 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:43.666927 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9e945-24cf-49b8-91d3-4389fdd924c3 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:43.667376 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9e945-24cf-49b8-91d3-4389fdd924c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:43.684715 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-b4f9e945-24cf-49b8-91d3-4389fdd924c3 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:43.685929 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-b4f9e945-24cf-49b8-91d3-4389fdd924c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:43.747185 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 987/1964] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:35:43.757084 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea1d5f0-594a-472e-a7d2-e7590cc75c96 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:43.758547 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-6ea1d5f0-594a-472e-a7d2-e7590cc75c96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:43.828288 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea1d5f0-594a-472e-a7d2-e7590cc75c96 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:43.837185 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c1fa7-0920-498a-ae85-3b7583a8b2fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:43.838555 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c1fa7-0920-498a-ae85-3b7583a8b2fe service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:43.839044 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c1fa7-0920-498a-ae85-3b7583a8b2fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:43.839165 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c1fa7-0920-498a-ae85-3b7583a8b2fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:43.849858 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c1fa7-0920-498a-ae85-3b7583a8b2fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:43.854598 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c1fa7-0920-498a-ae85-3b7583a8b2fe service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:43.868491 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 978/1965] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:35:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:35:44.385351 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9e945-24cf-49b8-91d3-4389fdd924c3 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:44.386549 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-b4f9e945-24cf-49b8-91d3-4389fdd924c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:44.402199 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9e945-24cf-49b8-91d3-4389fdd924c3 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:44.408265 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd11f8d-c849-4797-a991-76d9f5328374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:44.409846 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd11f8d-c849-4797-a991-76d9f5328374 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:44.410376 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd11f8d-c849-4797-a991-76d9f5328374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:44.410832 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd11f8d-c849-4797-a991-76d9f5328374 admin admin] PATH_INFO: `/v3/projects/407fce435fa34f5d96c2b1c2f40874cf` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:44.412364 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd11f8d-c849-4797-a991-76d9f5328374 admin admin] RBAC: Authorizing `identity:delete_project(project_id=407fce435fa34f5d96c2b1c2f40874cf)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:44.415609 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd11f8d-c849-4797-a991-76d9f5328374 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:44.530496 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-5bd11f8d-c849-4797-a991-76d9f5328374 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '407fce435fa34f5d96c2b1c2f40874cf', 'request_id': 'req-5bd11f8d-c849-4797-a991-76d9f5328374'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:44.622981 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:44.659462 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-5bd11f8d-c849-4797-a991-76d9f5328374 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '407fce435fa34f5d96c2b1c2f40874cf', 'request_id': 'req-5bd11f8d-c849-4797-a991-76d9f5328374'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:44.666810 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-5bd11f8d-c849-4797-a991-76d9f5328374 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '407fce435fa34f5d96c2b1c2f40874cf', 'request_id': 'req-5bd11f8d-c849-4797-a991-76d9f5328374'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:44.678791 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-5bd11f8d-c849-4797-a991-76d9f5328374 admin admin] The token cache is being invalidate because project 407fce435fa34f5d96c2b1c2f40874cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:35:44.679084 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-5bd11f8d-c849-4797-a991-76d9f5328374 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:44.679886 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-5bd11f8d-c849-4797-a991-76d9f5328374 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:44.682228 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 988/1966] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:35:44 2022] DELETE /identity/v3/projects/407fce435fa34f5d96c2b1c2f40874cf => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:35:44.686427 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c1fa7-0920-498a-ae85-3b7583a8b2fe service neutron] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:44.696755 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c1fa7-0920-498a-ae85-3b7583a8b2fe service neutron] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:44.758809 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd53552-85a1-471d-84ce-6f64eb5540d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:44.759638 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd53552-85a1-471d-84ce-6f64eb5540d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:44.759915 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd53552-85a1-471d-84ce-6f64eb5540d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:44.760184 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd53552-85a1-471d-84ce-6f64eb5540d7 admin admin] PATH_INFO: `/v3/users/31af822da1d441249bb81b03e008b247` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:44.763739 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd53552-85a1-471d-84ce-6f64eb5540d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31af822da1d441249bb81b03e008b247)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:44.763739 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd53552-85a1-471d-84ce-6f64eb5540d7 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:44.881144 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:44.942087 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-8fd53552-85a1-471d-84ce-6f64eb5540d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31af822da1d441249bb81b03e008b247'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:44.949344 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-8fd53552-85a1-471d-84ce-6f64eb5540d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31af822da1d441249bb81b03e008b247'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:45.051162 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-8fd53552-85a1-471d-84ce-6f64eb5540d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31af822da1d441249bb81b03e008b247'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:45.051985 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-8fd53552-85a1-471d-84ce-6f64eb5540d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31af822da1d441249bb81b03e008b247'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:45.068221 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-8fd53552-85a1-471d-84ce-6f64eb5540d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31af822da1d441249bb81b03e008b247'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:45.075659 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 979/1967] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:35:44 2022] DELETE /identity/v3/users/31af822da1d441249bb81b03e008b247 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:35:45.707747 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd11f8d-c849-4797-a991-76d9f5328374 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:45.709335 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-5bd11f8d-c849-4797-a991-76d9f5328374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:45.725291 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd11f8d-c849-4797-a991-76d9f5328374 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:45.801982 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac60251-4f15-4570-8f2d-224d105b011b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:45.803110 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac60251-4f15-4570-8f2d-224d105b011b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:45.803397 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac60251-4f15-4570-8f2d-224d105b011b admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:45.803681 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac60251-4f15-4570-8f2d-224d105b011b admin admin] PATH_INFO: `/v3/projects/1a2ca45bb79948d4a9674bf4aac0cb74` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:45.805474 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac60251-4f15-4570-8f2d-224d105b011b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a2ca45bb79948d4a9674bf4aac0cb74)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:45.808316 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac60251-4f15-4570-8f2d-224d105b011b admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:45.919346 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-bac60251-4f15-4570-8f2d-224d105b011b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a2ca45bb79948d4a9674bf4aac0cb74', 'request_id': 'req-bac60251-4f15-4570-8f2d-224d105b011b'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:45.998374 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-bac60251-4f15-4570-8f2d-224d105b011b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a2ca45bb79948d4a9674bf4aac0cb74', 'request_id': 'req-bac60251-4f15-4570-8f2d-224d105b011b'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:46.004867 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-bac60251-4f15-4570-8f2d-224d105b011b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a2ca45bb79948d4a9674bf4aac0cb74', 'request_id': 'req-bac60251-4f15-4570-8f2d-224d105b011b'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:46.016153 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-bac60251-4f15-4570-8f2d-224d105b011b admin admin] The token cache is being invalidate because project 1a2ca45bb79948d4a9674bf4aac0cb74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:35:46.016540 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-bac60251-4f15-4570-8f2d-224d105b011b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:46.017213 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-bac60251-4f15-4570-8f2d-224d105b011b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:46.018753 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 989/1968] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:35:45 2022] DELETE /identity/v3/projects/1a2ca45bb79948d4a9674bf4aac0cb74 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:35:46.023819 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8bdf7d-d3b0-4b6c-96af-a35d04ac9ded None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:46.024330 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8bdf7d-d3b0-4b6c-96af-a35d04ac9ded None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:46.024421 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8bdf7d-d3b0-4b6c-96af-a35d04ac9ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:46.027564 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:46.044299 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-7b8bdf7d-d3b0-4b6c-96af-a35d04ac9ded None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:46.045675 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-7b8bdf7d-d3b0-4b6c-96af-a35d04ac9ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:46.130425 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 980/1969] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:35:46.139475 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005585f7-341e-4388-b076-7e69225fd122 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:46.139853 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005585f7-341e-4388-b076-7e69225fd122 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:46.140229 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005585f7-341e-4388-b076-7e69225fd122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:46.160101 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-005585f7-341e-4388-b076-7e69225fd122 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:46.161500 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-005585f7-341e-4388-b076-7e69225fd122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:46.170349 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 990/1970] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:35:46.176277 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8bdf7d-d3b0-4b6c-96af-a35d04ac9ded None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:46.187650 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8bdf7d-d3b0-4b6c-96af-a35d04ac9ded None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:46.193094 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a0bc5-fda6-44fe-ae2b-bc2a3fd2fb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:46.198310 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a0bc5-fda6-44fe-ae2b-bc2a3fd2fb30 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:46.198310 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a0bc5-fda6-44fe-ae2b-bc2a3fd2fb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:46.198310 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a0bc5-fda6-44fe-ae2b-bc2a3fd2fb30 admin admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:46.198310 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a0bc5-fda6-44fe-ae2b-bc2a3fd2fb30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:35:46.198310 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a0bc5-fda6-44fe-ae2b-bc2a3fd2fb30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:46.198310 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a0bc5-fda6-44fe-ae2b-bc2a3fd2fb30 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:46.213394 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 981/1971] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:35:46.214724 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005585f7-341e-4388-b076-7e69225fd122 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:46.227480 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005585f7-341e-4388-b076-7e69225fd122 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:46.231199 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2deb570-a087-4b93-960d-d88f23ac3ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:46.231893 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2deb570-a087-4b93-960d-d88f23ac3ea6 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:46.232175 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2deb570-a087-4b93-960d-d88f23ac3ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:46.232588 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2deb570-a087-4b93-960d-d88f23ac3ea6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:46.233171 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2deb570-a087-4b93-960d-d88f23ac3ea6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:46.235074 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2deb570-a087-4b93-960d-d88f23ac3ea6 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:46.416359 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 991/1972] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:35:46 2022] POST /identity/v3/projects => generated 385 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:35:46.421933 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a0bc5-fda6-44fe-ae2b-bc2a3fd2fb30 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:46.437891 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a0bc5-fda6-44fe-ae2b-bc2a3fd2fb30 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:46.507411 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb19b7-1ae5-446e-b4c7-290c9f56387f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:46.508084 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb19b7-1ae5-446e-b4c7-290c9f56387f admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:46.508397 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb19b7-1ae5-446e-b4c7-290c9f56387f admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:46.508670 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb19b7-1ae5-446e-b4c7-290c9f56387f admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:46.509404 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb19b7-1ae5-446e-b4c7-290c9f56387f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:46.511491 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb19b7-1ae5-446e-b4c7-290c9f56387f admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:46.611533 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 982/1973] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:35:46 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:35:46.615947 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2deb570-a087-4b93-960d-d88f23ac3ea6 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:46.625996 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2deb570-a087-4b93-960d-d88f23ac3ea6 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:46.630566 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db031e8-a7dd-45e0-adab-0c5f6919876f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:46.631224 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db031e8-a7dd-45e0-adab-0c5f6919876f admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:46.631507 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db031e8-a7dd-45e0-adab-0c5f6919876f admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:46.631781 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db031e8-a7dd-45e0-adab-0c5f6919876f admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:46.632536 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db031e8-a7dd-45e0-adab-0c5f6919876f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:46.634131 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db031e8-a7dd-45e0-adab-0c5f6919876f admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:46.645778 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 992/1974] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 09:35:46.650372 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb19b7-1ae5-446e-b4c7-290c9f56387f admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:46.660455 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb19b7-1ae5-446e-b4c7-290c9f56387f admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:46.665065 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c2c92-fa17-4f69-865b-ea48a918fce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:46.667085 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c2c92-fa17-4f69-865b-ea48a918fce2 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:46.667085 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c2c92-fa17-4f69-865b-ea48a918fce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:46.667085 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c2c92-fa17-4f69-865b-ea48a918fce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:46.667642 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c2c92-fa17-4f69-865b-ea48a918fce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:46.669278 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c2c92-fa17-4f69-865b-ea48a918fce2 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:46.679236 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 983/1975] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:35:46.683356 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db031e8-a7dd-45e0-adab-0c5f6919876f admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:46.693292 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db031e8-a7dd-45e0-adab-0c5f6919876f admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:46.703041 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d39cb-5a6a-4468-a272-b5e0b6ca4b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:46.703981 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d39cb-5a6a-4468-a272-b5e0b6ca4b42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:46.704325 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d39cb-5a6a-4468-a272-b5e0b6ca4b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:46.704606 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d39cb-5a6a-4468-a272-b5e0b6ca4b42 admin admin] PATH_INFO: `/v3/projects/32c6dc3aee6545ccbcd921706c020057/users/362e7bf03e9145ce82a90dccea658b47/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:46.721542 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d39cb-5a6a-4468-a272-b5e0b6ca4b42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32c6dc3aee6545ccbcd921706c020057, user_id=362e7bf03e9145ce82a90dccea658b47, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:46.724180 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d39cb-5a6a-4468-a272-b5e0b6ca4b42 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:46.788589 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 993/1976] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:35:46 2022] PUT /identity/v3/projects/32c6dc3aee6545ccbcd921706c020057/users/362e7bf03e9145ce82a90dccea658b47/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:35:46.789040 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:46.798733 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd538b-484f-4508-b1a1-42436f40013a None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:46.799019 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd538b-484f-4508-b1a1-42436f40013a None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:46.799297 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd538b-484f-4508-b1a1-42436f40013a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:46.830040 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-a2fd538b-484f-4508-b1a1-42436f40013a None None] MFA Rules not processed for user `362e7bf03e9145ce82a90dccea658b47`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:46.831256 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-a2fd538b-484f-4508-b1a1-42436f40013a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:46.907818 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 984/1977] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:35:46.921263 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d39cb-5a6a-4468-a272-b5e0b6ca4b42 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:46.923055 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-d55d39cb-5a6a-4468-a272-b5e0b6ca4b42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:46.988227 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d39cb-5a6a-4468-a272-b5e0b6ca4b42 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:46.992568 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163c81a4-785a-46c5-8899-0507f6f0da00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:46.993318 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c81a4-785a-46c5-8899-0507f6f0da00 service cinder] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:46.994369 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c81a4-785a-46c5-8899-0507f6f0da00 service cinder] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:46.994736 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c81a4-785a-46c5-8899-0507f6f0da00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:47.006432 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163c81a4-785a-46c5-8899-0507f6f0da00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:47.008887 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163c81a4-785a-46c5-8899-0507f6f0da00 service cinder] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:47.018588 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 994/1978] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:35:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:35:47.492125 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:47.919077 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:48.005769 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:49.216550 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:49.394450 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:50.394445 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:50.474554 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:50.937044 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:51.189051 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:52.234333 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:52.354311 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:52.518663 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:52.541807 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:52.701882 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:52.767920 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:53.040103 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:54.200412 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:54.782745 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:INSERT=5,keystone:SELECT=91,keystone:DELETE=4 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:55.595098 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:56.220984 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8571b-c6db-4976-8810-54f53fd6c8f7 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:56.221511 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8571b-c6db-4976-8810-54f53fd6c8f7 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:56.221612 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8571b-c6db-4976-8810-54f53fd6c8f7 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:56.223178 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 985/1979] 10.222.0.62 () {54 vars in 921 bytes} [Mon Jun 27 09:35:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:35:56.236774 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3920a-dde9-4c17-a89c-ab33532a8d3d None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:56.237115 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3920a-dde9-4c17-a89c-ab33532a8d3d None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:56.237115 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3920a-dde9-4c17-a89c-ab33532a8d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:56.257836 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-4bd3920a-dde9-4c17-a89c-ab33532a8d3d None None] MFA Rules not processed for user `2bbaf738138b40b2a06bb63934f6608c`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:56.259317 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-4bd3920a-dde9-4c17-a89c-ab33532a8d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:56.332610 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 995/1980] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Jun 27 09:35:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:35:56.344681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8571b-c6db-4976-8810-54f53fd6c8f7 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:56.346391 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-3aa8571b-c6db-4976-8810-54f53fd6c8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:56.365706 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8571b-c6db-4976-8810-54f53fd6c8f7 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:56.371497 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a2dc76-47a5-4adc-9dd3-1478a6984ec8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbaf738138b40b2a06bb63934f6608c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:56.371923 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2dc76-47a5-4adc-9dd3-1478a6984ec8 service placement] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:56.372233 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2dc76-47a5-4adc-9dd3-1478a6984ec8 service placement] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:56.372520 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2dc76-47a5-4adc-9dd3-1478a6984ec8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:56.381931 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a2dc76-47a5-4adc-9dd3-1478a6984ec8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:56.383563 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a2dc76-47a5-4adc-9dd3-1478a6984ec8 service placement] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:56.394223 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 986/1981] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:35:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:35:56.485874 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd3920a-dde9-4c17-a89c-ab33532a8d3d None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:56.490193 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-4bd3920a-dde9-4c17-a89c-ab33532a8d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:56.559219 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd3920a-dde9-4c17-a89c-ab33532a8d3d None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:56.564118 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db85950e-76ed-44b6-8f3c-0fc595ed90d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:56.564968 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85950e-76ed-44b6-8f3c-0fc595ed90d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:56.565251 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85950e-76ed-44b6-8f3c-0fc595ed90d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:56.565533 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85950e-76ed-44b6-8f3c-0fc595ed90d2 admin admin] PATH_INFO: `/v3/users/b2c4f6fbf777401388307bf24396c8e5` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:56.566742 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db85950e-76ed-44b6-8f3c-0fc595ed90d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2c4f6fbf777401388307bf24396c8e5)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:56.568749 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db85950e-76ed-44b6-8f3c-0fc595ed90d2 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:56.793548 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-db85950e-76ed-44b6-8f3c-0fc595ed90d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2c4f6fbf777401388307bf24396c8e5'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:56.794202 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-db85950e-76ed-44b6-8f3c-0fc595ed90d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2c4f6fbf777401388307bf24396c8e5'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:56.795915 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:56.879194 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-db85950e-76ed-44b6-8f3c-0fc595ed90d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2c4f6fbf777401388307bf24396c8e5'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:56.879844 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-db85950e-76ed-44b6-8f3c-0fc595ed90d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2c4f6fbf777401388307bf24396c8e5'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:56.888138 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-db85950e-76ed-44b6-8f3c-0fc595ed90d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2c4f6fbf777401388307bf24396c8e5'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:56.906518 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 996/1982] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:35:56 2022] DELETE /identity/v3/users/b2c4f6fbf777401388307bf24396c8e5 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:35:57.172393 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a2dc76-47a5-4adc-9dd3-1478a6984ec8 service placement] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:57.183701 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a2dc76-47a5-4adc-9dd3-1478a6984ec8 service placement] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:57.210584 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:57.243399 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03fc8e-0120-49ef-ba86-7dcbecb22e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:57.244914 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03fc8e-0120-49ef-ba86-7dcbecb22e70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:57.245203 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03fc8e-0120-49ef-ba86-7dcbecb22e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:57.245709 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03fc8e-0120-49ef-ba86-7dcbecb22e70 admin admin] PATH_INFO: `/v3/projects/2b63618987f54652a373e1413607c5f7` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:57.246922 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b03fc8e-0120-49ef-ba86-7dcbecb22e70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b63618987f54652a373e1413607c5f7)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:57.248928 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b03fc8e-0120-49ef-ba86-7dcbecb22e70 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:57.353016 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-0b03fc8e-0120-49ef-ba86-7dcbecb22e70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b63618987f54652a373e1413607c5f7', 'request_id': 'req-0b03fc8e-0120-49ef-ba86-7dcbecb22e70'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:57.496721 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-0b03fc8e-0120-49ef-ba86-7dcbecb22e70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b63618987f54652a373e1413607c5f7', 'request_id': 'req-0b03fc8e-0120-49ef-ba86-7dcbecb22e70'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:57.502910 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-0b03fc8e-0120-49ef-ba86-7dcbecb22e70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b63618987f54652a373e1413607c5f7', 'request_id': 'req-0b03fc8e-0120-49ef-ba86-7dcbecb22e70'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:57.514281 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-0b03fc8e-0120-49ef-ba86-7dcbecb22e70 admin admin] The token cache is being invalidate because project 2b63618987f54652a373e1413607c5f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:35:57.514563 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-0b03fc8e-0120-49ef-ba86-7dcbecb22e70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:57.515192 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-0b03fc8e-0120-49ef-ba86-7dcbecb22e70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:57.516736 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 987/1983] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:35:57 2022] DELETE /identity/v3/projects/2b63618987f54652a373e1413607c5f7 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:35:57.521745 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0dc569-7ca9-46a4-bf0b-f1a30ca34a33 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:57.522034 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0dc569-7ca9-46a4-bf0b-f1a30ca34a33 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:57.522313 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0dc569-7ca9-46a4-bf0b-f1a30ca34a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:57.540635 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-de0dc569-7ca9-46a4-bf0b-f1a30ca34a33 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:57.542351 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-de0dc569-7ca9-46a4-bf0b-f1a30ca34a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:57.602208 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 997/1984] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:35:57.611179 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd543f3b-5cff-4ad5-ae9f-43bfa829cdcb None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:57.614966 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd543f3b-5cff-4ad5-ae9f-43bfa829cdcb None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:57.614966 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd543f3b-5cff-4ad5-ae9f-43bfa829cdcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:57.632546 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-dd543f3b-5cff-4ad5-ae9f-43bfa829cdcb None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:57.633776 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-dd543f3b-5cff-4ad5-ae9f-43bfa829cdcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:57.642128 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 988/1985] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:35:57.646849 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0dc569-7ca9-46a4-bf0b-f1a30ca34a33 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:57.657501 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0dc569-7ca9-46a4-bf0b-f1a30ca34a33 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:57.662306 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f3e41-371e-48d6-9390-f5839deccf8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:57.662964 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f3e41-371e-48d6-9390-f5839deccf8b admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:57.663268 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f3e41-371e-48d6-9390-f5839deccf8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:57.663546 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f3e41-371e-48d6-9390-f5839deccf8b admin admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:57.664327 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f3e41-371e-48d6-9390-f5839deccf8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:35:57.664636 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f3e41-371e-48d6-9390-f5839deccf8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:57.666907 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f3e41-371e-48d6-9390-f5839deccf8b admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:57.678572 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 998/1986] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:35:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:35:57.684001 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd543f3b-5cff-4ad5-ae9f-43bfa829cdcb None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:57.692601 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd543f3b-5cff-4ad5-ae9f-43bfa829cdcb None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:57.697330 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea46643-4943-4c86-a00b-33e9742bdf04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:57.697981 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea46643-4943-4c86-a00b-33e9742bdf04 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:57.698261 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea46643-4943-4c86-a00b-33e9742bdf04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:57.698537 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea46643-4943-4c86-a00b-33e9742bdf04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:57.699257 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea46643-4943-4c86-a00b-33e9742bdf04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:57.701277 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea46643-4943-4c86-a00b-33e9742bdf04 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:57.749330 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f3e41-371e-48d6-9390-f5839deccf8b admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:57.751125 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-534f3e41-371e-48d6-9390-f5839deccf8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:57.765271 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f3e41-371e-48d6-9390-f5839deccf8b admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:57.773869 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 989/1987] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:35:57 2022] POST /identity/v3/projects => generated 387 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:35:57.774229 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960c0ba-057e-412b-ab4a-0b7fc0e7e8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:57.774229 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960c0ba-057e-412b-ab4a-0b7fc0e7e8ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:57.774229 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960c0ba-057e-412b-ab4a-0b7fc0e7e8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:57.774229 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960c0ba-057e-412b-ab4a-0b7fc0e7e8ed admin admin] PATH_INFO: `/v3/users/362e7bf03e9145ce82a90dccea658b47` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:57.774746 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b960c0ba-057e-412b-ab4a-0b7fc0e7e8ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=362e7bf03e9145ce82a90dccea658b47)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:57.774746 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b960c0ba-057e-412b-ab4a-0b7fc0e7e8ed admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:57.777577 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea46643-4943-4c86-a00b-33e9742bdf04 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:57.847676 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea46643-4943-4c86-a00b-33e9742bdf04 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:57.852830 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a3514-2c24-401a-8c56-272920fe580d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:57.853691 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a3514-2c24-401a-8c56-272920fe580d admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:57.854528 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a3514-2c24-401a-8c56-272920fe580d admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:57.854733 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a3514-2c24-401a-8c56-272920fe580d admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:57.855436 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a3514-2c24-401a-8c56-272920fe580d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:57.857393 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a3514-2c24-401a-8c56-272920fe580d admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:57.988027 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 990/1988] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:35:57 2022] POST /identity/v3/users => generated 294 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:35:57.992213 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a3514-2c24-401a-8c56-272920fe580d admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:58.001770 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a3514-2c24-401a-8c56-272920fe580d admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:58.006409 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d33cf-fd61-41f7-8fe6-6ced63a9c533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:58.007043 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d33cf-fd61-41f7-8fe6-6ced63a9c533 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:58.007319 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d33cf-fd61-41f7-8fe6-6ced63a9c533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:58.007587 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d33cf-fd61-41f7-8fe6-6ced63a9c533 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:58.008399 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d33cf-fd61-41f7-8fe6-6ced63a9c533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:58.010493 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d33cf-fd61-41f7-8fe6-6ced63a9c533 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:58.020838 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 991/1989] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:35:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 09:35:58.024777 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d33cf-fd61-41f7-8fe6-6ced63a9c533 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:58.035409 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-b960c0ba-057e-412b-ab4a-0b7fc0e7e8ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '362e7bf03e9145ce82a90dccea658b47'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:58.035932 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d33cf-fd61-41f7-8fe6-6ced63a9c533 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:58.036840 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-b960c0ba-057e-412b-ab4a-0b7fc0e7e8ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '362e7bf03e9145ce82a90dccea658b47'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:58.043345 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b59e8b-a27b-49d1-a8ed-90e33b54b104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:58.043345 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b59e8b-a27b-49d1-a8ed-90e33b54b104 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:58.043345 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b59e8b-a27b-49d1-a8ed-90e33b54b104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:58.043345 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b59e8b-a27b-49d1-a8ed-90e33b54b104 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:58.043774 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b59e8b-a27b-49d1-a8ed-90e33b54b104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:58.044685 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b59e8b-a27b-49d1-a8ed-90e33b54b104 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:58.046295 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:58.056264 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 992/1990] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 09:35:58.060379 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b59e8b-a27b-49d1-a8ed-90e33b54b104 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:58.070694 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b59e8b-a27b-49d1-a8ed-90e33b54b104 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:58.076253 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b871f-7ca2-4aa3-8c3a-c406b8a367d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:58.077149 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b871f-7ca2-4aa3-8c3a-c406b8a367d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:58.077464 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b871f-7ca2-4aa3-8c3a-c406b8a367d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:58.077822 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b871f-7ca2-4aa3-8c3a-c406b8a367d3 admin admin] PATH_INFO: `/v3/projects/d877497d5bd94ed493e560ae004522c5/users/2def17c362a347c2baf8b42ceb0383f8/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:58.097160 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3b871f-7ca2-4aa3-8c3a-c406b8a367d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d877497d5bd94ed493e560ae004522c5, user_id=2def17c362a347c2baf8b42ceb0383f8, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:58.099848 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3b871f-7ca2-4aa3-8c3a-c406b8a367d3 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:58.113462 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-b960c0ba-057e-412b-ab4a-0b7fc0e7e8ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '362e7bf03e9145ce82a90dccea658b47'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:58.114077 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-b960c0ba-057e-412b-ab4a-0b7fc0e7e8ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '362e7bf03e9145ce82a90dccea658b47'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:58.122073 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-b960c0ba-057e-412b-ab4a-0b7fc0e7e8ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '362e7bf03e9145ce82a90dccea658b47'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:58.141354 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 999/1991] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:35:57 2022] DELETE /identity/v3/users/362e7bf03e9145ce82a90dccea658b47 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:35:58.145805 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58882b22-cd63-4639-88df-57afc906e54e None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:58.146161 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58882b22-cd63-4639-88df-57afc906e54e None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:58.146446 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58882b22-cd63-4639-88df-57afc906e54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:58.165586 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-58882b22-cd63-4639-88df-57afc906e54e None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:58.166874 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-58882b22-cd63-4639-88df-57afc906e54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:58.177548 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 993/1992] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:35:58 2022] PUT /identity/v3/projects/d877497d5bd94ed493e560ae004522c5/users/2def17c362a347c2baf8b42ceb0383f8/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:35:58.182894 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e11496-3f5c-41b8-9e9a-83dc0f599699 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:58.183328 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e11496-3f5c-41b8-9e9a-83dc0f599699 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:58.183596 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e11496-3f5c-41b8-9e9a-83dc0f599699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:58.195609 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:58.202785 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-72e11496-3f5c-41b8-9e9a-83dc0f599699 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:58.203985 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-72e11496-3f5c-41b8-9e9a-83dc0f599699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:58.239187 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1000/1993] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 09:35:58.249123 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58882b22-cd63-4639-88df-57afc906e54e None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:58.251479 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-58882b22-cd63-4639-88df-57afc906e54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:58.266589 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 994/1994] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:35:58.277413 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e11496-3f5c-41b8-9e9a-83dc0f599699 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:58.278405 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-72e11496-3f5c-41b8-9e9a-83dc0f599699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:58.312439 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58882b22-cd63-4639-88df-57afc906e54e None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:58.336141 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e11496-3f5c-41b8-9e9a-83dc0f599699 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:58.340223 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5610e-75a8-456f-94cf-f736ca9d6755 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:58.341126 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5610e-75a8-456f-94cf-f736ca9d6755 service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:58.341242 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5610e-75a8-456f-94cf-f736ca9d6755 service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:58.341515 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5610e-75a8-456f-94cf-f736ca9d6755 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:58.352547 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b5610e-75a8-456f-94cf-f736ca9d6755 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:58.354314 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b5610e-75a8-456f-94cf-f736ca9d6755 service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:58.361867 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe9b7b4-3eb3-45ee-9044-546dff9f0046 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:58.362562 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9b7b4-3eb3-45ee-9044-546dff9f0046 service neutron] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:58.362839 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9b7b4-3eb3-45ee-9044-546dff9f0046 service neutron] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:58.363108 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9b7b4-3eb3-45ee-9044-546dff9f0046 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:58.364358 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 995/1995] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:35:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 09:35:58.378273 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe9b7b4-3eb3-45ee-9044-546dff9f0046 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:58.379562 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe9b7b4-3eb3-45ee-9044-546dff9f0046 service neutron] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:58.391417 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1001/1996] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:35:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 09:35:59.069050 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5610e-75a8-456f-94cf-f736ca9d6755 service neutron] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:59.070717 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-00b5610e-75a8-456f-94cf-f736ca9d6755 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:59.089034 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5610e-75a8-456f-94cf-f736ca9d6755 service neutron] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:59.094657 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a5df1-3365-4d00-91b9-e6b1b84574cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:59.095808 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a5df1-3365-4d00-91b9-e6b1b84574cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:59.096109 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a5df1-3365-4d00-91b9-e6b1b84574cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:59.096398 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a5df1-3365-4d00-91b9-e6b1b84574cc admin admin] PATH_INFO: `/v3/projects/32c6dc3aee6545ccbcd921706c020057` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:59.097732 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a5df1-3365-4d00-91b9-e6b1b84574cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=32c6dc3aee6545ccbcd921706c020057)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:59.099873 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a5df1-3365-4d00-91b9-e6b1b84574cc admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:59.206961 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-e91a5df1-3365-4d00-91b9-e6b1b84574cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32c6dc3aee6545ccbcd921706c020057', 'request_id': 'req-e91a5df1-3365-4d00-91b9-e6b1b84574cc'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:59.346096 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-e91a5df1-3365-4d00-91b9-e6b1b84574cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32c6dc3aee6545ccbcd921706c020057', 'request_id': 'req-e91a5df1-3365-4d00-91b9-e6b1b84574cc'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:59.351107 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-e91a5df1-3365-4d00-91b9-e6b1b84574cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32c6dc3aee6545ccbcd921706c020057', 'request_id': 'req-e91a5df1-3365-4d00-91b9-e6b1b84574cc'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:59.362921 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:59.377602 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-e91a5df1-3365-4d00-91b9-e6b1b84574cc admin admin] The token cache is being invalidate because project 32c6dc3aee6545ccbcd921706c020057 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:35:59.377602 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-e91a5df1-3365-4d00-91b9-e6b1b84574cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:59.377602 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-e91a5df1-3365-4d00-91b9-e6b1b84574cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:35:59.377602 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 996/1997] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:35:59 2022] DELETE /identity/v3/projects/32c6dc3aee6545ccbcd921706c020057 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:35:59.379692 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab5b1d-d90a-4f78-a3ed-d1c36b829270 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:59.380167 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab5b1d-d90a-4f78-a3ed-d1c36b829270 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:59.380296 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab5b1d-d90a-4f78-a3ed-d1c36b829270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:59.403147 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-beab5b1d-d90a-4f78-a3ed-d1c36b829270 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:59.404613 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-beab5b1d-d90a-4f78-a3ed-d1c36b829270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:59.468096 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1002/1998] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:35:59.476577 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573107af-9e83-473e-85e3-e8f5f3067bea None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:59.476870 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573107af-9e83-473e-85e3-e8f5f3067bea None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:59.477149 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573107af-9e83-473e-85e3-e8f5f3067bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:59.498646 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-573107af-9e83-473e-85e3-e8f5f3067bea None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:35:59.499973 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-573107af-9e83-473e-85e3-e8f5f3067bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:35:59.508593 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 997/1999] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:35:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 09:35:59.513373 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab5b1d-d90a-4f78-a3ed-d1c36b829270 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:59.523596 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab5b1d-d90a-4f78-a3ed-d1c36b829270 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:59.529125 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d1311-08c2-4a04-923f-83f8d41a0773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:59.529784 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d1311-08c2-4a04-923f-83f8d41a0773 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:59.530066 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d1311-08c2-4a04-923f-83f8d41a0773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:59.530344 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d1311-08c2-4a04-923f-83f8d41a0773 admin admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:59.531085 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d1311-08c2-4a04-923f-83f8d41a0773 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:35:59.531389 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d1311-08c2-4a04-923f-83f8d41a0773 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:59.533518 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d1311-08c2-4a04-923f-83f8d41a0773 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:59.547544 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1003/2000] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:35:59.552261 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573107af-9e83-473e-85e3-e8f5f3067bea None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:59.563121 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573107af-9e83-473e-85e3-e8f5f3067bea None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:59.568481 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078c7e0-7ee7-491f-bd29-8f1cdf6754da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:59.569234 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078c7e0-7ee7-491f-bd29-8f1cdf6754da admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:59.569600 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078c7e0-7ee7-491f-bd29-8f1cdf6754da admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:59.569985 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078c7e0-7ee7-491f-bd29-8f1cdf6754da admin admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:59.570948 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f078c7e0-7ee7-491f-bd29-8f1cdf6754da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:59.573658 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f078c7e0-7ee7-491f-bd29-8f1cdf6754da admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:59.672788 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 998/2001] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:35:59 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:35:59.677217 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d1311-08c2-4a04-923f-83f8d41a0773 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:59.684577 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d1311-08c2-4a04-923f-83f8d41a0773 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:59.692613 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:35:59.749834 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd245a5-1843-4165-9fe2-f5c68bcc8301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:59.750507 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd245a5-1843-4165-9fe2-f5c68bcc8301 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:59.750787 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd245a5-1843-4165-9fe2-f5c68bcc8301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:59.751059 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd245a5-1843-4165-9fe2-f5c68bcc8301 admin admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:59.751763 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd245a5-1843-4165-9fe2-f5c68bcc8301 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:59.753853 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd245a5-1843-4165-9fe2-f5c68bcc8301 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:59.850256 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1004/2002] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:35:59 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:35:59.850455 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078c7e0-7ee7-491f-bd29-8f1cdf6754da admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:59.860881 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078c7e0-7ee7-491f-bd29-8f1cdf6754da admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:59.866087 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af4559-c605-43ae-8788-e4c25d59f8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:59.867775 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af4559-c605-43ae-8788-e4c25d59f8a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:59.867775 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af4559-c605-43ae-8788-e4c25d59f8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:59.867775 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af4559-c605-43ae-8788-e4c25d59f8a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:59.872482 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62af4559-c605-43ae-8788-e4c25d59f8a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:59.872482 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62af4559-c605-43ae-8788-e4c25d59f8a9 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:59.900271 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 999/2003] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:35:59 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:35:59.901841 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd245a5-1843-4165-9fe2-f5c68bcc8301 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:59.911966 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd245a5-1843-4165-9fe2-f5c68bcc8301 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:59.917032 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51f8a1-1a03-4f4d-a8fe-1843409c084f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:59.917810 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51f8a1-1a03-4f4d-a8fe-1843409c084f admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:59.918174 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51f8a1-1a03-4f4d-a8fe-1843409c084f admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:59.918516 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51f8a1-1a03-4f4d-a8fe-1843409c084f admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:59.919338 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51f8a1-1a03-4f4d-a8fe-1843409c084f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:59.921091 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51f8a1-1a03-4f4d-a8fe-1843409c084f admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:35:59.933205 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1005/2004] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:35:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:35:59.942705 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af4559-c605-43ae-8788-e4c25d59f8a9 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:35:59.954490 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af4559-c605-43ae-8788-e4c25d59f8a9 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:35:59.961520 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa53766-3e10-443f-8f33-a07c0034d01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:35:59.962681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa53766-3e10-443f-8f33-a07c0034d01f admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:35:59.963770 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa53766-3e10-443f-8f33-a07c0034d01f admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:35:59.964191 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa53766-3e10-443f-8f33-a07c0034d01f admin admin] PATH_INFO: `/v3/projects/f5c582ef3f51401194776ad3ef175c8d/users/1d4e3faf5cb3420d94270c200b446419/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:35:59.985687 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa53766-3e10-443f-8f33-a07c0034d01f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5c582ef3f51401194776ad3ef175c8d, user_id=1d4e3faf5cb3420d94270c200b446419, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:35:59.988500 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa53766-3e10-443f-8f33-a07c0034d01f admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:00.086665 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1000/2005] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:35:59 2022] PUT /identity/v3/projects/f5c582ef3f51401194776ad3ef175c8d/users/1d4e3faf5cb3420d94270c200b446419/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:36:00.091676 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012ae22-7608-46ef-abc5-a21aef42c78d None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:00.091676 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012ae22-7608-46ef-abc5-a21aef42c78d None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:00.091676 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012ae22-7608-46ef-abc5-a21aef42c78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:00.123329 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-8012ae22-7608-46ef-abc5-a21aef42c78d None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:36:00.124687 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-8012ae22-7608-46ef-abc5-a21aef42c78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:00.198816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1006/2006] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:36:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:36:00.209305 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa53766-3e10-443f-8f33-a07c0034d01f admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:00.210876 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-6fa53766-3e10-443f-8f33-a07c0034d01f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:00.284909 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa53766-3e10-443f-8f33-a07c0034d01f admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:00.288978 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44f5d7-05f1-4c5d-b5ba-2508e025193f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:00.289678 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44f5d7-05f1-4c5d-b5ba-2508e025193f service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:00.289963 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44f5d7-05f1-4c5d-b5ba-2508e025193f service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:00.290239 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44f5d7-05f1-4c5d-b5ba-2508e025193f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:00.302223 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44f5d7-05f1-4c5d-b5ba-2508e025193f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:00.303843 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44f5d7-05f1-4c5d-b5ba-2508e025193f service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:00.317081 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1001/2007] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:36:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:36:01.542958 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf111168-ed7c-4614-ba35-5dc3aaf5ef8b None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:01.543496 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf111168-ed7c-4614-ba35-5dc3aaf5ef8b None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:01.543590 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf111168-ed7c-4614-ba35-5dc3aaf5ef8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:01.562530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-bf111168-ed7c-4614-ba35-5dc3aaf5ef8b None None] MFA Rules not processed for user `53f0fa68d99341e685ade3449a5c6ece`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:36:01.563863 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-bf111168-ed7c-4614-ba35-5dc3aaf5ef8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:01.642343 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1007/2008] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:36:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 09:36:05.378925 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44f5d7-05f1-4c5d-b5ba-2508e025193f service neutron] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:05.381524 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-6a44f5d7-05f1-4c5d-b5ba-2508e025193f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:05.402361 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44f5d7-05f1-4c5d-b5ba-2508e025193f service neutron] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:05.409383 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0295125-9950-482a-a058-ceea0b560f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:05.409692 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0295125-9950-482a-a058-ceea0b560f08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:05.410505 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0295125-9950-482a-a058-ceea0b560f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:05.410944 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0295125-9950-482a-a058-ceea0b560f08 admin admin] PATH_INFO: `/v3/users/2a57abee26714847b5cf06e6c67d303a` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:05.412679 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0295125-9950-482a-a058-ceea0b560f08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a57abee26714847b5cf06e6c67d303a)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:05.416334 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0295125-9950-482a-a058-ceea0b560f08 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:05.649841 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-a0295125-9950-482a-a058-ceea0b560f08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a57abee26714847b5cf06e6c67d303a'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:05.664179 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-a0295125-9950-482a-a058-ceea0b560f08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a57abee26714847b5cf06e6c67d303a'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:05.727034 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-a0295125-9950-482a-a058-ceea0b560f08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a57abee26714847b5cf06e6c67d303a'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:05.728462 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-a0295125-9950-482a-a058-ceea0b560f08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a57abee26714847b5cf06e6c67d303a'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:05.751946 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-a0295125-9950-482a-a058-ceea0b560f08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a57abee26714847b5cf06e6c67d303a'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:05.765081 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1002/2009] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:36:05 2022] DELETE /identity/v3/users/2a57abee26714847b5cf06e6c67d303a => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:36:05.766696 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a2f23-b0c6-4b0e-944c-0a8be941e66e None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:05.767165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a2f23-b0c6-4b0e-944c-0a8be941e66e None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:05.767296 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a2f23-b0c6-4b0e-944c-0a8be941e66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:05.800903 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-351a2f23-b0c6-4b0e-944c-0a8be941e66e None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:36:05.802360 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-351a2f23-b0c6-4b0e-944c-0a8be941e66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:05.859385 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:36:05.909902 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1008/2010] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:36:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 09:36:05.921788 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0295125-9950-482a-a058-ceea0b560f08 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:05.923369 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-a0295125-9950-482a-a058-ceea0b560f08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:05.938383 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:36:06.020694 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0295125-9950-482a-a058-ceea0b560f08 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:06.029359 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50850a22-e36c-45bd-94c0-d72ec90401eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:06.030107 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50850a22-e36c-45bd-94c0-d72ec90401eb service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:06.030484 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50850a22-e36c-45bd-94c0-d72ec90401eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:06.030887 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50850a22-e36c-45bd-94c0-d72ec90401eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:06.071429 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50850a22-e36c-45bd-94c0-d72ec90401eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:06.073711 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50850a22-e36c-45bd-94c0-d72ec90401eb service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:06.088950 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1003/2011] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:36:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:36:06.783537 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a2f23-b0c6-4b0e-944c-0a8be941e66e None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:06.785371 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-351a2f23-b0c6-4b0e-944c-0a8be941e66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:06.820351 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a2f23-b0c6-4b0e-944c-0a8be941e66e None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:06.840868 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40548e73-840f-4f28-a47a-f077f5bad895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:06.841671 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40548e73-840f-4f28-a47a-f077f5bad895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:06.841956 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40548e73-840f-4f28-a47a-f077f5bad895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:06.842234 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40548e73-840f-4f28-a47a-f077f5bad895 admin admin] PATH_INFO: `/v3/projects/dba2f153ca744fdba30acdc938dec88f` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:06.843946 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40548e73-840f-4f28-a47a-f077f5bad895 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dba2f153ca744fdba30acdc938dec88f)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:06.845977 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40548e73-840f-4f28-a47a-f077f5bad895 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:07.038187 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f5b7c-f720-4ac9-84f3-84f5f8b8cc75 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:07.038725 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f5b7c-f720-4ac9-84f3-84f5f8b8cc75 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:07.043550 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f5b7c-f720-4ac9-84f3-84f5f8b8cc75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:07.088883 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-40548e73-840f-4f28-a47a-f077f5bad895 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dba2f153ca744fdba30acdc938dec88f', 'request_id': 'req-40548e73-840f-4f28-a47a-f077f5bad895'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:07.118824 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-f20f5b7c-f720-4ac9-84f3-84f5f8b8cc75 None None] MFA Rules not processed for user `2def17c362a347c2baf8b42ceb0383f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:36:07.120507 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-f20f5b7c-f720-4ac9-84f3-84f5f8b8cc75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:07.182171 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-40548e73-840f-4f28-a47a-f077f5bad895 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dba2f153ca744fdba30acdc938dec88f', 'request_id': 'req-40548e73-840f-4f28-a47a-f077f5bad895'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:07.196304 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-40548e73-840f-4f28-a47a-f077f5bad895 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dba2f153ca744fdba30acdc938dec88f', 'request_id': 'req-40548e73-840f-4f28-a47a-f077f5bad895'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:07.221141 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-40548e73-840f-4f28-a47a-f077f5bad895 admin admin] The token cache is being invalidate because project dba2f153ca744fdba30acdc938dec88f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:36:07.221531 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-40548e73-840f-4f28-a47a-f077f5bad895 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:07.222327 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-40548e73-840f-4f28-a47a-f077f5bad895 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:07.225779 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1009/2012] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:36:06 2022] DELETE /identity/v3/projects/dba2f153ca744fdba30acdc938dec88f => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:36:07.229862 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40548e73-840f-4f28-a47a-f077f5bad895 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:07.240824 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-40548e73-840f-4f28-a47a-f077f5bad895 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:07.244353 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1004/2013] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:36:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:36:07.255437 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f5b7c-f720-4ac9-84f3-84f5f8b8cc75 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:07.258396 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-f20f5b7c-f720-4ac9-84f3-84f5f8b8cc75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:07.383934 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40548e73-840f-4f28-a47a-f077f5bad895 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:07.390125 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bfd1b2-928a-4345-91ac-6cbc148ae5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:07.391667 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfd1b2-928a-4345-91ac-6cbc148ae5a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:07.393099 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfd1b2-928a-4345-91ac-6cbc148ae5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:07.396843 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfd1b2-928a-4345-91ac-6cbc148ae5a1 admin admin] PATH_INFO: `/v3/users/60f9151d86a2462a94b7af1b7720cb9f` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:07.398716 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bfd1b2-928a-4345-91ac-6cbc148ae5a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60f9151d86a2462a94b7af1b7720cb9f)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:07.404874 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bfd1b2-928a-4345-91ac-6cbc148ae5a1 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:07.457420 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f5b7c-f720-4ac9-84f3-84f5f8b8cc75 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:07.473772 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940531b-da22-4d0a-8491-18a6ebba57cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:07.475733 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940531b-da22-4d0a-8491-18a6ebba57cb service nova] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:07.477460 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940531b-da22-4d0a-8491-18a6ebba57cb service nova] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:07.477874 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940531b-da22-4d0a-8491-18a6ebba57cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:07.483389 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-1940531b-da22-4d0a-8491-18a6ebba57cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:07.503553 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1940531b-da22-4d0a-8491-18a6ebba57cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:07.506424 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1940531b-da22-4d0a-8491-18a6ebba57cb service nova] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:07.520888 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1005/2014] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:36:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:36:07.740024 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-01bfd1b2-928a-4345-91ac-6cbc148ae5a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60f9151d86a2462a94b7af1b7720cb9f'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:07.740024 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-01bfd1b2-928a-4345-91ac-6cbc148ae5a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60f9151d86a2462a94b7af1b7720cb9f'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:07.828143 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-01bfd1b2-928a-4345-91ac-6cbc148ae5a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60f9151d86a2462a94b7af1b7720cb9f'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:07.837314 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-01bfd1b2-928a-4345-91ac-6cbc148ae5a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60f9151d86a2462a94b7af1b7720cb9f'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:07.851039 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:36:07.853856 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-01bfd1b2-928a-4345-91ac-6cbc148ae5a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60f9151d86a2462a94b7af1b7720cb9f'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:07.878260 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1010/2015] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:36:07 2022] DELETE /identity/v3/users/60f9151d86a2462a94b7af1b7720cb9f => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:36:09.447026 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940531b-da22-4d0a-8491-18a6ebba57cb service nova] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:09.463688 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940531b-da22-4d0a-8491-18a6ebba57cb service nova] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:09.515721 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:36:09.584406 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0e3c1-796e-4a06-bea8-7f54d1d77b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:09.585626 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0e3c1-796e-4a06-bea8-7f54d1d77b65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:09.586491 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0e3c1-796e-4a06-bea8-7f54d1d77b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:09.586929 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0e3c1-796e-4a06-bea8-7f54d1d77b65 admin admin] PATH_INFO: `/v3/projects/7498e5237efc45b9a53ed3fe10e9dbd3` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:09.589049 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0e3c1-796e-4a06-bea8-7f54d1d77b65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7498e5237efc45b9a53ed3fe10e9dbd3)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:09.591172 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0e3c1-796e-4a06-bea8-7f54d1d77b65 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:09.785554 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-49e0e3c1-796e-4a06-bea8-7f54d1d77b65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7498e5237efc45b9a53ed3fe10e9dbd3', 'request_id': 'req-49e0e3c1-796e-4a06-bea8-7f54d1d77b65'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:09.903529 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-49e0e3c1-796e-4a06-bea8-7f54d1d77b65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7498e5237efc45b9a53ed3fe10e9dbd3', 'request_id': 'req-49e0e3c1-796e-4a06-bea8-7f54d1d77b65'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:09.927229 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-49e0e3c1-796e-4a06-bea8-7f54d1d77b65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7498e5237efc45b9a53ed3fe10e9dbd3', 'request_id': 'req-49e0e3c1-796e-4a06-bea8-7f54d1d77b65'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:09.951480 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-49e0e3c1-796e-4a06-bea8-7f54d1d77b65 admin admin] The token cache is being invalidate because project 7498e5237efc45b9a53ed3fe10e9dbd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:36:09.951875 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-49e0e3c1-796e-4a06-bea8-7f54d1d77b65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:09.954643 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-49e0e3c1-796e-4a06-bea8-7f54d1d77b65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:09.968446 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5ee9c-82e6-4af4-9675-f886f53562a0 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:09.969224 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5ee9c-82e6-4af4-9675-f886f53562a0 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:09.969519 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5ee9c-82e6-4af4-9675-f886f53562a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:09.971689 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1006/2016] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:36:09 2022] DELETE /identity/v3/projects/7498e5237efc45b9a53ed3fe10e9dbd3 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:36:09.995185 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-17b5ee9c-82e6-4af4-9675-f886f53562a0 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:36:09.996690 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-17b5ee9c-82e6-4af4-9675-f886f53562a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:10.122845 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1011/2017] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:36:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:36:10.131245 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145b8a6-9cfc-435e-af2d-3fc7b935c975 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:10.131823 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145b8a6-9cfc-435e-af2d-3fc7b935c975 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:10.132383 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145b8a6-9cfc-435e-af2d-3fc7b935c975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:10.158455 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-a145b8a6-9cfc-435e-af2d-3fc7b935c975 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:36:10.160337 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-a145b8a6-9cfc-435e-af2d-3fc7b935c975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:10.171330 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1007/2018] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:36:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:36:10.176134 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b5ee9c-82e6-4af4-9675-f886f53562a0 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:10.190386 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b5ee9c-82e6-4af4-9675-f886f53562a0 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:10.210188 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460c073-16cf-47bc-a05a-0d5b5193a7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:10.214711 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460c073-16cf-47bc-a05a-0d5b5193a7d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:10.215339 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460c073-16cf-47bc-a05a-0d5b5193a7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:10.215777 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460c073-16cf-47bc-a05a-0d5b5193a7d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:10.217476 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460c073-16cf-47bc-a05a-0d5b5193a7d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:36:10.219850 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460c073-16cf-47bc-a05a-0d5b5193a7d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:10.221785 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460c073-16cf-47bc-a05a-0d5b5193a7d4 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:10.247105 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1012/2019] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:36:10.247730 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145b8a6-9cfc-435e-af2d-3fc7b935c975 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:10.261307 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145b8a6-9cfc-435e-af2d-3fc7b935c975 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:10.269147 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17c7a4-c6a1-4569-bef5-c49add6ae38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:10.270074 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17c7a4-c6a1-4569-bef5-c49add6ae38c admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:10.270332 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17c7a4-c6a1-4569-bef5-c49add6ae38c admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:10.270805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17c7a4-c6a1-4569-bef5-c49add6ae38c admin admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:10.271647 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17c7a4-c6a1-4569-bef5-c49add6ae38c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:10.276908 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17c7a4-c6a1-4569-bef5-c49add6ae38c admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:10.445010 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1008/2020] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:36:10 2022] POST /identity/v3/projects => generated 381 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 09:36:10.449969 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460c073-16cf-47bc-a05a-0d5b5193a7d4 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:10.472230 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460c073-16cf-47bc-a05a-0d5b5193a7d4 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:10.571672 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c84a20-1cdb-41cf-be37-a7750956a37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:10.573015 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c84a20-1cdb-41cf-be37-a7750956a37a admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:10.573318 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c84a20-1cdb-41cf-be37-a7750956a37a admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:10.573647 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c84a20-1cdb-41cf-be37-a7750956a37a admin admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:10.574367 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c84a20-1cdb-41cf-be37-a7750956a37a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:10.577418 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c84a20-1cdb-41cf-be37-a7750956a37a admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:10.667956 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1013/2021] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:36:10 2022] POST /identity/v3/users => generated 291 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 09:36:10.673055 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17c7a4-c6a1-4569-bef5-c49add6ae38c admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:10.694660 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17c7a4-c6a1-4569-bef5-c49add6ae38c admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:10.700403 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf06a5c-2607-4649-a6f9-d1ec54eeee26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:10.701298 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf06a5c-2607-4649-a6f9-d1ec54eeee26 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:10.701655 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf06a5c-2607-4649-a6f9-d1ec54eeee26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:10.702563 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf06a5c-2607-4649-a6f9-d1ec54eeee26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:10.705246 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf06a5c-2607-4649-a6f9-d1ec54eeee26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:10.707041 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf06a5c-2607-4649-a6f9-d1ec54eeee26 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:10.751410 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1009/2022] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:36:10.755517 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c84a20-1cdb-41cf-be37-a7750956a37a admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:10.770802 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c84a20-1cdb-41cf-be37-a7750956a37a admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:10.789174 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431923e-7846-4fd4-a329-0eaee3eb7eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:10.791153 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431923e-7846-4fd4-a329-0eaee3eb7eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:10.791609 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431923e-7846-4fd4-a329-0eaee3eb7eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:10.792059 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431923e-7846-4fd4-a329-0eaee3eb7eb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:10.793153 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431923e-7846-4fd4-a329-0eaee3eb7eb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:10.795177 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431923e-7846-4fd4-a329-0eaee3eb7eb8 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:10.820048 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1014/2023] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:36:10.821377 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf06a5c-2607-4649-a6f9-d1ec54eeee26 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:10.838359 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf06a5c-2607-4649-a6f9-d1ec54eeee26 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:10.845246 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d15a14-1b4a-42ba-bb24-7e44ee0bf504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:10.846407 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d15a14-1b4a-42ba-bb24-7e44ee0bf504 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:10.846770 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d15a14-1b4a-42ba-bb24-7e44ee0bf504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:10.847119 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d15a14-1b4a-42ba-bb24-7e44ee0bf504 admin admin] PATH_INFO: `/v3/projects/0e35323caf224bd29360a62cf1b8147f/users/ecd3342c608b4432948c36d154194fe3/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:10.871219 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d15a14-1b4a-42ba-bb24-7e44ee0bf504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e35323caf224bd29360a62cf1b8147f, user_id=ecd3342c608b4432948c36d154194fe3, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:10.875625 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d15a14-1b4a-42ba-bb24-7e44ee0bf504 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:10.971984 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431923e-7846-4fd4-a329-0eaee3eb7eb8 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:10.973934 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-c431923e-7846-4fd4-a329-0eaee3eb7eb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:10.994238 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431923e-7846-4fd4-a329-0eaee3eb7eb8 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:11.000982 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861beea-40df-4e54-9a14-4cb7ba842d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:11.002554 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861beea-40df-4e54-9a14-4cb7ba842d38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:11.003008 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861beea-40df-4e54-9a14-4cb7ba842d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:11.004048 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861beea-40df-4e54-9a14-4cb7ba842d38 admin admin] PATH_INFO: `/v3/users/312b8bd31e6c4ae68067da1e3ab67a88` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:11.006157 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4861beea-40df-4e54-9a14-4cb7ba842d38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=312b8bd31e6c4ae68067da1e3ab67a88)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:11.013441 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4861beea-40df-4e54-9a14-4cb7ba842d38 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:11.013582 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1010/2024] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:36:10 2022] PUT /identity/v3/projects/0e35323caf224bd29360a62cf1b8147f/users/ecd3342c608b4432948c36d154194fe3/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:36:11.020324 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910439ec-ad8f-42d0-bf94-9c18819d4e24 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:11.020873 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910439ec-ad8f-42d0-bf94-9c18819d4e24 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:11.021673 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910439ec-ad8f-42d0-bf94-9c18819d4e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:11.076632 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-910439ec-ad8f-42d0-bf94-9c18819d4e24 None None] MFA Rules not processed for user `ecd3342c608b4432948c36d154194fe3`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:36:11.077957 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-910439ec-ad8f-42d0-bf94-9c18819d4e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:11.147598 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:36:11.189758 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1011/2025] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:36:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:36:11.191319 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3e30d-eb67-4acb-b174-b298ae024015 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:11.194328 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3e30d-eb67-4acb-b174-b298ae024015 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:11.194328 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3e30d-eb67-4acb-b174-b298ae024015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:11.223201 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:36:11.240785 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-d3c3e30d-eb67-4acb-b174-b298ae024015 None None] MFA Rules not processed for user `1d4e3faf5cb3420d94270c200b446419`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:36:11.244355 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-4861beea-40df-4e54-9a14-4cb7ba842d38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '312b8bd31e6c4ae68067da1e3ab67a88'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:11.246272 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-d3c3e30d-eb67-4acb-b174-b298ae024015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:11.246430 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-4861beea-40df-4e54-9a14-4cb7ba842d38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '312b8bd31e6c4ae68067da1e3ab67a88'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:11.320100 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-4861beea-40df-4e54-9a14-4cb7ba842d38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '312b8bd31e6c4ae68067da1e3ab67a88'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:11.320985 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-4861beea-40df-4e54-9a14-4cb7ba842d38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '312b8bd31e6c4ae68067da1e3ab67a88'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:11.335383 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-4861beea-40df-4e54-9a14-4cb7ba842d38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '312b8bd31e6c4ae68067da1e3ab67a88'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:11.360283 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1015/2026] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:36:10 2022] DELETE /identity/v3/users/312b8bd31e6c4ae68067da1e3ab67a88 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:36:11.364613 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861beea-40df-4e54-9a14-4cb7ba842d38 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:11.364761 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-4861beea-40df-4e54-9a14-4cb7ba842d38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:11.373732 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1012/2027] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:36:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:36:11.379875 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16b95a-8071-4581-bba6-1eeba8326348 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:11.382783 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16b95a-8071-4581-bba6-1eeba8326348 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:11.383406 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16b95a-8071-4581-bba6-1eeba8326348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:11.427979 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-9a16b95a-8071-4581-bba6-1eeba8326348 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:36:11.432825 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-9a16b95a-8071-4581-bba6-1eeba8326348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:11.516698 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861beea-40df-4e54-9a14-4cb7ba842d38 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:11.532645 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce82101-f019-4173-ab4c-00b22d20afe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:11.533432 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce82101-f019-4173-ab4c-00b22d20afe0 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:11.533598 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce82101-f019-4173-ab4c-00b22d20afe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:11.534192 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce82101-f019-4173-ab4c-00b22d20afe0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:11.536987 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce82101-f019-4173-ab4c-00b22d20afe0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:11.539343 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce82101-f019-4173-ab4c-00b22d20afe0 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:11.582994 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1013/2028] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:36:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:36:11.583904 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16b95a-8071-4581-bba6-1eeba8326348 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:11.588984 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-9a16b95a-8071-4581-bba6-1eeba8326348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:11.614827 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16b95a-8071-4581-bba6-1eeba8326348 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:11.629053 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a0fabe-839e-4403-9d8e-7055e27c4cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:11.629751 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0fabe-839e-4403-9d8e-7055e27c4cfa admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:11.630185 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0fabe-839e-4403-9d8e-7055e27c4cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:11.630475 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0fabe-839e-4403-9d8e-7055e27c4cfa admin admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:11.631186 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a0fabe-839e-4403-9d8e-7055e27c4cfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:11.635584 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a0fabe-839e-4403-9d8e-7055e27c4cfa admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:11.678559 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1016/2029] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:36:11 2022] POST /identity/v3/projects => generated 379 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:36:11.679698 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce82101-f019-4173-ab4c-00b22d20afe0 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:11.687485 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-4ce82101-f019-4173-ab4c-00b22d20afe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:11.754203 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1014/2030] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:36:11 2022] POST /identity/v3/projects => generated 385 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:36:11.758982 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a0fabe-839e-4403-9d8e-7055e27c4cfa admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:11.871339 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce82101-f019-4173-ab4c-00b22d20afe0 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:11.902609 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a0fabe-839e-4403-9d8e-7055e27c4cfa admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:11.915645 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a41adda-ee09-47c5-860b-4b9344fa992a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:11.916861 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a41adda-ee09-47c5-860b-4b9344fa992a admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:11.917293 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a41adda-ee09-47c5-860b-4b9344fa992a admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:11.917711 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a41adda-ee09-47c5-860b-4b9344fa992a admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:11.919627 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a41adda-ee09-47c5-860b-4b9344fa992a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:11.923131 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a41adda-ee09-47c5-860b-4b9344fa992a admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:11.991384 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb351651-e87d-49d6-9e68-d8bcb4cd4328 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:11.993108 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb351651-e87d-49d6-9e68-d8bcb4cd4328 service neutron] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:11.994316 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb351651-e87d-49d6-9e68-d8bcb4cd4328 service neutron] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:11.994739 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb351651-e87d-49d6-9e68-d8bcb4cd4328 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:12.006786 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb351651-e87d-49d6-9e68-d8bcb4cd4328 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:12.009014 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb351651-e87d-49d6-9e68-d8bcb4cd4328 service neutron] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:12.021990 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1017/2031] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:36:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:36:12.025811 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb351651-e87d-49d6-9e68-d8bcb4cd4328 service neutron] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:12.036454 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1015/2032] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:36:11 2022] POST /identity/v3/users => generated 296 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:36:12.040348 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a41adda-ee09-47c5-860b-4b9344fa992a admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:12.062885 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a41adda-ee09-47c5-860b-4b9344fa992a admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:12.063422 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb351651-e87d-49d6-9e68-d8bcb4cd4328 service neutron] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:12.074337 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2958ea-f374-492e-825f-9693cd579d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:12.075212 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68afec96-530b-4d7a-ab09-069b5cfa186d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:12.076070 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2958ea-f374-492e-825f-9693cd579d0e admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:12.077137 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afec96-530b-4d7a-ab09-069b5cfa186d admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:12.077736 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2958ea-f374-492e-825f-9693cd579d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:12.078262 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2958ea-f374-492e-825f-9693cd579d0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:12.079791 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afec96-530b-4d7a-ab09-069b5cfa186d admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:12.080265 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afec96-530b-4d7a-ab09-069b5cfa186d admin admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:12.081322 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68afec96-530b-4d7a-ab09-069b5cfa186d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:12.081556 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2958ea-f374-492e-825f-9693cd579d0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:12.084744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2958ea-f374-492e-825f-9693cd579d0e admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:12.086059 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68afec96-530b-4d7a-ab09-069b5cfa186d admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:12.117824 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:36:12.128323 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1016/2033] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 09:36:12.132170 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2958ea-f374-492e-825f-9693cd579d0e admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:12.146543 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2958ea-f374-492e-825f-9693cd579d0e admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:12.155802 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3325586-8f34-4f64-b338-65d0b15060e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:12.157617 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3325586-8f34-4f64-b338-65d0b15060e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:12.158109 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3325586-8f34-4f64-b338-65d0b15060e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:12.158562 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3325586-8f34-4f64-b338-65d0b15060e5 admin admin] PATH_INFO: `/v3/projects/8d3c34531e2843c9b707225ba6363048/users/0c42a8839526497e966987189b624c72/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:12.179875 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3325586-8f34-4f64-b338-65d0b15060e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d3c34531e2843c9b707225ba6363048, user_id=0c42a8839526497e966987189b624c72, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:12.184974 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3325586-8f34-4f64-b338-65d0b15060e5 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:12.207277 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1018/2034] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:36:12 2022] POST /identity/v3/users => generated 299 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:36:12.211981 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68afec96-530b-4d7a-ab09-069b5cfa186d admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:12.229404 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:36:12.239888 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68afec96-530b-4d7a-ab09-069b5cfa186d admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:12.255354 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6de0e-0a91-46f5-826b-b156b25574d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:12.257378 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6de0e-0a91-46f5-826b-b156b25574d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:12.258838 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6de0e-0a91-46f5-826b-b156b25574d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:12.259331 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6de0e-0a91-46f5-826b-b156b25574d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:12.261497 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc6de0e-0a91-46f5-826b-b156b25574d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:12.266585 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc6de0e-0a91-46f5-826b-b156b25574d2 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:12.295122 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1019/2035] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 09:36:12.299059 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6de0e-0a91-46f5-826b-b156b25574d2 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:12.311701 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1017/2036] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:36:12 2022] PUT /identity/v3/projects/8d3c34531e2843c9b707225ba6363048/users/0c42a8839526497e966987189b624c72/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:36:12.315906 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3325586-8f34-4f64-b338-65d0b15060e5 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:12.327970 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6de0e-0a91-46f5-826b-b156b25574d2 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:12.432730 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3325586-8f34-4f64-b338-65d0b15060e5 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:12.438329 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d3487a-b665-4ee5-81e0-152565709d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:12.439305 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3487a-b665-4ee5-81e0-152565709d01 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:12.439584 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3487a-b665-4ee5-81e0-152565709d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:12.440042 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3487a-b665-4ee5-81e0-152565709d01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:12.440984 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d3487a-b665-4ee5-81e0-152565709d01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:12.443768 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d3487a-b665-4ee5-81e0-152565709d01 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:12.459981 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1018/2037] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:36:12.461422 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d3487a-b665-4ee5-81e0-152565709d01 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:12.465309 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83548a96-a49d-4303-a213-acd7484db0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:12.466373 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83548a96-a49d-4303-a213-acd7484db0f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:12.466757 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83548a96-a49d-4303-a213-acd7484db0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:12.467128 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83548a96-a49d-4303-a213-acd7484db0f3 admin admin] PATH_INFO: `/v3/projects/708523e470d446668cc7086b524ccf0d/users/dbb22a58e1374b6facc64673cc1986c3/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:12.477581 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d3487a-b665-4ee5-81e0-152565709d01 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:12.480372 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3790b0c-995b-4e6e-9257-32525b8fd4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:12.481562 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3790b0c-995b-4e6e-9257-32525b8fd4ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:12.481845 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3790b0c-995b-4e6e-9257-32525b8fd4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:12.482123 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3790b0c-995b-4e6e-9257-32525b8fd4ec admin admin] PATH_INFO: `/v3/projects/8d3c34531e2843c9b707225ba6363048/users/0c42a8839526497e966987189b624c72/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:12.488673 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3790b0c-995b-4e6e-9257-32525b8fd4ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d3c34531e2843c9b707225ba6363048, user_id=0c42a8839526497e966987189b624c72, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:12.492513 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3790b0c-995b-4e6e-9257-32525b8fd4ec admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:12.498826 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83548a96-a49d-4303-a213-acd7484db0f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=708523e470d446668cc7086b524ccf0d, user_id=dbb22a58e1374b6facc64673cc1986c3, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:12.502600 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83548a96-a49d-4303-a213-acd7484db0f3 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:12.511955 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1019/2038] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:36:12 2022] PUT /identity/v3/projects/8d3c34531e2843c9b707225ba6363048/users/0c42a8839526497e966987189b624c72/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:36:12.520927 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7edb7c-864c-4a81-a116-235dece77a5c None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:12.521244 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7edb7c-864c-4a81-a116-235dece77a5c None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:12.521492 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7edb7c-864c-4a81-a116-235dece77a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:12.565541 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-9c7edb7c-864c-4a81-a116-235dece77a5c None None] MFA Rules not processed for user `0c42a8839526497e966987189b624c72`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:36:12.567052 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-9c7edb7c-864c-4a81-a116-235dece77a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:12.634025 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1020/2039] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:36:12 2022] PUT /identity/v3/projects/708523e470d446668cc7086b524ccf0d/users/dbb22a58e1374b6facc64673cc1986c3/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:36:12.638224 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83548a96-a49d-4303-a213-acd7484db0f3 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:12.658600 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1020/2040] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:36:12 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 09:36:12.671919 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7edb7c-864c-4a81-a116-235dece77a5c None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:12.674084 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-9c7edb7c-864c-4a81-a116-235dece77a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:12.728903 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83548a96-a49d-4303-a213-acd7484db0f3 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:12.735422 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0c1d1-03e1-40de-8a50-ce9b2d9f1dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:12.736134 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0c1d1-03e1-40de-8a50-ce9b2d9f1dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:12.736449 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0c1d1-03e1-40de-8a50-ce9b2d9f1dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:12.736697 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0c1d1-03e1-40de-8a50-ce9b2d9f1dd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:12.737610 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c0c1d1-03e1-40de-8a50-ce9b2d9f1dd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:12.741429 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c0c1d1-03e1-40de-8a50-ce9b2d9f1dd8 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:12.783435 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1021/2041] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 09:36:12.787554 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0c1d1-03e1-40de-8a50-ce9b2d9f1dd8 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:12.811535 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0c1d1-03e1-40de-8a50-ce9b2d9f1dd8 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:12.814839 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7edb7c-864c-4a81-a116-235dece77a5c None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:12.821431 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6816f78-0973-4468-9838-6eead2bc5644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:12.823831 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6816f78-0973-4468-9838-6eead2bc5644 admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:12.825657 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6816f78-0973-4468-9838-6eead2bc5644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:12.825657 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6816f78-0973-4468-9838-6eead2bc5644 admin admin] PATH_INFO: `/v3/projects/708523e470d446668cc7086b524ccf0d/users/dbb22a58e1374b6facc64673cc1986c3/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:12.831185 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6816f78-0973-4468-9838-6eead2bc5644 admin admin] RBAC: Authorizing `identity:create_grant(project_id=708523e470d446668cc7086b524ccf0d, user_id=dbb22a58e1374b6facc64673cc1986c3, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:12.835195 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6816f78-0973-4468-9838-6eead2bc5644 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:12.871431 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1022/2042] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:36:12 2022] PUT /identity/v3/projects/708523e470d446668cc7086b524ccf0d/users/dbb22a58e1374b6facc64673cc1986c3/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:36:12.936784 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c4d8d-9ebe-4bb2-b9ef-b0a3dbda75e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:12.938059 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c4d8d-9ebe-4bb2-b9ef-b0a3dbda75e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:12.938498 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c4d8d-9ebe-4bb2-b9ef-b0a3dbda75e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:12.939120 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c4d8d-9ebe-4bb2-b9ef-b0a3dbda75e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:13.110196 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c4d8d-9ebe-4bb2-b9ef-b0a3dbda75e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:13.114574 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c4d8d-9ebe-4bb2-b9ef-b0a3dbda75e4 service cinder] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:13.146084 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1021/2043] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:36:12 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 09:36:13.250138 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:36:13.264187 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7a0e9-8267-466b-9568-5d0967804841 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:13.264806 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7a0e9-8267-466b-9568-5d0967804841 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:13.265600 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7a0e9-8267-466b-9568-5d0967804841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:13.312926 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-a3b7a0e9-8267-466b-9568-5d0967804841 None None] MFA Rules not processed for user `2def17c362a347c2baf8b42ceb0383f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:36:13.319831 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-a3b7a0e9-8267-466b-9568-5d0967804841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:13.434184 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1023/2044] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:36:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:36:13.509387 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c4d8d-9ebe-4bb2-b9ef-b0a3dbda75e4 service cinder] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:13.513484 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-f11c4d8d-9ebe-4bb2-b9ef-b0a3dbda75e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:13.524351 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b7a0e9-8267-466b-9568-5d0967804841 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:13.544818 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c4d8d-9ebe-4bb2-b9ef-b0a3dbda75e4 service cinder] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:13.663985 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b7a0e9-8267-466b-9568-5d0967804841 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:13.675696 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25221a-9e83-4284-8d11-4ea68d4b0e67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:13.676472 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25221a-9e83-4284-8d11-4ea68d4b0e67 service cinder] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:13.677006 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25221a-9e83-4284-8d11-4ea68d4b0e67 service cinder] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:13.677554 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25221a-9e83-4284-8d11-4ea68d4b0e67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:13.680348 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-ca25221a-9e83-4284-8d11-4ea68d4b0e67 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:13.728966 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390fd36-f276-4dd6-8c7d-613188ba4985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:13.730622 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390fd36-f276-4dd6-8c7d-613188ba4985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:13.731002 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390fd36-f276-4dd6-8c7d-613188ba4985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:13.733813 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390fd36-f276-4dd6-8c7d-613188ba4985 admin admin] PATH_INFO: `/v3/projects/55698077cdf64f2c919b7a0d5e00148d` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:13.735589 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f390fd36-f276-4dd6-8c7d-613188ba4985 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55698077cdf64f2c919b7a0d5e00148d)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:13.738706 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f390fd36-f276-4dd6-8c7d-613188ba4985 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:13.804952 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25221a-9e83-4284-8d11-4ea68d4b0e67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:13.809237 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25221a-9e83-4284-8d11-4ea68d4b0e67 service cinder] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:13.823031 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1024/2045] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:36:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 09:36:13.994455 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-f390fd36-f276-4dd6-8c7d-613188ba4985 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55698077cdf64f2c919b7a0d5e00148d', 'request_id': 'req-f390fd36-f276-4dd6-8c7d-613188ba4985'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:14.086738 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:36:14.089152 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-f390fd36-f276-4dd6-8c7d-613188ba4985 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55698077cdf64f2c919b7a0d5e00148d', 'request_id': 'req-f390fd36-f276-4dd6-8c7d-613188ba4985'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:14.115250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-f390fd36-f276-4dd6-8c7d-613188ba4985 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55698077cdf64f2c919b7a0d5e00148d', 'request_id': 'req-f390fd36-f276-4dd6-8c7d-613188ba4985'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:14.134043 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-f390fd36-f276-4dd6-8c7d-613188ba4985 admin admin] The token cache is being invalidate because project 55698077cdf64f2c919b7a0d5e00148d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:36:14.134490 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-f390fd36-f276-4dd6-8c7d-613188ba4985 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:14.135293 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-f390fd36-f276-4dd6-8c7d-613188ba4985 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:14.138164 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1022/2046] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:36:13 2022] DELETE /identity/v3/projects/55698077cdf64f2c919b7a0d5e00148d => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:36:14.142890 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07124d-42ee-4f42-b013-1d4746483da5 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:14.143322 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07124d-42ee-4f42-b013-1d4746483da5 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:14.143708 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07124d-42ee-4f42-b013-1d4746483da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:14.199599 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-ee07124d-42ee-4f42-b013-1d4746483da5 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:36:14.204814 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-ee07124d-42ee-4f42-b013-1d4746483da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:14.330870 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1025/2047] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:36:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 09:36:14.336853 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b533c5-90f1-429c-aab1-8aa21f5314c0 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:14.337900 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b533c5-90f1-429c-aab1-8aa21f5314c0 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:14.338271 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b533c5-90f1-429c-aab1-8aa21f5314c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:14.361374 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-e6b533c5-90f1-429c-aab1-8aa21f5314c0 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:36:14.363397 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-e6b533c5-90f1-429c-aab1-8aa21f5314c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:14.373387 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1023/2048] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:36:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:36:14.377489 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee07124d-42ee-4f42-b013-1d4746483da5 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:14.392529 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee07124d-42ee-4f42-b013-1d4746483da5 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:14.413300 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd7b08-8fe6-4d2e-9e31-38c18855cb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:14.414384 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd7b08-8fe6-4d2e-9e31-38c18855cb59 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:14.414839 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd7b08-8fe6-4d2e-9e31-38c18855cb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:14.415275 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd7b08-8fe6-4d2e-9e31-38c18855cb59 admin admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:14.416969 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fd7b08-8fe6-4d2e-9e31-38c18855cb59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:36:14.419630 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fd7b08-8fe6-4d2e-9e31-38c18855cb59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:14.419630 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fd7b08-8fe6-4d2e-9e31-38c18855cb59 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:14.434544 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1026/2049] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:36:14.438911 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b533c5-90f1-429c-aab1-8aa21f5314c0 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:14.449710 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b533c5-90f1-429c-aab1-8aa21f5314c0 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:14.455496 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9381142-8806-4f60-a82e-194dbf87fb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:14.459949 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9381142-8806-4f60-a82e-194dbf87fb72 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:14.459949 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9381142-8806-4f60-a82e-194dbf87fb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:14.459949 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9381142-8806-4f60-a82e-194dbf87fb72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:14.459949 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9381142-8806-4f60-a82e-194dbf87fb72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:14.459949 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9381142-8806-4f60-a82e-194dbf87fb72 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:14.670994 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1024/2050] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:36:14 2022] POST /identity/v3/projects => generated 383 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:36:14.675260 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd7b08-8fe6-4d2e-9e31-38c18855cb59 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:14.686031 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd7b08-8fe6-4d2e-9e31-38c18855cb59 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:14.774633 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc7587-3d70-4df9-9ad0-8ab2213500dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:14.776351 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc7587-3d70-4df9-9ad0-8ab2213500dd admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:14.776809 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc7587-3d70-4df9-9ad0-8ab2213500dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:14.777259 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc7587-3d70-4df9-9ad0-8ab2213500dd admin admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:14.778126 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc7587-3d70-4df9-9ad0-8ab2213500dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:14.789243 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc7587-3d70-4df9-9ad0-8ab2213500dd admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:14.893564 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1027/2051] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:36:14 2022] POST /identity/v3/users => generated 292 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:36:14.897276 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9381142-8806-4f60-a82e-194dbf87fb72 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:14.910275 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9381142-8806-4f60-a82e-194dbf87fb72 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:14.917625 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf37ecf-daf4-4bf9-9441-a86d5b9afb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:14.918713 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf37ecf-daf4-4bf9-9441-a86d5b9afb80 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:14.919127 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf37ecf-daf4-4bf9-9441-a86d5b9afb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:14.919582 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf37ecf-daf4-4bf9-9441-a86d5b9afb80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:14.920561 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf37ecf-daf4-4bf9-9441-a86d5b9afb80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:14.922428 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf37ecf-daf4-4bf9-9441-a86d5b9afb80 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:14.935475 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1025/2052] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:36:14.939289 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc7587-3d70-4df9-9ad0-8ab2213500dd admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:14.963470 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc7587-3d70-4df9-9ad0-8ab2213500dd admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:14.972407 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7ad4fb-1d7a-41a9-9b4a-fceb22160c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:14.973093 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ad4fb-1d7a-41a9-9b4a-fceb22160c03 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:14.973528 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ad4fb-1d7a-41a9-9b4a-fceb22160c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:14.973885 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ad4fb-1d7a-41a9-9b4a-fceb22160c03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:14.974773 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7ad4fb-1d7a-41a9-9b4a-fceb22160c03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:14.976512 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7ad4fb-1d7a-41a9-9b4a-fceb22160c03 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:14.997575 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1028/2053] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:36:15.000070 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf37ecf-daf4-4bf9-9441-a86d5b9afb80 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:15.012050 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf37ecf-daf4-4bf9-9441-a86d5b9afb80 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:15.017250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc83a7-ad61-4cf0-8d9c-2b12ebf70d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:15.018150 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc83a7-ad61-4cf0-8d9c-2b12ebf70d82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:15.018436 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc83a7-ad61-4cf0-8d9c-2b12ebf70d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:15.018717 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc83a7-ad61-4cf0-8d9c-2b12ebf70d82 admin admin] PATH_INFO: `/v3/projects/3a25038bb95f486ea1a518d3379b989b/users/ab7398448109433c8d3839e0ffb747d3/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:15.037921 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc83a7-ad61-4cf0-8d9c-2b12ebf70d82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a25038bb95f486ea1a518d3379b989b, user_id=ab7398448109433c8d3839e0ffb747d3, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:15.041665 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc83a7-ad61-4cf0-8d9c-2b12ebf70d82 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:15.138611 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1026/2054] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:36:14 2022] PUT /identity/v3/projects/3a25038bb95f486ea1a518d3379b989b/users/ab7398448109433c8d3839e0ffb747d3/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:36:15.144126 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c74f6d-b5c3-40dd-ac15-74770a9fbc1d None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:15.144126 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c74f6d-b5c3-40dd-ac15-74770a9fbc1d None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:15.144555 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c74f6d-b5c3-40dd-ac15-74770a9fbc1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:15.163547 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-23c74f6d-b5c3-40dd-ac15-74770a9fbc1d None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:36:15.164834 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-23c74f6d-b5c3-40dd-ac15-74770a9fbc1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:15.237817 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1029/2055] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:36:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:36:15.249488 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc83a7-ad61-4cf0-8d9c-2b12ebf70d82 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:15.257617 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-0abc83a7-ad61-4cf0-8d9c-2b12ebf70d82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:15.316358 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc83a7-ad61-4cf0-8d9c-2b12ebf70d82 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:15.322070 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f7929-4295-4668-8f2f-51289e9cc4f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:15.323094 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f7929-4295-4668-8f2f-51289e9cc4f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:15.323573 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f7929-4295-4668-8f2f-51289e9cc4f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:15.324426 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f7929-4295-4668-8f2f-51289e9cc4f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:15.337645 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850f7929-4295-4668-8f2f-51289e9cc4f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:15.338935 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850f7929-4295-4668-8f2f-51289e9cc4f2 service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:15.350788 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1027/2056] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:36:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:36:15.482506 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:36:16.805274 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:36:17.716339 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e130550-323d-47aa-9059-eaa7c3af8b7b None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:17.716339 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e130550-323d-47aa-9059-eaa7c3af8b7b None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:17.716339 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e130550-323d-47aa-9059-eaa7c3af8b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:17.813751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-1e130550-323d-47aa-9059-eaa7c3af8b7b None None] MFA Rules not processed for user `ab7398448109433c8d3839e0ffb747d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:36:17.816020 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-1e130550-323d-47aa-9059-eaa7c3af8b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:17.967102 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1030/2057] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:36:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 09:36:18.509703 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f7929-4295-4668-8f2f-51289e9cc4f2 service neutron] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:18.512024 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-850f7929-4295-4668-8f2f-51289e9cc4f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:18.626504 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:36:18.631460 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f7929-4295-4668-8f2f-51289e9cc4f2 service neutron] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:18.636457 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7207db-c9d3-4557-98ac-e7b57654c7bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:18.640355 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7207db-c9d3-4557-98ac-e7b57654c7bb service cinder] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:18.640651 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7207db-c9d3-4557-98ac-e7b57654c7bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:18.640984 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7207db-c9d3-4557-98ac-e7b57654c7bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:18.678136 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7207db-c9d3-4557-98ac-e7b57654c7bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:18.679959 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7207db-c9d3-4557-98ac-e7b57654c7bb service cinder] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:18.726101 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1028/2058] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:36:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:36:21.753968 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e33926-c2ab-4367-8692-2a84a2723396 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:21.759068 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e33926-c2ab-4367-8692-2a84a2723396 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:21.759068 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e33926-c2ab-4367-8692-2a84a2723396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:21.792783 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-09e33926-c2ab-4367-8692-2a84a2723396 None None] MFA Rules not processed for user `ab7398448109433c8d3839e0ffb747d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:36:21.794249 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-09e33926-c2ab-4367-8692-2a84a2723396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:21.849304 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:36:21.859703 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1031/2059] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:36:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:36:22.736587 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea4df4-0b0d-4146-b63b-1a53bc63359b None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:22.736587 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea4df4-0b0d-4146-b63b-1a53bc63359b None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:22.736587 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea4df4-0b0d-4146-b63b-1a53bc63359b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:22.784986 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-30ea4df4-0b0d-4146-b63b-1a53bc63359b None None] MFA Rules not processed for user `dbb22a58e1374b6facc64673cc1986c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:36:22.787210 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-30ea4df4-0b0d-4146-b63b-1a53bc63359b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:22.912279 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1029/2060] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:36:22 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:36:22.928611 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e33926-c2ab-4367-8692-2a84a2723396 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:22.931803 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-09e33926-c2ab-4367-8692-2a84a2723396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:23.051368 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e33926-c2ab-4367-8692-2a84a2723396 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:23.055254 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e651922c-b73c-42d3-ad08-1cc8d6be0f58 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6f97b803a28453c8b78fd8380ac64ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:23.064318 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651922c-b73c-42d3-ad08-1cc8d6be0f58 service glance] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:23.064318 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651922c-b73c-42d3-ad08-1cc8d6be0f58 service glance] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:23.064318 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651922c-b73c-42d3-ad08-1cc8d6be0f58 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:23.064318 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-e651922c-b73c-42d3-ad08-1cc8d6be0f58 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:23.141854 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e651922c-b73c-42d3-ad08-1cc8d6be0f58 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:23.143728 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e651922c-b73c-42d3-ad08-1cc8d6be0f58 service glance] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:23.155172 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1032/2061] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:36:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:36:23.525176 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c6e3f-0902-4169-9ecb-033f9a73b724 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:23.525176 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c6e3f-0902-4169-9ecb-033f9a73b724 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:23.525176 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c6e3f-0902-4169-9ecb-033f9a73b724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:23.542901 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-b10c6e3f-0902-4169-9ecb-033f9a73b724 None None] MFA Rules not processed for user `8f5d1f2327914f9fb070c6212582b6dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:36:23.544122 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-b10c6e3f-0902-4169-9ecb-033f9a73b724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:23.617593 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1030/2062] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Jun 27 09:36:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:36:23.682662 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e651922c-b73c-42d3-ad08-1cc8d6be0f58 service glance] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:23.684246 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-e651922c-b73c-42d3-ad08-1cc8d6be0f58 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:23.826676 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e651922c-b73c-42d3-ad08-1cc8d6be0f58 service glance] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:23.832954 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd6272-aa4a-4560-88ae-1ef5d120c881 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5477b14dae24fd3a644c9cbd6ff85ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:23.833707 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd6272-aa4a-4560-88ae-1ef5d120c881 service swift] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:23.834127 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd6272-aa4a-4560-88ae-1ef5d120c881 service swift] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:23.834478 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd6272-aa4a-4560-88ae-1ef5d120c881 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:23.846019 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fd6272-aa4a-4560-88ae-1ef5d120c881 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:23.848078 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fd6272-aa4a-4560-88ae-1ef5d120c881 service swift] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:23.858393 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1033/2063] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Jun 27 09:36:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 27 09:36:24.201806 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10c6e3f-0902-4169-9ecb-033f9a73b724 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:24.203287 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-b10c6e3f-0902-4169-9ecb-033f9a73b724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:24.304336 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10c6e3f-0902-4169-9ecb-033f9a73b724 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:24.310553 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4280ab9f-e4d8-47fe-a2e4-8c7549f86b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:24.311848 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280ab9f-e4d8-47fe-a2e4-8c7549f86b23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:24.312414 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280ab9f-e4d8-47fe-a2e4-8c7549f86b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:24.312733 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280ab9f-e4d8-47fe-a2e4-8c7549f86b23 admin admin] PATH_INFO: `/v3/users/ecd3342c608b4432948c36d154194fe3` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:24.315454 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4280ab9f-e4d8-47fe-a2e4-8c7549f86b23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecd3342c608b4432948c36d154194fe3)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:24.317597 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4280ab9f-e4d8-47fe-a2e4-8c7549f86b23 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:24.576874 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:36:24.592655 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-4280ab9f-e4d8-47fe-a2e4-8c7549f86b23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecd3342c608b4432948c36d154194fe3'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:24.620235 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-4280ab9f-e4d8-47fe-a2e4-8c7549f86b23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecd3342c608b4432948c36d154194fe3'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:24.731589 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-4280ab9f-e4d8-47fe-a2e4-8c7549f86b23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecd3342c608b4432948c36d154194fe3'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:24.732273 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-4280ab9f-e4d8-47fe-a2e4-8c7549f86b23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecd3342c608b4432948c36d154194fe3'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:24.754878 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-4280ab9f-e4d8-47fe-a2e4-8c7549f86b23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecd3342c608b4432948c36d154194fe3'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:24.771195 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b93c5-ff19-4ec7-be6a-b40f51557643 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:24.771689 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b93c5-ff19-4ec7-be6a-b40f51557643 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:24.771792 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b93c5-ff19-4ec7-be6a-b40f51557643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:24.776284 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1031/2064] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:36:24 2022] DELETE /identity/v3/users/ecd3342c608b4432948c36d154194fe3 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:36:24.837340 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-865b93c5-ff19-4ec7-be6a-b40f51557643 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:36:24.837340 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-865b93c5-ff19-4ec7-be6a-b40f51557643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:24.905618 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:36:25.082651 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1034/2065] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:36:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:36:25.097338 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4280ab9f-e4d8-47fe-a2e4-8c7549f86b23 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:25.107314 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-4280ab9f-e4d8-47fe-a2e4-8c7549f86b23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:25.284772 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4280ab9f-e4d8-47fe-a2e4-8c7549f86b23 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:25.299615 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6d676-68b6-4106-aa7e-0084dfe2dd77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:25.300571 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6d676-68b6-4106-aa7e-0084dfe2dd77 service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:25.301024 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6d676-68b6-4106-aa7e-0084dfe2dd77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:25.301458 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6d676-68b6-4106-aa7e-0084dfe2dd77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:25.313307 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6d676-68b6-4106-aa7e-0084dfe2dd77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:25.315041 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6d676-68b6-4106-aa7e-0084dfe2dd77 service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:25.328347 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1032/2066] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:36:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:36:26.104890 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b93c5-ff19-4ec7-be6a-b40f51557643 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:26.108332 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-865b93c5-ff19-4ec7-be6a-b40f51557643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:26.140091 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b93c5-ff19-4ec7-be6a-b40f51557643 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:26.150539 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b58bb-82f2-44e9-87e7-f5c35665f031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:26.156698 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b58bb-82f2-44e9-87e7-f5c35665f031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:26.156698 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b58bb-82f2-44e9-87e7-f5c35665f031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:26.156698 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b58bb-82f2-44e9-87e7-f5c35665f031 admin admin] PATH_INFO: `/v3/projects/0e35323caf224bd29360a62cf1b8147f` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:26.156698 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2b58bb-82f2-44e9-87e7-f5c35665f031 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e35323caf224bd29360a62cf1b8147f)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:26.158199 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2b58bb-82f2-44e9-87e7-f5c35665f031 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:26.346218 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-dc2b58bb-82f2-44e9-87e7-f5c35665f031 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e35323caf224bd29360a62cf1b8147f', 'request_id': 'req-dc2b58bb-82f2-44e9-87e7-f5c35665f031'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:26.447169 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-dc2b58bb-82f2-44e9-87e7-f5c35665f031 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e35323caf224bd29360a62cf1b8147f', 'request_id': 'req-dc2b58bb-82f2-44e9-87e7-f5c35665f031'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:26.480867 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-dc2b58bb-82f2-44e9-87e7-f5c35665f031 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e35323caf224bd29360a62cf1b8147f', 'request_id': 'req-dc2b58bb-82f2-44e9-87e7-f5c35665f031'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:26.503442 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-dc2b58bb-82f2-44e9-87e7-f5c35665f031 admin admin] The token cache is being invalidate because project 0e35323caf224bd29360a62cf1b8147f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:36:26.503971 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-dc2b58bb-82f2-44e9-87e7-f5c35665f031 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:26.504811 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-dc2b58bb-82f2-44e9-87e7-f5c35665f031 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:26.507243 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1035/2067] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:36:26 2022] DELETE /identity/v3/projects/0e35323caf224bd29360a62cf1b8147f => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:36:26.511936 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6d676-68b6-4106-aa7e-0084dfe2dd77 service neutron] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:26.522888 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6d676-68b6-4106-aa7e-0084dfe2dd77 service neutron] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:26.603685 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539fae02-a138-4b24-a0a6-f29c0605d75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:26.604670 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fae02-a138-4b24-a0a6-f29c0605d75d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:26.605015 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fae02-a138-4b24-a0a6-f29c0605d75d admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:26.605294 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fae02-a138-4b24-a0a6-f29c0605d75d admin admin] PATH_INFO: `/v3/users/0c42a8839526497e966987189b624c72` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:26.606496 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539fae02-a138-4b24-a0a6-f29c0605d75d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c42a8839526497e966987189b624c72)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:26.609582 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539fae02-a138-4b24-a0a6-f29c0605d75d admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:26.894257 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:36:26.897478 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-539fae02-a138-4b24-a0a6-f29c0605d75d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c42a8839526497e966987189b624c72'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:26.905475 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-539fae02-a138-4b24-a0a6-f29c0605d75d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c42a8839526497e966987189b624c72'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:26.981170 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-539fae02-a138-4b24-a0a6-f29c0605d75d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c42a8839526497e966987189b624c72'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:26.981827 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-539fae02-a138-4b24-a0a6-f29c0605d75d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c42a8839526497e966987189b624c72'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:27.003261 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-539fae02-a138-4b24-a0a6-f29c0605d75d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c42a8839526497e966987189b624c72'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:27.010637 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1033/2068] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:36:26 2022] DELETE /identity/v3/users/0c42a8839526497e966987189b624c72 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:36:27.647377 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b58bb-82f2-44e9-87e7-f5c35665f031 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:27.648864 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-dc2b58bb-82f2-44e9-87e7-f5c35665f031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:27.675687 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b58bb-82f2-44e9-87e7-f5c35665f031 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:27.786677 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3e77a-c3e0-4980-beed-e1b4d67e9c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:27.787606 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3e77a-c3e0-4980-beed-e1b4d67e9c30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:27.787890 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3e77a-c3e0-4980-beed-e1b4d67e9c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:27.788347 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3e77a-c3e0-4980-beed-e1b4d67e9c30 admin admin] PATH_INFO: `/v3/projects/8d3c34531e2843c9b707225ba6363048` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:27.793852 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd3e77a-c3e0-4980-beed-e1b4d67e9c30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d3c34531e2843c9b707225ba6363048)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:27.794133 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd3e77a-c3e0-4980-beed-e1b4d67e9c30 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:27.952614 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:36:27.957201 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-bbd3e77a-c3e0-4980-beed-e1b4d67e9c30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d3c34531e2843c9b707225ba6363048', 'request_id': 'req-bbd3e77a-c3e0-4980-beed-e1b4d67e9c30'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:28.060499 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-bbd3e77a-c3e0-4980-beed-e1b4d67e9c30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d3c34531e2843c9b707225ba6363048', 'request_id': 'req-bbd3e77a-c3e0-4980-beed-e1b4d67e9c30'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:28.074977 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-bbd3e77a-c3e0-4980-beed-e1b4d67e9c30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d3c34531e2843c9b707225ba6363048', 'request_id': 'req-bbd3e77a-c3e0-4980-beed-e1b4d67e9c30'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:28.091521 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-bbd3e77a-c3e0-4980-beed-e1b4d67e9c30 admin admin] The token cache is being invalidate because project 8d3c34531e2843c9b707225ba6363048 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:36:28.092109 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-bbd3e77a-c3e0-4980-beed-e1b4d67e9c30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:28.093417 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-bbd3e77a-c3e0-4980-beed-e1b4d67e9c30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:28.095281 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1036/2069] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:36:27 2022] DELETE /identity/v3/projects/8d3c34531e2843c9b707225ba6363048 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:36:28.101097 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39923a75-2316-48b8-9d8a-76ef6cfd9d31 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:28.102177 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39923a75-2316-48b8-9d8a-76ef6cfd9d31 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:28.102694 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39923a75-2316-48b8-9d8a-76ef6cfd9d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:28.146106 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-39923a75-2316-48b8-9d8a-76ef6cfd9d31 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:36:28.147469 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-39923a75-2316-48b8-9d8a-76ef6cfd9d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:28.213787 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1034/2070] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:36:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:36:28.221672 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74700d-6277-4df4-a58c-f536b582cd23 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:28.221963 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74700d-6277-4df4-a58c-f536b582cd23 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:28.222245 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74700d-6277-4df4-a58c-f536b582cd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:28.241725 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-dd74700d-6277-4df4-a58c-f536b582cd23 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:36:28.243062 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-dd74700d-6277-4df4-a58c-f536b582cd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:28.252668 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1037/2071] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:36:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 09:36:28.257182 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39923a75-2316-48b8-9d8a-76ef6cfd9d31 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:28.267555 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39923a75-2316-48b8-9d8a-76ef6cfd9d31 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:28.272261 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9a7c8-5fa4-439f-b6ea-bd7ad52c984a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:28.272926 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9a7c8-5fa4-439f-b6ea-bd7ad52c984a admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:28.273213 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9a7c8-5fa4-439f-b6ea-bd7ad52c984a admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:28.273490 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9a7c8-5fa4-439f-b6ea-bd7ad52c984a admin admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:28.274292 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f9a7c8-5fa4-439f-b6ea-bd7ad52c984a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:36:28.275137 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f9a7c8-5fa4-439f-b6ea-bd7ad52c984a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:28.276948 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f9a7c8-5fa4-439f-b6ea-bd7ad52c984a admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:28.289132 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1035/2072] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:36:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:36:28.293736 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74700d-6277-4df4-a58c-f536b582cd23 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:28.303322 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74700d-6277-4df4-a58c-f536b582cd23 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:28.308754 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483c81d-035f-4626-aa05-77ec124b7214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:28.309415 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483c81d-035f-4626-aa05-77ec124b7214 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:28.309696 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483c81d-035f-4626-aa05-77ec124b7214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:28.309972 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483c81d-035f-4626-aa05-77ec124b7214 admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:28.310817 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483c81d-035f-4626-aa05-77ec124b7214 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:28.312634 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483c81d-035f-4626-aa05-77ec124b7214 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:28.674442 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1038/2073] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:36:28 2022] POST /identity/v3/projects => generated 407 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:36:28.675958 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9a7c8-5fa4-439f-b6ea-bd7ad52c984a admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:28.691410 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9a7c8-5fa4-439f-b6ea-bd7ad52c984a admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:28.832350 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb48c18-4c48-442c-b3fa-37641c1e4418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:28.833036 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb48c18-4c48-442c-b3fa-37641c1e4418 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:28.833399 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb48c18-4c48-442c-b3fa-37641c1e4418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:28.833690 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb48c18-4c48-442c-b3fa-37641c1e4418 admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:28.834432 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb48c18-4c48-442c-b3fa-37641c1e4418 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:28.836419 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb48c18-4c48-442c-b3fa-37641c1e4418 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:28.989499 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1036/2074] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:36:28 2022] POST /identity/v3/users => generated 304 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:36:28.996520 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483c81d-035f-4626-aa05-77ec124b7214 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:29.010027 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483c81d-035f-4626-aa05-77ec124b7214 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:29.028690 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6b03f-bb49-4043-beae-f08259b34c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:29.029394 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6b03f-bb49-4043-beae-f08259b34c32 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:29.029682 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6b03f-bb49-4043-beae-f08259b34c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:29.029960 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6b03f-bb49-4043-beae-f08259b34c32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:29.030705 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a6b03f-bb49-4043-beae-f08259b34c32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:29.032388 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a6b03f-bb49-4043-beae-f08259b34c32 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:29.059531 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1039/2075] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:36:29.064239 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb48c18-4c48-442c-b3fa-37641c1e4418 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:29.081705 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb48c18-4c48-442c-b3fa-37641c1e4418 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:29.096165 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b57869-8f55-4d08-a0be-e1fe76483364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:29.097161 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b57869-8f55-4d08-a0be-e1fe76483364 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:29.098351 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b57869-8f55-4d08-a0be-e1fe76483364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:29.098836 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b57869-8f55-4d08-a0be-e1fe76483364 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:29.100964 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b57869-8f55-4d08-a0be-e1fe76483364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:29.126685 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b57869-8f55-4d08-a0be-e1fe76483364 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:29.163599 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1037/2076] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:36:29 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:36:29.176528 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6b03f-bb49-4043-beae-f08259b34c32 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:29.192163 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6b03f-bb49-4043-beae-f08259b34c32 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:29.197309 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85bbb25-3142-424c-9d1c-6ae643a67216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:29.198201 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85bbb25-3142-424c-9d1c-6ae643a67216 admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:29.198483 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85bbb25-3142-424c-9d1c-6ae643a67216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:29.198767 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85bbb25-3142-424c-9d1c-6ae643a67216 admin admin] PATH_INFO: `/v3/projects/81de3f52b73e4cfe89838361bcad1791/users/7236ee1bc01c4f0db6b4e5681a1d22cb/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:29.216465 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85bbb25-3142-424c-9d1c-6ae643a67216 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81de3f52b73e4cfe89838361bcad1791, user_id=7236ee1bc01c4f0db6b4e5681a1d22cb, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:29.219296 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85bbb25-3142-424c-9d1c-6ae643a67216 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:29.318156 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1040/2077] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:36:29 2022] PUT /identity/v3/projects/81de3f52b73e4cfe89838361bcad1791/users/7236ee1bc01c4f0db6b4e5681a1d22cb/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:36:29.322492 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dad3ca-8e47-47ec-bcb5-224805686215 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:29.323031 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dad3ca-8e47-47ec-bcb5-224805686215 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:29.323468 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dad3ca-8e47-47ec-bcb5-224805686215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:29.382183 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:36:29.402186 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-b2dad3ca-8e47-47ec-bcb5-224805686215 None None] MFA Rules not processed for user `7236ee1bc01c4f0db6b4e5681a1d22cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:36:29.404245 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-b2dad3ca-8e47-47ec-bcb5-224805686215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:29.556167 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85bbb25-3142-424c-9d1c-6ae643a67216 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:29.560046 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1038/2078] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:36:29 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:36:29.656187 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85bbb25-3142-424c-9d1c-6ae643a67216 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:29.672880 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269fb56-5f7d-459f-b0fc-bacc710b45a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:29.673981 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269fb56-5f7d-459f-b0fc-bacc710b45a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:29.674543 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269fb56-5f7d-459f-b0fc-bacc710b45a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:29.675471 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269fb56-5f7d-459f-b0fc-bacc710b45a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:29.676530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9269fb56-5f7d-459f-b0fc-bacc710b45a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:29.678919 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9269fb56-5f7d-459f-b0fc-bacc710b45a8 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:29.816546 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dad3ca-8e47-47ec-bcb5-224805686215 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:29.822555 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1041/2079] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:36:29 2022] POST /identity/v3/projects => generated 409 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:36:29.833815 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dad3ca-8e47-47ec-bcb5-224805686215 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:29.958175 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4757d123-0766-4b21-b178-33cd3c461a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:29.959151 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757d123-0766-4b21-b178-33cd3c461a57 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:29.959623 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757d123-0766-4b21-b178-33cd3c461a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:29.960051 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757d123-0766-4b21-b178-33cd3c461a57 admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:29.960932 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4757d123-0766-4b21-b178-33cd3c461a57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:29.964151 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4757d123-0766-4b21-b178-33cd3c461a57 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:30.103046 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1039/2080] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:36:29 2022] POST /identity/v3/users => generated 311 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:36:30.105056 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269fb56-5f7d-459f-b0fc-bacc710b45a8 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:30.132500 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269fb56-5f7d-459f-b0fc-bacc710b45a8 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:30.146524 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c217718-6f87-43fa-9375-0d12dbccc286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:30.147454 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c217718-6f87-43fa-9375-0d12dbccc286 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:30.151979 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c217718-6f87-43fa-9375-0d12dbccc286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:30.151979 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c217718-6f87-43fa-9375-0d12dbccc286 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:30.151979 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c217718-6f87-43fa-9375-0d12dbccc286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:30.151979 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c217718-6f87-43fa-9375-0d12dbccc286 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:30.180238 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4757d123-0766-4b21-b178-33cd3c461a57 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:30.181579 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1042/2081] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:36:30.192088 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4757d123-0766-4b21-b178-33cd3c461a57 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:30.198346 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb5cb9-22a9-47fd-a572-5e76639e6f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:30.199327 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb5cb9-22a9-47fd-a572-5e76639e6f03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:30.199705 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb5cb9-22a9-47fd-a572-5e76639e6f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:30.200075 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb5cb9-22a9-47fd-a572-5e76639e6f03 admin admin] PATH_INFO: `/v3/projects/c687013f824544d598a80494068a9357/users/5fb5d7aaab49481698c95e1ccfee706b/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:30.219100 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb5cb9-22a9-47fd-a572-5e76639e6f03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c687013f824544d598a80494068a9357, user_id=5fb5d7aaab49481698c95e1ccfee706b, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:30.221951 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb5cb9-22a9-47fd-a572-5e76639e6f03 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:30.384255 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1040/2082] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:36:30 2022] PUT /identity/v3/projects/c687013f824544d598a80494068a9357/users/5fb5d7aaab49481698c95e1ccfee706b/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:36:30.388606 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c217718-6f87-43fa-9375-0d12dbccc286 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:30.402017 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c217718-6f87-43fa-9375-0d12dbccc286 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:30.516234 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:36:30.535432 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91045f-019b-43b7-b095-0e087d0ce7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:30.537276 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91045f-019b-43b7-b095-0e087d0ce7ce admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:30.537276 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91045f-019b-43b7-b095-0e087d0ce7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:30.537276 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91045f-019b-43b7-b095-0e087d0ce7ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:30.537581 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f91045f-019b-43b7-b095-0e087d0ce7ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:30.539403 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f91045f-019b-43b7-b095-0e087d0ce7ce admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:30.552902 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1043/2083] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:36:30.557558 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb5cb9-22a9-47fd-a572-5e76639e6f03 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:30.568675 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb5cb9-22a9-47fd-a572-5e76639e6f03 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:30.591143 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81fb2a-b51f-4255-b9e5-ca831270706a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:30.592455 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81fb2a-b51f-4255-b9e5-ca831270706a admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:30.593480 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81fb2a-b51f-4255-b9e5-ca831270706a admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:30.593966 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81fb2a-b51f-4255-b9e5-ca831270706a admin admin] PATH_INFO: `/v3/projects/c687013f824544d598a80494068a9357/users/5fb5d7aaab49481698c95e1ccfee706b/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:30.597561 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f81fb2a-b51f-4255-b9e5-ca831270706a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c687013f824544d598a80494068a9357, user_id=5fb5d7aaab49481698c95e1ccfee706b, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:30.601708 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f81fb2a-b51f-4255-b9e5-ca831270706a admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:30.647711 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1041/2084] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:36:30 2022] PUT /identity/v3/projects/c687013f824544d598a80494068a9357/users/5fb5d7aaab49481698c95e1ccfee706b/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:36:30.650843 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be4db7-f73e-4dab-9af0-e3f73cc7a370 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:30.657611 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be4db7-f73e-4dab-9af0-e3f73cc7a370 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:30.659818 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be4db7-f73e-4dab-9af0-e3f73cc7a370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:30.717570 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-71be4db7-f73e-4dab-9af0-e3f73cc7a370 None None] MFA Rules not processed for user `5fb5d7aaab49481698c95e1ccfee706b`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:36:30.718879 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-71be4db7-f73e-4dab-9af0-e3f73cc7a370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:30.903226 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1044/2085] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:36:30 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:36:30.915984 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81fb2a-b51f-4255-b9e5-ca831270706a admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:30.917812 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-4f81fb2a-b51f-4255-b9e5-ca831270706a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:31.045367 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81fb2a-b51f-4255-b9e5-ca831270706a admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:31.049904 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b0a4c-31dc-46ea-8b13-0bd1293540f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:31.050741 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b0a4c-31dc-46ea-8b13-0bd1293540f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:31.051211 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b0a4c-31dc-46ea-8b13-0bd1293540f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:31.051491 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b0a4c-31dc-46ea-8b13-0bd1293540f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:31.065729 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b0a4c-31dc-46ea-8b13-0bd1293540f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:31.069613 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:36:31.069914 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b0a4c-31dc-46ea-8b13-0bd1293540f9 service cinder] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:31.082834 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1042/2086] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:36:30 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:36:31.535730 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be4db7-f73e-4dab-9af0-e3f73cc7a370 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:31.538556 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be4db7-f73e-4dab-9af0-e3f73cc7a370 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:31.543182 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b79fa-9dd2-4805-8dd7-1fd43e5786a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:31.543842 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b79fa-9dd2-4805-8dd7-1fd43e5786a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:31.544131 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b79fa-9dd2-4805-8dd7-1fd43e5786a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:31.544582 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b79fa-9dd2-4805-8dd7-1fd43e5786a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:31.730029 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b79fa-9dd2-4805-8dd7-1fd43e5786a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:31.731580 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b79fa-9dd2-4805-8dd7-1fd43e5786a6 service cinder] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:31.758299 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1045/2087] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:36:31 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:36:34.480347 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de72f31-31fd-4438-bd33-7a141fb4119d None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:34.480955 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de72f31-31fd-4438-bd33-7a141fb4119d None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:34.480955 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de72f31-31fd-4438-bd33-7a141fb4119d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:34.527453 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-4de72f31-31fd-4438-bd33-7a141fb4119d None None] MFA Rules not processed for user `8f5d1f2327914f9fb070c6212582b6dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:36:34.529151 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-4de72f31-31fd-4438-bd33-7a141fb4119d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:34.603837 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1043/2088] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Jun 27 09:36:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 09:36:34.628029 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b79fa-9dd2-4805-8dd7-1fd43e5786a6 service cinder] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:34.639982 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-977b79fa-9dd2-4805-8dd7-1fd43e5786a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:34.857768 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b79fa-9dd2-4805-8dd7-1fd43e5786a6 service cinder] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:34.872882 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1341c3-0db6-4922-8294-50dd0eb74387 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5477b14dae24fd3a644c9cbd6ff85ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:34.873557 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1341c3-0db6-4922-8294-50dd0eb74387 service swift] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:34.873840 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1341c3-0db6-4922-8294-50dd0eb74387 service swift] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:34.874118 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1341c3-0db6-4922-8294-50dd0eb74387 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:34.887240 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:36:34.890124 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1341c3-0db6-4922-8294-50dd0eb74387 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:34.891878 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1341c3-0db6-4922-8294-50dd0eb74387 service swift] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:34.901711 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1046/2089] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Jun 27 09:36:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 09:36:39.074143 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0488a-9bc4-48bc-81d2-524765b886f0 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:39.074757 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0488a-9bc4-48bc-81d2-524765b886f0 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:39.074757 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0488a-9bc4-48bc-81d2-524765b886f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:39.093442 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-14d0488a-9bc4-48bc-81d2-524765b886f0 None None] MFA Rules not processed for user `1d4e3faf5cb3420d94270c200b446419`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:36:39.094668 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-14d0488a-9bc4-48bc-81d2-524765b886f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:39.192445 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1044/2090] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:36:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:36:41.505928 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1341c3-0db6-4922-8294-50dd0eb74387 service swift] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:41.602787 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1341c3-0db6-4922-8294-50dd0eb74387 service swift] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:41.608508 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9c08e-90cf-4c49-a62a-581a3ad3497d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:41.609779 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9c08e-90cf-4c49-a62a-581a3ad3497d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:41.610187 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9c08e-90cf-4c49-a62a-581a3ad3497d admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:41.610568 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9c08e-90cf-4c49-a62a-581a3ad3497d admin admin] PATH_INFO: `/v3/users/7236ee1bc01c4f0db6b4e5681a1d22cb` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:41.612088 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf9c08e-90cf-4c49-a62a-581a3ad3497d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7236ee1bc01c4f0db6b4e5681a1d22cb)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:41.614794 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf9c08e-90cf-4c49-a62a-581a3ad3497d admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:41.869595 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-eaf9c08e-90cf-4c49-a62a-581a3ad3497d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7236ee1bc01c4f0db6b4e5681a1d22cb'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:41.870305 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-eaf9c08e-90cf-4c49-a62a-581a3ad3497d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7236ee1bc01c4f0db6b4e5681a1d22cb'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:41.964124 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-eaf9c08e-90cf-4c49-a62a-581a3ad3497d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7236ee1bc01c4f0db6b4e5681a1d22cb'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:41.964844 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-eaf9c08e-90cf-4c49-a62a-581a3ad3497d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7236ee1bc01c4f0db6b4e5681a1d22cb'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:41.977295 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-eaf9c08e-90cf-4c49-a62a-581a3ad3497d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7236ee1bc01c4f0db6b4e5681a1d22cb'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:42.047991 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1047/2091] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:36:41 2022] DELETE /identity/v3/users/7236ee1bc01c4f0db6b4e5681a1d22cb => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:36:42.057872 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03267fe7-bb3f-4f88-bec9-2ac8163dd5c3 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:42.060038 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03267fe7-bb3f-4f88-bec9-2ac8163dd5c3 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:42.060038 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03267fe7-bb3f-4f88-bec9-2ac8163dd5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:42.088464 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-03267fe7-bb3f-4f88-bec9-2ac8163dd5c3 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:36:42.091840 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-03267fe7-bb3f-4f88-bec9-2ac8163dd5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:42.178704 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1045/2092] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:36:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:36:42.189794 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9c08e-90cf-4c49-a62a-581a3ad3497d admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:42.191798 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-eaf9c08e-90cf-4c49-a62a-581a3ad3497d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:42.285915 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9c08e-90cf-4c49-a62a-581a3ad3497d admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:42.293772 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b5d4cf-249c-4beb-bb0a-132ce12eb5df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:42.295112 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b5d4cf-249c-4beb-bb0a-132ce12eb5df service neutron] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:42.295604 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b5d4cf-249c-4beb-bb0a-132ce12eb5df service neutron] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:42.296055 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b5d4cf-249c-4beb-bb0a-132ce12eb5df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:42.314022 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b5d4cf-249c-4beb-bb0a-132ce12eb5df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:42.315909 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b5d4cf-249c-4beb-bb0a-132ce12eb5df service neutron] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:42.335504 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1048/2093] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:36:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:36:42.954823 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03267fe7-bb3f-4f88-bec9-2ac8163dd5c3 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:42.956384 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-03267fe7-bb3f-4f88-bec9-2ac8163dd5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:42.969395 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03267fe7-bb3f-4f88-bec9-2ac8163dd5c3 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:42.978056 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c58e3-af99-4e82-9a77-91ba13de96b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:42.979388 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c58e3-af99-4e82-9a77-91ba13de96b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:42.979867 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c58e3-af99-4e82-9a77-91ba13de96b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:42.980284 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c58e3-af99-4e82-9a77-91ba13de96b5 admin admin] PATH_INFO: `/v3/projects/81de3f52b73e4cfe89838361bcad1791` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:42.981979 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c58e3-af99-4e82-9a77-91ba13de96b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81de3f52b73e4cfe89838361bcad1791)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:42.984860 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c58e3-af99-4e82-9a77-91ba13de96b5 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:43.090813 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:36:43.117810 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-e96c58e3-af99-4e82-9a77-91ba13de96b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81de3f52b73e4cfe89838361bcad1791', 'request_id': 'req-e96c58e3-af99-4e82-9a77-91ba13de96b5'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:43.189359 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-e96c58e3-af99-4e82-9a77-91ba13de96b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81de3f52b73e4cfe89838361bcad1791', 'request_id': 'req-e96c58e3-af99-4e82-9a77-91ba13de96b5'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:43.206776 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-e96c58e3-af99-4e82-9a77-91ba13de96b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81de3f52b73e4cfe89838361bcad1791', 'request_id': 'req-e96c58e3-af99-4e82-9a77-91ba13de96b5'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:43.221433 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-e96c58e3-af99-4e82-9a77-91ba13de96b5 admin admin] The token cache is being invalidate because project 81de3f52b73e4cfe89838361bcad1791 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:36:43.222003 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-e96c58e3-af99-4e82-9a77-91ba13de96b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:43.222918 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-e96c58e3-af99-4e82-9a77-91ba13de96b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:43.228659 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1046/2094] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:36:42 2022] DELETE /identity/v3/projects/81de3f52b73e4cfe89838361bcad1791 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:36:43.229462 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b5d4cf-249c-4beb-bb0a-132ce12eb5df service neutron] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:43.242581 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b5d4cf-249c-4beb-bb0a-132ce12eb5df service neutron] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:43.270089 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:36:43.341708 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ae2f2-9f88-44db-9613-c887fe7ca5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:43.342626 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ae2f2-9f88-44db-9613-c887fe7ca5bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:43.342900 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ae2f2-9f88-44db-9613-c887fe7ca5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:43.343170 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ae2f2-9f88-44db-9613-c887fe7ca5bd admin admin] PATH_INFO: `/v3/users/5fb5d7aaab49481698c95e1ccfee706b` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:43.344403 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685ae2f2-9f88-44db-9613-c887fe7ca5bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fb5d7aaab49481698c95e1ccfee706b)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:43.346466 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685ae2f2-9f88-44db-9613-c887fe7ca5bd admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:43.545053 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-685ae2f2-9f88-44db-9613-c887fe7ca5bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fb5d7aaab49481698c95e1ccfee706b'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:43.546632 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-685ae2f2-9f88-44db-9613-c887fe7ca5bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fb5d7aaab49481698c95e1ccfee706b'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:43.620906 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-685ae2f2-9f88-44db-9613-c887fe7ca5bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fb5d7aaab49481698c95e1ccfee706b'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:43.621792 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-685ae2f2-9f88-44db-9613-c887fe7ca5bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fb5d7aaab49481698c95e1ccfee706b'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:43.635452 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-685ae2f2-9f88-44db-9613-c887fe7ca5bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fb5d7aaab49481698c95e1ccfee706b'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:43.659517 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1049/2095] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:36:43 2022] DELETE /identity/v3/users/5fb5d7aaab49481698c95e1ccfee706b => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:36:44.208965 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c58e3-af99-4e82-9a77-91ba13de96b5 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:44.212026 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-e96c58e3-af99-4e82-9a77-91ba13de96b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:44.238671 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c58e3-af99-4e82-9a77-91ba13de96b5 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:44.340273 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae5f1c-8e3f-48a4-b527-da901fe9ad70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:44.340273 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae5f1c-8e3f-48a4-b527-da901fe9ad70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:44.340273 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae5f1c-8e3f-48a4-b527-da901fe9ad70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:44.340273 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae5f1c-8e3f-48a4-b527-da901fe9ad70 admin admin] PATH_INFO: `/v3/projects/c687013f824544d598a80494068a9357` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:44.340960 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae5f1c-8e3f-48a4-b527-da901fe9ad70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c687013f824544d598a80494068a9357)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:44.342629 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae5f1c-8e3f-48a4-b527-da901fe9ad70 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:44.453430 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-20ae5f1c-8e3f-48a4-b527-da901fe9ad70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c687013f824544d598a80494068a9357', 'request_id': 'req-20ae5f1c-8e3f-48a4-b527-da901fe9ad70'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:44.518151 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-20ae5f1c-8e3f-48a4-b527-da901fe9ad70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c687013f824544d598a80494068a9357', 'request_id': 'req-20ae5f1c-8e3f-48a4-b527-da901fe9ad70'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:44.525441 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-20ae5f1c-8e3f-48a4-b527-da901fe9ad70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c687013f824544d598a80494068a9357', 'request_id': 'req-20ae5f1c-8e3f-48a4-b527-da901fe9ad70'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:44.539244 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-20ae5f1c-8e3f-48a4-b527-da901fe9ad70 admin admin] The token cache is being invalidate because project c687013f824544d598a80494068a9357 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:36:44.539556 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-20ae5f1c-8e3f-48a4-b527-da901fe9ad70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:44.540335 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-20ae5f1c-8e3f-48a4-b527-da901fe9ad70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:36:44.543095 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1047/2096] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:36:44 2022] DELETE /identity/v3/projects/c687013f824544d598a80494068a9357 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:36:44.549999 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00840884-f6d0-4bb8-9692-e61c61ac4641 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:44.550559 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00840884-f6d0-4bb8-9692-e61c61ac4641 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:44.550663 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00840884-f6d0-4bb8-9692-e61c61ac4641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:44.589113 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-00840884-f6d0-4bb8-9692-e61c61ac4641 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:36:44.591932 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-00840884-f6d0-4bb8-9692-e61c61ac4641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:44.685105 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1050/2097] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:36:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:36:44.693492 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b2e22-ee38-4f59-b61b-3cb8e396ec1c None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:44.693892 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b2e22-ee38-4f59-b61b-3cb8e396ec1c None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:44.694171 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b2e22-ee38-4f59-b61b-3cb8e396ec1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:44.717590 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-da1b2e22-ee38-4f59-b61b-3cb8e396ec1c None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:36:44.718817 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-da1b2e22-ee38-4f59-b61b-3cb8e396ec1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:44.728912 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1048/2098] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:36:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:36:44.734057 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00840884-f6d0-4bb8-9692-e61c61ac4641 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:44.746422 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00840884-f6d0-4bb8-9692-e61c61ac4641 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:44.753556 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d407d8-6052-46a3-97c4-22657921164a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:44.754321 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d407d8-6052-46a3-97c4-22657921164a admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:44.754670 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d407d8-6052-46a3-97c4-22657921164a admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:44.755012 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d407d8-6052-46a3-97c4-22657921164a admin admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:44.755820 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d407d8-6052-46a3-97c4-22657921164a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:36:44.756297 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d407d8-6052-46a3-97c4-22657921164a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:44.758648 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d407d8-6052-46a3-97c4-22657921164a admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:44.782032 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1051/2099] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:36:44.786370 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b2e22-ee38-4f59-b61b-3cb8e396ec1c None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:44.797017 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b2e22-ee38-4f59-b61b-3cb8e396ec1c None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:44.801783 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0386ed-96d6-43d3-bb17-adcff341ef92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:44.802691 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0386ed-96d6-43d3-bb17-adcff341ef92 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:44.802975 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0386ed-96d6-43d3-bb17-adcff341ef92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:44.803324 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0386ed-96d6-43d3-bb17-adcff341ef92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:44.804022 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0386ed-96d6-43d3-bb17-adcff341ef92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:44.806510 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0386ed-96d6-43d3-bb17-adcff341ef92 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:44.906126 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1049/2100] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:36:44 2022] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:36:44.912033 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d407d8-6052-46a3-97c4-22657921164a admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:44.935637 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d407d8-6052-46a3-97c4-22657921164a admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:44.961072 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:36:45.058548 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969060a-c2af-4b51-b71d-19affbcfdaf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:45.059315 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969060a-c2af-4b51-b71d-19affbcfdaf6 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:45.059595 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969060a-c2af-4b51-b71d-19affbcfdaf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:45.060036 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969060a-c2af-4b51-b71d-19affbcfdaf6 admin admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:45.060755 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8969060a-c2af-4b51-b71d-19affbcfdaf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:45.062699 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8969060a-c2af-4b51-b71d-19affbcfdaf6 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:45.159440 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1052/2101] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:36:44 2022] POST /identity/v3/users => generated 289 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:36:45.164832 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0386ed-96d6-43d3-bb17-adcff341ef92 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:45.175444 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0386ed-96d6-43d3-bb17-adcff341ef92 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:45.196136 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f3180-0775-4e9f-ae9e-07614365bd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:45.197239 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f3180-0775-4e9f-ae9e-07614365bd14 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:45.197578 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f3180-0775-4e9f-ae9e-07614365bd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:45.197858 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f3180-0775-4e9f-ae9e-07614365bd14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:45.198629 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f3180-0775-4e9f-ae9e-07614365bd14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:45.200295 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f3180-0775-4e9f-ae9e-07614365bd14 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:45.212549 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1050/2102] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:36:45.217503 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969060a-c2af-4b51-b71d-19affbcfdaf6 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:45.229256 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969060a-c2af-4b51-b71d-19affbcfdaf6 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:45.234605 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ca0f7-25c6-49ba-8700-683dfe27d265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:45.240028 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ca0f7-25c6-49ba-8700-683dfe27d265 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:45.240028 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ca0f7-25c6-49ba-8700-683dfe27d265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:45.240028 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ca0f7-25c6-49ba-8700-683dfe27d265 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:45.240028 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ca0f7-25c6-49ba-8700-683dfe27d265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:45.241356 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ca0f7-25c6-49ba-8700-683dfe27d265 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:45.254361 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1053/2103] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:36:45.258339 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f3180-0775-4e9f-ae9e-07614365bd14 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:45.270456 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f3180-0775-4e9f-ae9e-07614365bd14 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:45.276061 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb831c6-ad61-4deb-971f-c0f18708d272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:45.277754 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb831c6-ad61-4deb-971f-c0f18708d272 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:45.278132 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb831c6-ad61-4deb-971f-c0f18708d272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:45.278432 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb831c6-ad61-4deb-971f-c0f18708d272 admin admin] PATH_INFO: `/v3/projects/e01e992a5f6f407dbdf1d890cbe7e812/users/9d3311dcfae84c46ba5e58293fea5604/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:45.287926 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:36:45.300101 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb831c6-ad61-4deb-971f-c0f18708d272 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e01e992a5f6f407dbdf1d890cbe7e812, user_id=9d3311dcfae84c46ba5e58293fea5604, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:45.303065 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb831c6-ad61-4deb-971f-c0f18708d272 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:45.381983 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1051/2104] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:36:45 2022] PUT /identity/v3/projects/e01e992a5f6f407dbdf1d890cbe7e812/users/9d3311dcfae84c46ba5e58293fea5604/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:36:45.393472 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e1bee-ba15-4ee6-a2c3-baa6cb7d4b9e None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:45.394045 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e1bee-ba15-4ee6-a2c3-baa6cb7d4b9e None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:45.394394 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e1bee-ba15-4ee6-a2c3-baa6cb7d4b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:45.431757 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-f50e1bee-ba15-4ee6-a2c3-baa6cb7d4b9e None None] MFA Rules not processed for user `9d3311dcfae84c46ba5e58293fea5604`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:36:45.433046 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-f50e1bee-ba15-4ee6-a2c3-baa6cb7d4b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:45.579428 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1054/2105] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:36:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:36:45.597140 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb831c6-ad61-4deb-971f-c0f18708d272 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:45.600831 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-6cb831c6-ad61-4deb-971f-c0f18708d272 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:45.751304 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb831c6-ad61-4deb-971f-c0f18708d272 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:45.761501 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705a4fd-f3c4-4fe7-823f-3bb7d2bddaf9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:45.764819 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705a4fd-f3c4-4fe7-823f-3bb7d2bddaf9 service cinder] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:45.764819 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705a4fd-f3c4-4fe7-823f-3bb7d2bddaf9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:45.764819 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705a4fd-f3c4-4fe7-823f-3bb7d2bddaf9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:45.784629 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9705a4fd-f3c4-4fe7-823f-3bb7d2bddaf9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:45.787697 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9705a4fd-f3c4-4fe7-823f-3bb7d2bddaf9 service cinder] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:45.826767 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1052/2106] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:36:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:36:47.258151 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495c456-8ac9-462d-9189-8b9492044ab5 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:47.258649 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495c456-8ac9-462d-9189-8b9492044ab5 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:47.258852 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495c456-8ac9-462d-9189-8b9492044ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:47.278424 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-1495c456-8ac9-462d-9189-8b9492044ab5 None None] MFA Rules not processed for user `8f5d1f2327914f9fb070c6212582b6dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:36:47.278626 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-1495c456-8ac9-462d-9189-8b9492044ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:47.349892 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1055/2107] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Jun 27 09:36:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:36:47.364543 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705a4fd-f3c4-4fe7-823f-3bb7d2bddaf9 service cinder] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:47.365992 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-9705a4fd-f3c4-4fe7-823f-3bb7d2bddaf9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:47.486787 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705a4fd-f3c4-4fe7-823f-3bb7d2bddaf9 service cinder] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:47.504601 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ca0a5-dcb4-40ed-ba37-49f3be5621ab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5477b14dae24fd3a644c9cbd6ff85ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:47.505192 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ca0a5-dcb4-40ed-ba37-49f3be5621ab service swift] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:47.505638 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ca0a5-dcb4-40ed-ba37-49f3be5621ab service swift] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:47.505811 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ca0a5-dcb4-40ed-ba37-49f3be5621ab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:47.525021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79ca0a5-dcb4-40ed-ba37-49f3be5621ab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:47.526939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79ca0a5-dcb4-40ed-ba37-49f3be5621ab service swift] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:47.542268 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1053/2108] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Jun 27 09:36:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 09:36:53.392929 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53ef3d-55f7-4173-b456-7bf24db856d5 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:53.393510 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53ef3d-55f7-4173-b456-7bf24db856d5 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:53.393510 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53ef3d-55f7-4173-b456-7bf24db856d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:53.414823 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-6b53ef3d-55f7-4173-b456-7bf24db856d5 None None] MFA Rules not processed for user `8a959557b0064aff8e2308e842859481`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:36:53.416718 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-6b53ef3d-55f7-4173-b456-7bf24db856d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:53.452171 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:36:53.503546 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1056/2109] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:36:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 09:36:56.664721 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e3651-cc53-4d0f-8919-adf728fd08cc None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:56.665306 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e3651-cc53-4d0f-8919-adf728fd08cc None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:56.665306 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e3651-cc53-4d0f-8919-adf728fd08cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:56.684167 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-836e3651-cc53-4d0f-8919-adf728fd08cc None None] MFA Rules not processed for user `8f5d1f2327914f9fb070c6212582b6dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:36:56.685362 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-836e3651-cc53-4d0f-8919-adf728fd08cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:36:56.693037 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1054/2110] 10.222.0.62 () {58 vars in 967 bytes} [Mon Jun 27 09:36:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:36:56.707300 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53ef3d-55f7-4173-b456-7bf24db856d5 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:36:56.723376 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53ef3d-55f7-4173-b456-7bf24db856d5 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:36:56.728821 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53cb615-a652-41ba-a9df-4f7bc3ca23cd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5477b14dae24fd3a644c9cbd6ff85ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:36:56.734576 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53cb615-a652-41ba-a9df-4f7bc3ca23cd service swift] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:36:56.734576 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53cb615-a652-41ba-a9df-4f7bc3ca23cd service swift] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:36:56.734576 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53cb615-a652-41ba-a9df-4f7bc3ca23cd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:36:56.739400 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53cb615-a652-41ba-a9df-4f7bc3ca23cd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:36:56.741096 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53cb615-a652-41ba-a9df-4f7bc3ca23cd service swift] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:36:56.749778 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1057/2111] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Jun 27 09:36:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 09:37:00.346480 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b865b-b421-4e64-825e-4599298f05da None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:00.347073 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b865b-b421-4e64-825e-4599298f05da None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:00.347073 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b865b-b421-4e64-825e-4599298f05da None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:00.349648 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1055/2112] 10.222.0.62 () {54 vars in 921 bytes} [Mon Jun 27 09:37:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 09:37:00.401876 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d76ba-5dd7-45be-a621-1b3871aa97e8 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:00.408452 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d76ba-5dd7-45be-a621-1b3871aa97e8 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:00.416527 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d76ba-5dd7-45be-a621-1b3871aa97e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:00.461999 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-e67d76ba-5dd7-45be-a621-1b3871aa97e8 None None] MFA Rules not processed for user `2bbaf738138b40b2a06bb63934f6608c`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:37:00.463224 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-e67d76ba-5dd7-45be-a621-1b3871aa97e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:37:00.505133 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b865b-b421-4e64-825e-4599298f05da None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:00.507168 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-d92b865b-b421-4e64-825e-4599298f05da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:37:00.564267 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1058/2113] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Jun 27 09:37:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:37:00.583305 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d76ba-5dd7-45be-a621-1b3871aa97e8 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:00.584802 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-e67d76ba-5dd7-45be-a621-1b3871aa97e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:37:00.600130 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d76ba-5dd7-45be-a621-1b3871aa97e8 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:00.606321 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b865b-b421-4e64-825e-4599298f05da None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:00.608721 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa8da3-ff72-4a80-a284-6457eb9385c5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbaf738138b40b2a06bb63934f6608c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:00.609458 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa8da3-ff72-4a80-a284-6457eb9385c5 service placement] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:00.609837 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa8da3-ff72-4a80-a284-6457eb9385c5 service placement] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:00.610296 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa8da3-ff72-4a80-a284-6457eb9385c5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:00.616061 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d40c1-4441-4216-a300-698a1500fab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:00.617048 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d40c1-4441-4216-a300-698a1500fab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:00.617330 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d40c1-4441-4216-a300-698a1500fab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:00.617609 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d40c1-4441-4216-a300-698a1500fab9 admin admin] PATH_INFO: `/v3/users/53f0fa68d99341e685ade3449a5c6ece` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:00.619139 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d40c1-4441-4216-a300-698a1500fab9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53f0fa68d99341e685ade3449a5c6ece)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:00.620403 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aa8da3-ff72-4a80-a284-6457eb9385c5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:00.621139 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d40c1-4441-4216-a300-698a1500fab9 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:00.622125 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aa8da3-ff72-4a80-a284-6457eb9385c5 service placement] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:00.632804 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1059/2114] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:37:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 09:37:00.638081 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:37:00.836742 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-b12d40c1-4441-4216-a300-698a1500fab9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53f0fa68d99341e685ade3449a5c6ece'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:37:00.843618 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-b12d40c1-4441-4216-a300-698a1500fab9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53f0fa68d99341e685ade3449a5c6ece'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:37:00.957909 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-b12d40c1-4441-4216-a300-698a1500fab9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53f0fa68d99341e685ade3449a5c6ece'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:37:00.958557 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-b12d40c1-4441-4216-a300-698a1500fab9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53f0fa68d99341e685ade3449a5c6ece'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:37:00.972361 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-b12d40c1-4441-4216-a300-698a1500fab9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53f0fa68d99341e685ade3449a5c6ece'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:37:00.978423 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1056/2115] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:37:00 2022] DELETE /identity/v3/users/53f0fa68d99341e685ade3449a5c6ece => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:37:01.219666 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa8da3-ff72-4a80-a284-6457eb9385c5 service placement] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:01.230883 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa8da3-ff72-4a80-a284-6457eb9385c5 service placement] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:01.295754 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b509aa29-e758-4c1b-b71a-7f0813f30bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:01.296656 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509aa29-e758-4c1b-b71a-7f0813f30bd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:01.296936 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509aa29-e758-4c1b-b71a-7f0813f30bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:01.297208 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509aa29-e758-4c1b-b71a-7f0813f30bd5 admin admin] PATH_INFO: `/v3/projects/463d4c542b844c3aa0ff21fd7b455670` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:01.298438 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b509aa29-e758-4c1b-b71a-7f0813f30bd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=463d4c542b844c3aa0ff21fd7b455670)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:01.300546 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b509aa29-e758-4c1b-b71a-7f0813f30bd5 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:01.308502 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:37:01.427980 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-b509aa29-e758-4c1b-b71a-7f0813f30bd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '463d4c542b844c3aa0ff21fd7b455670', 'request_id': 'req-b509aa29-e758-4c1b-b71a-7f0813f30bd5'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:37:01.471610 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-b509aa29-e758-4c1b-b71a-7f0813f30bd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '463d4c542b844c3aa0ff21fd7b455670', 'request_id': 'req-b509aa29-e758-4c1b-b71a-7f0813f30bd5'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:37:01.477934 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-b509aa29-e758-4c1b-b71a-7f0813f30bd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '463d4c542b844c3aa0ff21fd7b455670', 'request_id': 'req-b509aa29-e758-4c1b-b71a-7f0813f30bd5'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:37:01.492563 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-b509aa29-e758-4c1b-b71a-7f0813f30bd5 admin admin] The token cache is being invalidate because project 463d4c542b844c3aa0ff21fd7b455670 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:37:01.497080 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-b509aa29-e758-4c1b-b71a-7f0813f30bd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:37:01.497080 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-b509aa29-e758-4c1b-b71a-7f0813f30bd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:37:01.497080 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1060/2116] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:37:01 2022] DELETE /identity/v3/projects/463d4c542b844c3aa0ff21fd7b455670 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:37:01.500916 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67311345-64a8-4713-9d26-fa73a59d96ff None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:01.501437 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67311345-64a8-4713-9d26-fa73a59d96ff None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:01.501529 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67311345-64a8-4713-9d26-fa73a59d96ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:01.522128 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-67311345-64a8-4713-9d26-fa73a59d96ff None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:37:01.523413 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-67311345-64a8-4713-9d26-fa73a59d96ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:37:01.585573 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1057/2117] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:37:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 09:37:01.594313 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e7a20-f0a1-4798-a56d-4e9632e2e092 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:01.594608 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e7a20-f0a1-4798-a56d-4e9632e2e092 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:01.594886 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e7a20-f0a1-4798-a56d-4e9632e2e092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:01.615389 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-b11e7a20-f0a1-4798-a56d-4e9632e2e092 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:37:01.616643 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-b11e7a20-f0a1-4798-a56d-4e9632e2e092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:37:01.625292 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1061/2118] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:37:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:37:01.630710 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67311345-64a8-4713-9d26-fa73a59d96ff None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:01.642616 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67311345-64a8-4713-9d26-fa73a59d96ff None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:01.648312 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8166a7b6-30ef-4a60-8f28-eb390f0e64f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:01.649191 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8166a7b6-30ef-4a60-8f28-eb390f0e64f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:01.649469 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8166a7b6-30ef-4a60-8f28-eb390f0e64f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:01.649744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8166a7b6-30ef-4a60-8f28-eb390f0e64f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:01.650556 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8166a7b6-30ef-4a60-8f28-eb390f0e64f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:37:01.650892 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8166a7b6-30ef-4a60-8f28-eb390f0e64f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:01.652646 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8166a7b6-30ef-4a60-8f28-eb390f0e64f0 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:01.665199 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1058/2119] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:37:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:37:01.669919 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11e7a20-f0a1-4798-a56d-4e9632e2e092 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:01.680244 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11e7a20-f0a1-4798-a56d-4e9632e2e092 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:01.685666 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839fbff-e5e8-48e1-b9d7-355f6c724d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:01.686384 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839fbff-e5e8-48e1-b9d7-355f6c724d3a admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:01.686671 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839fbff-e5e8-48e1-b9d7-355f6c724d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:01.687361 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839fbff-e5e8-48e1-b9d7-355f6c724d3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:01.687893 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3839fbff-e5e8-48e1-b9d7-355f6c724d3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:01.690136 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3839fbff-e5e8-48e1-b9d7-355f6c724d3a admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:01.794038 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1062/2120] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:37:01 2022] POST /identity/v3/projects => generated 369 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 09:37:01.802409 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8166a7b6-30ef-4a60-8f28-eb390f0e64f0 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:01.813176 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8166a7b6-30ef-4a60-8f28-eb390f0e64f0 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:01.875061 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d73787-023a-4895-bba9-e5379e58df74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:01.875861 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d73787-023a-4895-bba9-e5379e58df74 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:01.876411 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d73787-023a-4895-bba9-e5379e58df74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:01.876771 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d73787-023a-4895-bba9-e5379e58df74 admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:01.877535 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d73787-023a-4895-bba9-e5379e58df74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:01.879522 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d73787-023a-4895-bba9-e5379e58df74 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:01.975530 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1059/2121] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:37:01 2022] POST /identity/v3/users => generated 285 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 09:37:01.980077 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839fbff-e5e8-48e1-b9d7-355f6c724d3a admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:01.990816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839fbff-e5e8-48e1-b9d7-355f6c724d3a admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:01.996645 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a55abf-9a58-4579-8ffa-b23ba2bb3271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:01.997386 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a55abf-9a58-4579-8ffa-b23ba2bb3271 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:01.997672 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a55abf-9a58-4579-8ffa-b23ba2bb3271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:01.997949 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a55abf-9a58-4579-8ffa-b23ba2bb3271 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:01.998876 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a55abf-9a58-4579-8ffa-b23ba2bb3271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:02.000726 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a55abf-9a58-4579-8ffa-b23ba2bb3271 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:02.013531 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1063/2122] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:37:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:37:02.016100 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d73787-023a-4895-bba9-e5379e58df74 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:02.026673 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d73787-023a-4895-bba9-e5379e58df74 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:02.031684 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9328247-90ba-4793-9bf2-30e91c6a3422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:02.032399 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9328247-90ba-4793-9bf2-30e91c6a3422 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:02.032683 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9328247-90ba-4793-9bf2-30e91c6a3422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:02.032958 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9328247-90ba-4793-9bf2-30e91c6a3422 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:02.033687 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9328247-90ba-4793-9bf2-30e91c6a3422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:02.035321 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9328247-90ba-4793-9bf2-30e91c6a3422 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:02.037645 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:37:02.047717 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1060/2123] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:37:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:37:02.052078 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a55abf-9a58-4579-8ffa-b23ba2bb3271 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:02.063236 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a55abf-9a58-4579-8ffa-b23ba2bb3271 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:02.068041 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac037af-be4b-4f47-9579-670515ae0405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:02.068968 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac037af-be4b-4f47-9579-670515ae0405 admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:02.069250 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac037af-be4b-4f47-9579-670515ae0405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:02.069526 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac037af-be4b-4f47-9579-670515ae0405 admin admin] PATH_INFO: `/v3/projects/0e1877d1d68641769edf134aec8bf7e3/users/0aeaf193f2c94bf58f5f168cb8d6fe0e/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:02.085175 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac037af-be4b-4f47-9579-670515ae0405 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e1877d1d68641769edf134aec8bf7e3, user_id=0aeaf193f2c94bf58f5f168cb8d6fe0e, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:02.088414 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac037af-be4b-4f47-9579-670515ae0405 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:02.153210 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1064/2124] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:37:02 2022] PUT /identity/v3/projects/0e1877d1d68641769edf134aec8bf7e3/users/0aeaf193f2c94bf58f5f168cb8d6fe0e/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:37:02.164567 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba788e2f-b22d-49da-93ab-bc71c9a88c0e None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:02.164870 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba788e2f-b22d-49da-93ab-bc71c9a88c0e None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:02.165144 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba788e2f-b22d-49da-93ab-bc71c9a88c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:02.193552 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-ba788e2f-b22d-49da-93ab-bc71c9a88c0e None None] MFA Rules not processed for user `0aeaf193f2c94bf58f5f168cb8d6fe0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:37:02.194794 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-ba788e2f-b22d-49da-93ab-bc71c9a88c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:37:02.264042 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1061/2125] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:37:02 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:37:02.276851 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac037af-be4b-4f47-9579-670515ae0405 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:02.278568 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-2ac037af-be4b-4f47-9579-670515ae0405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:37:02.340454 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac037af-be4b-4f47-9579-670515ae0405 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:02.344172 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706ecfa-a7e0-4a79-9a0a-5db8581d1928 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6f97b803a28453c8b78fd8380ac64ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:02.344861 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706ecfa-a7e0-4a79-9a0a-5db8581d1928 service glance] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:02.345145 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706ecfa-a7e0-4a79-9a0a-5db8581d1928 service glance] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:02.345421 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706ecfa-a7e0-4a79-9a0a-5db8581d1928 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:02.356428 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c706ecfa-a7e0-4a79-9a0a-5db8581d1928 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:02.361800 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c706ecfa-a7e0-4a79-9a0a-5db8581d1928 service glance] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:02.369401 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1065/2126] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:37:02 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:37:12.153985 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba788e2f-b22d-49da-93ab-bc71c9a88c0e None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:12.155610 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-ba788e2f-b22d-49da-93ab-bc71c9a88c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:37:12.260600 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba788e2f-b22d-49da-93ab-bc71c9a88c0e None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:12.266615 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d0b6b-8c49-4d34-b78a-0a31ef4a2297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:12.267963 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d0b6b-8c49-4d34-b78a-0a31ef4a2297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:12.268286 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d0b6b-8c49-4d34-b78a-0a31ef4a2297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:12.268570 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d0b6b-8c49-4d34-b78a-0a31ef4a2297 admin admin] PATH_INFO: `/v3/users/9d3311dcfae84c46ba5e58293fea5604` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:12.270378 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5d0b6b-8c49-4d34-b78a-0a31ef4a2297 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d3311dcfae84c46ba5e58293fea5604)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:12.272514 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5d0b6b-8c49-4d34-b78a-0a31ef4a2297 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:12.364320 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=75,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:37:12.583770 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-fc5d0b6b-8c49-4d34-b78a-0a31ef4a2297 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d3311dcfae84c46ba5e58293fea5604'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:37:12.591860 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-fc5d0b6b-8c49-4d34-b78a-0a31ef4a2297 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d3311dcfae84c46ba5e58293fea5604'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:37:12.673230 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-fc5d0b6b-8c49-4d34-b78a-0a31ef4a2297 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d3311dcfae84c46ba5e58293fea5604'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:37:12.673986 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-fc5d0b6b-8c49-4d34-b78a-0a31ef4a2297 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d3311dcfae84c46ba5e58293fea5604'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:37:12.692392 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-fc5d0b6b-8c49-4d34-b78a-0a31ef4a2297 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d3311dcfae84c46ba5e58293fea5604'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:37:12.704120 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1062/2127] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:37:12 2022] DELETE /identity/v3/users/9d3311dcfae84c46ba5e58293fea5604 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:37:12.706102 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce1ecb-b1de-4b64-8e96-2d749e121f60 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:12.706102 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce1ecb-b1de-4b64-8e96-2d749e121f60 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:12.706332 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce1ecb-b1de-4b64-8e96-2d749e121f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:12.724521 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-25ce1ecb-b1de-4b64-8e96-2d749e121f60 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:37:12.726095 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-25ce1ecb-b1de-4b64-8e96-2d749e121f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:37:12.797186 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1066/2128] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:37:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 09:37:12.809289 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d0b6b-8c49-4d34-b78a-0a31ef4a2297 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:12.811085 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-fc5d0b6b-8c49-4d34-b78a-0a31ef4a2297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:37:12.822295 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:37:12.879566 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d0b6b-8c49-4d34-b78a-0a31ef4a2297 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:12.883432 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251740d1-0fcf-461e-ab4f-ebc670453ae1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:12.884105 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251740d1-0fcf-461e-ab4f-ebc670453ae1 service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:12.884949 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251740d1-0fcf-461e-ab4f-ebc670453ae1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:12.885226 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251740d1-0fcf-461e-ab4f-ebc670453ae1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:12.894978 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251740d1-0fcf-461e-ab4f-ebc670453ae1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:12.896528 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251740d1-0fcf-461e-ab4f-ebc670453ae1 service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:12.908740 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1063/2129] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:37:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:37:13.644625 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce1ecb-b1de-4b64-8e96-2d749e121f60 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:13.646122 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-25ce1ecb-b1de-4b64-8e96-2d749e121f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:37:13.662315 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce1ecb-b1de-4b64-8e96-2d749e121f60 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:13.667854 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42b599-ac2f-415b-98e7-d997bdfaaa0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:13.668752 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42b599-ac2f-415b-98e7-d997bdfaaa0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:13.669035 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42b599-ac2f-415b-98e7-d997bdfaaa0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:13.669314 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42b599-ac2f-415b-98e7-d997bdfaaa0e admin admin] PATH_INFO: `/v3/projects/e01e992a5f6f407dbdf1d890cbe7e812` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:13.670614 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c42b599-ac2f-415b-98e7-d997bdfaaa0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e01e992a5f6f407dbdf1d890cbe7e812)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:13.672578 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c42b599-ac2f-415b-98e7-d997bdfaaa0e admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:13.812178 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-0c42b599-ac2f-415b-98e7-d997bdfaaa0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e01e992a5f6f407dbdf1d890cbe7e812', 'request_id': 'req-0c42b599-ac2f-415b-98e7-d997bdfaaa0e'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:37:13.894406 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-0c42b599-ac2f-415b-98e7-d997bdfaaa0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e01e992a5f6f407dbdf1d890cbe7e812', 'request_id': 'req-0c42b599-ac2f-415b-98e7-d997bdfaaa0e'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:37:13.901180 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-0c42b599-ac2f-415b-98e7-d997bdfaaa0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e01e992a5f6f407dbdf1d890cbe7e812', 'request_id': 'req-0c42b599-ac2f-415b-98e7-d997bdfaaa0e'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:37:13.912817 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-0c42b599-ac2f-415b-98e7-d997bdfaaa0e admin admin] The token cache is being invalidate because project e01e992a5f6f407dbdf1d890cbe7e812 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:37:13.913082 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-0c42b599-ac2f-415b-98e7-d997bdfaaa0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:37:13.913761 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-0c42b599-ac2f-415b-98e7-d997bdfaaa0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:37:13.915292 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1067/2130] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:37:13 2022] DELETE /identity/v3/projects/e01e992a5f6f407dbdf1d890cbe7e812 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:37:13.921875 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797ff4c-dd6f-44fd-8d69-09fbfb726e22 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:13.922399 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797ff4c-dd6f-44fd-8d69-09fbfb726e22 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:13.922399 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797ff4c-dd6f-44fd-8d69-09fbfb726e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:13.940377 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-7797ff4c-dd6f-44fd-8d69-09fbfb726e22 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:37:13.941579 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-7797ff4c-dd6f-44fd-8d69-09fbfb726e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:37:14.004023 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1064/2131] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:37:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:37:14.012329 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce347500-1816-49d2-acb6-693d237a0d88 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:14.012624 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce347500-1816-49d2-acb6-693d237a0d88 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:14.012903 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce347500-1816-49d2-acb6-693d237a0d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:14.031675 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-ce347500-1816-49d2-acb6-693d237a0d88 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:37:14.036240 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-ce347500-1816-49d2-acb6-693d237a0d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:37:14.042765 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1068/2132] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:37:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:37:14.047464 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797ff4c-dd6f-44fd-8d69-09fbfb726e22 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:14.057871 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797ff4c-dd6f-44fd-8d69-09fbfb726e22 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:14.062788 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc91133-c861-48b7-ac7c-3bb7c381b38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:14.063490 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc91133-c861-48b7-ac7c-3bb7c381b38d admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:14.064006 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc91133-c861-48b7-ac7c-3bb7c381b38d admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:14.064426 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc91133-c861-48b7-ac7c-3bb7c381b38d admin admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:14.065301 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc91133-c861-48b7-ac7c-3bb7c381b38d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:37:14.065788 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc91133-c861-48b7-ac7c-3bb7c381b38d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:14.067692 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc91133-c861-48b7-ac7c-3bb7c381b38d admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:14.080680 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1065/2133] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:37:14.084900 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce347500-1816-49d2-acb6-693d237a0d88 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:14.094077 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce347500-1816-49d2-acb6-693d237a0d88 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:14.098768 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d52b4-af8a-4dbf-ad3d-69c672e1cc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:14.099411 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d52b4-af8a-4dbf-ad3d-69c672e1cc23 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:14.099688 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d52b4-af8a-4dbf-ad3d-69c672e1cc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:14.099962 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d52b4-af8a-4dbf-ad3d-69c672e1cc23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:14.100681 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037d52b4-af8a-4dbf-ad3d-69c672e1cc23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:14.102618 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037d52b4-af8a-4dbf-ad3d-69c672e1cc23 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:14.195230 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1069/2134] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:37:14 2022] POST /identity/v3/projects => generated 389 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 09:37:14.199599 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc91133-c861-48b7-ac7c-3bb7c381b38d admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:14.211642 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc91133-c861-48b7-ac7c-3bb7c381b38d admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:14.273902 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878b5d4-6893-4d58-9b60-c0f100954b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:14.274580 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878b5d4-6893-4d58-9b60-c0f100954b61 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:14.274865 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878b5d4-6893-4d58-9b60-c0f100954b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:14.275728 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878b5d4-6893-4d58-9b60-c0f100954b61 admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:14.276442 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3878b5d4-6893-4d58-9b60-c0f100954b61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:14.278439 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3878b5d4-6893-4d58-9b60-c0f100954b61 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:14.387459 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1066/2135] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:37:14 2022] POST /identity/v3/users => generated 295 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:37:14.392128 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d52b4-af8a-4dbf-ad3d-69c672e1cc23 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:14.405488 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d52b4-af8a-4dbf-ad3d-69c672e1cc23 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:14.411887 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa08e7-3317-4752-a304-823251dd66dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:14.412702 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa08e7-3317-4752-a304-823251dd66dc admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:14.413198 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa08e7-3317-4752-a304-823251dd66dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:14.413350 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa08e7-3317-4752-a304-823251dd66dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:14.414329 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa08e7-3317-4752-a304-823251dd66dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:14.416031 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa08e7-3317-4752-a304-823251dd66dc admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:14.432584 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1070/2136] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:37:14.437046 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878b5d4-6893-4d58-9b60-c0f100954b61 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:14.450358 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878b5d4-6893-4d58-9b60-c0f100954b61 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:14.455963 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d9bff-4b4d-4903-af35-f14737fe3588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:14.459726 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d9bff-4b4d-4903-af35-f14737fe3588 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:14.459726 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d9bff-4b4d-4903-af35-f14737fe3588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:14.459726 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d9bff-4b4d-4903-af35-f14737fe3588 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:14.459726 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d9bff-4b4d-4903-af35-f14737fe3588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:14.459726 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d9bff-4b4d-4903-af35-f14737fe3588 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:14.471097 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1067/2137] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:37:14.475309 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa08e7-3317-4752-a304-823251dd66dc admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:14.486786 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa08e7-3317-4752-a304-823251dd66dc admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:14.492069 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a2868-895b-43ff-9c73-729771fcc13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:14.502431 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a2868-895b-43ff-9c73-729771fcc13c admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:14.502431 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a2868-895b-43ff-9c73-729771fcc13c admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:14.502431 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a2868-895b-43ff-9c73-729771fcc13c admin admin] PATH_INFO: `/v3/projects/3f65ea296e29402bb5f530e587bb8881/users/3e6595b9f9a64b6e9ac7c94f0fa0d183/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:14.512471 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705a2868-895b-43ff-9c73-729771fcc13c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f65ea296e29402bb5f530e587bb8881, user_id=3e6595b9f9a64b6e9ac7c94f0fa0d183, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:14.515613 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705a2868-895b-43ff-9c73-729771fcc13c admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:14.615664 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1071/2138] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:37:14 2022] PUT /identity/v3/projects/3f65ea296e29402bb5f530e587bb8881/users/3e6595b9f9a64b6e9ac7c94f0fa0d183/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:37:14.626789 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e3336-f1c0-431f-9354-ee9c2d47e1e5 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:14.627073 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e3336-f1c0-431f-9354-ee9c2d47e1e5 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:14.627442 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e3336-f1c0-431f-9354-ee9c2d47e1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:14.661191 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-f63e3336-f1c0-431f-9354-ee9c2d47e1e5 None None] MFA Rules not processed for user `3e6595b9f9a64b6e9ac7c94f0fa0d183`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:37:14.662427 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-f63e3336-f1c0-431f-9354-ee9c2d47e1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:37:14.666614 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:37:14.745343 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1068/2139] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:37:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:37:14.759300 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a2868-895b-43ff-9c73-729771fcc13c admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:14.760245 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-705a2868-895b-43ff-9c73-729771fcc13c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:37:14.795599 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:37:14.859062 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a2868-895b-43ff-9c73-729771fcc13c admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:14.863251 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153afeed-2a1d-465b-95ae-b9cb078a146b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:14.863891 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153afeed-2a1d-465b-95ae-b9cb078a146b service cinder] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:14.864169 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153afeed-2a1d-465b-95ae-b9cb078a146b service cinder] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:14.864471 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153afeed-2a1d-465b-95ae-b9cb078a146b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:14.873686 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153afeed-2a1d-465b-95ae-b9cb078a146b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:14.875209 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153afeed-2a1d-465b-95ae-b9cb078a146b service cinder] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:14.886177 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1072/2140] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:37:14 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:37:24.797345 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=25 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:37:25.020290 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=26 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:37:28.228170 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e3336-f1c0-431f-9354-ee9c2d47e1e5 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:28.230240 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-f63e3336-f1c0-431f-9354-ee9c2d47e1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:37:28.286527 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e3336-f1c0-431f-9354-ee9c2d47e1e5 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:28.290048 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab8ee6-d9ac-41b6-98e9-86a7064fc8fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:28.290684 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab8ee6-d9ac-41b6-98e9-86a7064fc8fd service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:28.291001 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab8ee6-d9ac-41b6-98e9-86a7064fc8fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:28.291270 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab8ee6-d9ac-41b6-98e9-86a7064fc8fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:28.293044 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-e9ab8ee6-d9ac-41b6-98e9-86a7064fc8fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:37:28.358570 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab8ee6-d9ac-41b6-98e9-86a7064fc8fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:28.360317 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab8ee6-d9ac-41b6-98e9-86a7064fc8fd service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:28.370744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1069/2141] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:37:28 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:37:34.262776 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153afeed-2a1d-465b-95ae-b9cb078a146b service cinder] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:34.342738 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153afeed-2a1d-465b-95ae-b9cb078a146b service cinder] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:34.347578 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25701b7-d628-410f-839e-1d00b8b74074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:34.348555 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25701b7-d628-410f-839e-1d00b8b74074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:34.348903 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25701b7-d628-410f-839e-1d00b8b74074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:34.349243 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25701b7-d628-410f-839e-1d00b8b74074 admin admin] PATH_INFO: `/v3/users/3e6595b9f9a64b6e9ac7c94f0fa0d183` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:34.350634 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25701b7-d628-410f-839e-1d00b8b74074 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e6595b9f9a64b6e9ac7c94f0fa0d183)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:34.352596 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25701b7-d628-410f-839e-1d00b8b74074 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:34.564168 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-a25701b7-d628-410f-839e-1d00b8b74074 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e6595b9f9a64b6e9ac7c94f0fa0d183'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:37:34.565514 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-a25701b7-d628-410f-839e-1d00b8b74074 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e6595b9f9a64b6e9ac7c94f0fa0d183'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:37:34.642225 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-a25701b7-d628-410f-839e-1d00b8b74074 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e6595b9f9a64b6e9ac7c94f0fa0d183'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:37:34.643144 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-a25701b7-d628-410f-839e-1d00b8b74074 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e6595b9f9a64b6e9ac7c94f0fa0d183'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:37:34.658500 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-a25701b7-d628-410f-839e-1d00b8b74074 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e6595b9f9a64b6e9ac7c94f0fa0d183'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:37:34.688019 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1073/2142] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:37:34 2022] DELETE /identity/v3/users/3e6595b9f9a64b6e9ac7c94f0fa0d183 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:37:34.697014 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7633739-94b9-465a-a689-f4706c379cee None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:34.697540 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7633739-94b9-465a-a689-f4706c379cee None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:34.697695 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7633739-94b9-465a-a689-f4706c379cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:34.715517 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-a7633739-94b9-465a-a689-f4706c379cee None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:37:34.716847 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-a7633739-94b9-465a-a689-f4706c379cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:37:34.784575 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1070/2143] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:37:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:37:34.795072 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25701b7-d628-410f-839e-1d00b8b74074 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:34.796661 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-a25701b7-d628-410f-839e-1d00b8b74074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:37:34.868715 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25701b7-d628-410f-839e-1d00b8b74074 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:34.872481 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477619d8-221a-4c2c-a1a3-37cee0275be7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:34.873144 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477619d8-221a-4c2c-a1a3-37cee0275be7 service neutron] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:34.873426 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477619d8-221a-4c2c-a1a3-37cee0275be7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:34.873703 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477619d8-221a-4c2c-a1a3-37cee0275be7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:34.883697 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477619d8-221a-4c2c-a1a3-37cee0275be7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:34.885206 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477619d8-221a-4c2c-a1a3-37cee0275be7 service neutron] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:34.895430 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1074/2144] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:37:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:37:35.445771 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7633739-94b9-465a-a689-f4706c379cee None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:35.448310 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-a7633739-94b9-465a-a689-f4706c379cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:37:35.464322 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7633739-94b9-465a-a689-f4706c379cee None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:35.470592 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd78f1ba-c8b8-440d-b24b-3aa71a7aef66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:35.471688 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78f1ba-c8b8-440d-b24b-3aa71a7aef66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:35.472219 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78f1ba-c8b8-440d-b24b-3aa71a7aef66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:35.472615 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78f1ba-c8b8-440d-b24b-3aa71a7aef66 admin admin] PATH_INFO: `/v3/projects/3f65ea296e29402bb5f530e587bb8881` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:35.474130 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd78f1ba-c8b8-440d-b24b-3aa71a7aef66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f65ea296e29402bb5f530e587bb8881)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:35.476502 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd78f1ba-c8b8-440d-b24b-3aa71a7aef66 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:35.644592 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:37:35.649306 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-cd78f1ba-c8b8-440d-b24b-3aa71a7aef66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f65ea296e29402bb5f530e587bb8881', 'request_id': 'req-cd78f1ba-c8b8-440d-b24b-3aa71a7aef66'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:37:35.722456 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-cd78f1ba-c8b8-440d-b24b-3aa71a7aef66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f65ea296e29402bb5f530e587bb8881', 'request_id': 'req-cd78f1ba-c8b8-440d-b24b-3aa71a7aef66'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:37:35.734588 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-cd78f1ba-c8b8-440d-b24b-3aa71a7aef66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f65ea296e29402bb5f530e587bb8881', 'request_id': 'req-cd78f1ba-c8b8-440d-b24b-3aa71a7aef66'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:37:35.755399 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-cd78f1ba-c8b8-440d-b24b-3aa71a7aef66 admin admin] The token cache is being invalidate because project 3f65ea296e29402bb5f530e587bb8881 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:37:35.762373 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-cd78f1ba-c8b8-440d-b24b-3aa71a7aef66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:37:35.764744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-cd78f1ba-c8b8-440d-b24b-3aa71a7aef66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:37:35.766484 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1071/2145] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:37:35 2022] DELETE /identity/v3/projects/3f65ea296e29402bb5f530e587bb8881 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:37:37.656411 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d9952-432b-42ac-875a-e0517962538a None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:37.656903 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d9952-432b-42ac-875a-e0517962538a None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:37.657022 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d9952-432b-42ac-875a-e0517962538a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:37.675357 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-6c2d9952-432b-42ac-875a-e0517962538a None None] MFA Rules not processed for user `4c30a14c11d24ff3bd270c8e865a55d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:37:37.676673 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-6c2d9952-432b-42ac-875a-e0517962538a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:37:37.693841 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:37:37.733105 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1075/2146] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:37:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:37:38.176808 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd63a8b-1b77-4d0f-82ef-62ef55033390 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:38.177350 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd63a8b-1b77-4d0f-82ef-62ef55033390 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:38.177350 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd63a8b-1b77-4d0f-82ef-62ef55033390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:38.196123 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-2cd63a8b-1b77-4d0f-82ef-62ef55033390 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:37:38.197928 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-2cd63a8b-1b77-4d0f-82ef-62ef55033390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:37:38.265314 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1072/2147] 10.222.0.69 () {58 vars in 1016 bytes} [Mon Jun 27 09:37:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:37:38.340916 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d9952-432b-42ac-875a-e0517962538a None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:38.342495 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-6c2d9952-432b-42ac-875a-e0517962538a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:37:38.446212 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d9952-432b-42ac-875a-e0517962538a None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:38.452665 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461ed9e-c4fd-4be3-b6f2-11b40bcac080 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:38.453287 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461ed9e-c4fd-4be3-b6f2-11b40bcac080 service nova] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:38.453572 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461ed9e-c4fd-4be3-b6f2-11b40bcac080 service nova] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:38.453889 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461ed9e-c4fd-4be3-b6f2-11b40bcac080 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:38.462417 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5461ed9e-c4fd-4be3-b6f2-11b40bcac080 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:38.464051 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5461ed9e-c4fd-4be3-b6f2-11b40bcac080 service nova] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:38.476376 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1076/2148] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:37:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:37:40.552258 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd63a8b-1b77-4d0f-82ef-62ef55033390 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:40.552258 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-2cd63a8b-1b77-4d0f-82ef-62ef55033390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:37:40.630089 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd63a8b-1b77-4d0f-82ef-62ef55033390 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:40.635589 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5580ab98-0351-4388-890e-a069b9ad3d0d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbaf738138b40b2a06bb63934f6608c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:40.636748 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580ab98-0351-4388-890e-a069b9ad3d0d service placement] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:40.637244 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580ab98-0351-4388-890e-a069b9ad3d0d service placement] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:40.637730 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580ab98-0351-4388-890e-a069b9ad3d0d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:40.640302 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-5580ab98-0351-4388-890e-a069b9ad3d0d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:37:40.653264 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5580ab98-0351-4388-890e-a069b9ad3d0d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:40.654861 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5580ab98-0351-4388-890e-a069b9ad3d0d service placement] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:40.665030 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1073/2149] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:37:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:37:43.578201 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a4d9e-759b-4142-a2ed-d41a7ebeb0bb None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:43.578931 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a4d9e-759b-4142-a2ed-d41a7ebeb0bb None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:43.578931 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a4d9e-759b-4142-a2ed-d41a7ebeb0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:43.597311 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-800a4d9e-759b-4142-a2ed-d41a7ebeb0bb None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:37:43.598519 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-800a4d9e-759b-4142-a2ed-d41a7ebeb0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:37:43.607206 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1077/2150] 10.222.0.69 () {58 vars in 1016 bytes} [Mon Jun 27 09:37:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 09:37:43.632566 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5580ab98-0351-4388-890e-a069b9ad3d0d service placement] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:43.634659 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-5580ab98-0351-4388-890e-a069b9ad3d0d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:37:43.655475 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5580ab98-0351-4388-890e-a069b9ad3d0d service placement] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:43.661261 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61966b68-c07d-45b2-99ae-7a07c86801ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:43.661895 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61966b68-c07d-45b2-99ae-7a07c86801ca service nova] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:43.662171 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61966b68-c07d-45b2-99ae-7a07c86801ca service nova] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:43.662447 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61966b68-c07d-45b2-99ae-7a07c86801ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:43.673354 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61966b68-c07d-45b2-99ae-7a07c86801ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:43.677109 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61966b68-c07d-45b2-99ae-7a07c86801ca service nova] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:43.685017 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1074/2151] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:37:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:37:47.764190 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a4d9e-759b-4142-a2ed-d41a7ebeb0bb None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:47.765682 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-800a4d9e-759b-4142-a2ed-d41a7ebeb0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:37:47.778393 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a4d9e-759b-4142-a2ed-d41a7ebeb0bb None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:47.782941 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606321f4-2d37-4ba4-b4d7-d06bf84d8948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:47.783796 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606321f4-2d37-4ba4-b4d7-d06bf84d8948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:47.784075 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606321f4-2d37-4ba4-b4d7-d06bf84d8948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:47.784385 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606321f4-2d37-4ba4-b4d7-d06bf84d8948 admin admin] PATH_INFO: `/v3/users/0aeaf193f2c94bf58f5f168cb8d6fe0e` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:47.785665 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606321f4-2d37-4ba4-b4d7-d06bf84d8948 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aeaf193f2c94bf58f5f168cb8d6fe0e)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:47.787576 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606321f4-2d37-4ba4-b4d7-d06bf84d8948 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:48.010861 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-606321f4-2d37-4ba4-b4d7-d06bf84d8948 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aeaf193f2c94bf58f5f168cb8d6fe0e'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:37:48.011514 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-606321f4-2d37-4ba4-b4d7-d06bf84d8948 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aeaf193f2c94bf58f5f168cb8d6fe0e'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:37:48.088535 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-606321f4-2d37-4ba4-b4d7-d06bf84d8948 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aeaf193f2c94bf58f5f168cb8d6fe0e'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:37:48.089104 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-606321f4-2d37-4ba4-b4d7-d06bf84d8948 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aeaf193f2c94bf58f5f168cb8d6fe0e'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:37:48.096775 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-606321f4-2d37-4ba4-b4d7-d06bf84d8948 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aeaf193f2c94bf58f5f168cb8d6fe0e'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:37:48.115861 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:37:48.124192 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1078/2152] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:37:47 2022] DELETE /identity/v3/users/0aeaf193f2c94bf58f5f168cb8d6fe0e => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:37:48.128679 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18581ba3-ffb0-4afb-aaa7-9f16f9cca7e7 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:48.129145 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18581ba3-ffb0-4afb-aaa7-9f16f9cca7e7 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:48.129415 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18581ba3-ffb0-4afb-aaa7-9f16f9cca7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:48.152314 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-18581ba3-ffb0-4afb-aaa7-9f16f9cca7e7 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:37:48.153534 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-18581ba3-ffb0-4afb-aaa7-9f16f9cca7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:37:48.200641 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:37:48.215309 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1075/2153] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:37:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 09:37:48.229804 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606321f4-2d37-4ba4-b4d7-d06bf84d8948 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:48.231268 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-606321f4-2d37-4ba4-b4d7-d06bf84d8948 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:37:48.289012 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606321f4-2d37-4ba4-b4d7-d06bf84d8948 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:48.292891 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b777a1-15e7-40e3-81e6-132777e687e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:48.293562 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b777a1-15e7-40e3-81e6-132777e687e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:48.293852 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b777a1-15e7-40e3-81e6-132777e687e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:48.294207 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b777a1-15e7-40e3-81e6-132777e687e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:48.304145 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b777a1-15e7-40e3-81e6-132777e687e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:48.305651 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b777a1-15e7-40e3-81e6-132777e687e0 service neutron] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:48.315939 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1079/2154] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:37:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 09:37:48.826980 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18581ba3-ffb0-4afb-aaa7-9f16f9cca7e7 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:48.828743 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-18581ba3-ffb0-4afb-aaa7-9f16f9cca7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:37:48.842560 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18581ba3-ffb0-4afb-aaa7-9f16f9cca7e7 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:48.847535 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d98ada-b590-4783-8891-0d77cab82072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:48.848775 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d98ada-b590-4783-8891-0d77cab82072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:48.849061 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d98ada-b590-4783-8891-0d77cab82072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:48.851549 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d98ada-b590-4783-8891-0d77cab82072 admin admin] PATH_INFO: `/v3/projects/0e1877d1d68641769edf134aec8bf7e3` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:48.851549 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d98ada-b590-4783-8891-0d77cab82072 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e1877d1d68641769edf134aec8bf7e3)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:48.852601 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d98ada-b590-4783-8891-0d77cab82072 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:48.975820 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-45d98ada-b590-4783-8891-0d77cab82072 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e1877d1d68641769edf134aec8bf7e3', 'request_id': 'req-45d98ada-b590-4783-8891-0d77cab82072'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:37:49.083898 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-45d98ada-b590-4783-8891-0d77cab82072 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e1877d1d68641769edf134aec8bf7e3', 'request_id': 'req-45d98ada-b590-4783-8891-0d77cab82072'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:37:49.090096 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-45d98ada-b590-4783-8891-0d77cab82072 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e1877d1d68641769edf134aec8bf7e3', 'request_id': 'req-45d98ada-b590-4783-8891-0d77cab82072'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:37:49.102062 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-45d98ada-b590-4783-8891-0d77cab82072 admin admin] The token cache is being invalidate because project 0e1877d1d68641769edf134aec8bf7e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:37:49.102354 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-45d98ada-b590-4783-8891-0d77cab82072 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:37:49.103010 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-45d98ada-b590-4783-8891-0d77cab82072 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:37:49.104696 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1076/2155] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:37:48 2022] DELETE /identity/v3/projects/0e1877d1d68641769edf134aec8bf7e3 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:37:49.110249 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331473a-0be7-4403-8448-6a1df75f1cf6 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:49.110729 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331473a-0be7-4403-8448-6a1df75f1cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:49.110840 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331473a-0be7-4403-8448-6a1df75f1cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:49.129567 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-4331473a-0be7-4403-8448-6a1df75f1cf6 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:37:49.130754 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-4331473a-0be7-4403-8448-6a1df75f1cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:37:49.190682 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1080/2156] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:37:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:37:49.198515 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e5555-7296-46d6-bbe1-8fe0fab87e17 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:49.199010 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e5555-7296-46d6-bbe1-8fe0fab87e17 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:49.199135 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e5555-7296-46d6-bbe1-8fe0fab87e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:49.212348 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01bee33-5c69-4240-b15c-1ad4e788bab6 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:49.212656 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01bee33-5c69-4240-b15c-1ad4e788bab6 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:49.212964 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01bee33-5c69-4240-b15c-1ad4e788bab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:49.298010 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-c01bee33-5c69-4240-b15c-1ad4e788bab6 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:37:49.298282 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-6a3e5555-7296-46d6-bbe1-8fe0fab87e17 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:37:49.299268 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-c01bee33-5c69-4240-b15c-1ad4e788bab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:37:49.299417 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-6a3e5555-7296-46d6-bbe1-8fe0fab87e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:37:49.307391 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1077/2157] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:37:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:37:49.310688 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1081/2158] 10.222.0.69 () {58 vars in 1016 bytes} [Mon Jun 27 09:37:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 09:37:49.311614 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e5555-7296-46d6-bbe1-8fe0fab87e17 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:49.320737 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e5555-7296-46d6-bbe1-8fe0fab87e17 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:49.326006 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d85cc0-0565-472f-ad6b-4f22131b5bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:49.326648 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d85cc0-0565-472f-ad6b-4f22131b5bfb admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:49.329358 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d85cc0-0565-472f-ad6b-4f22131b5bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:49.329358 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d85cc0-0565-472f-ad6b-4f22131b5bfb admin admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:49.329358 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d85cc0-0565-472f-ad6b-4f22131b5bfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:37:49.329358 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d85cc0-0565-472f-ad6b-4f22131b5bfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:49.330161 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d85cc0-0565-472f-ad6b-4f22131b5bfb admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:49.331846 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01bee33-5c69-4240-b15c-1ad4e788bab6 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:49.333316 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-c01bee33-5c69-4240-b15c-1ad4e788bab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:37:49.342615 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1078/2159] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:37:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:37:49.346735 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d85cc0-0565-472f-ad6b-4f22131b5bfb admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:49.357322 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d85cc0-0565-472f-ad6b-4f22131b5bfb admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:49.362576 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5adddc0-ca2b-41c1-9363-13b23c21e95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:49.363233 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5adddc0-ca2b-41c1-9363-13b23c21e95b admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:49.363518 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5adddc0-ca2b-41c1-9363-13b23c21e95b admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:49.363801 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5adddc0-ca2b-41c1-9363-13b23c21e95b admin admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:49.364575 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5adddc0-ca2b-41c1-9363-13b23c21e95b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:49.366472 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5adddc0-ca2b-41c1-9363-13b23c21e95b admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:49.423715 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01bee33-5c69-4240-b15c-1ad4e788bab6 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:49.429743 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9349daf-8f5e-4ccf-9900-329db68a2f57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:49.430399 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9349daf-8f5e-4ccf-9900-329db68a2f57 service nova] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:49.430736 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9349daf-8f5e-4ccf-9900-329db68a2f57 service nova] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:49.431059 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9349daf-8f5e-4ccf-9900-329db68a2f57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:49.439870 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9349daf-8f5e-4ccf-9900-329db68a2f57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:49.441552 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9349daf-8f5e-4ccf-9900-329db68a2f57 service nova] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:49.452023 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1082/2160] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:37:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:37:49.468076 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1079/2161] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:37:49 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 09:37:49.471987 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9349daf-8f5e-4ccf-9900-329db68a2f57 service nova] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:49.483526 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9349daf-8f5e-4ccf-9900-329db68a2f57 service nova] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:49.500736 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:37:49.540462 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3625f-a762-4144-b864-8e3f1cb0d486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:49.541141 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3625f-a762-4144-b864-8e3f1cb0d486 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:49.541419 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3625f-a762-4144-b864-8e3f1cb0d486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:49.541688 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3625f-a762-4144-b864-8e3f1cb0d486 admin admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:49.542437 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a3625f-a762-4144-b864-8e3f1cb0d486 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:49.544551 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a3625f-a762-4144-b864-8e3f1cb0d486 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:49.626417 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1083/2162] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:37:49 2022] POST /identity/v3/users => generated 287 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:37:49.630517 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5adddc0-ca2b-41c1-9363-13b23c21e95b admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:49.641438 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5adddc0-ca2b-41c1-9363-13b23c21e95b admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:49.646190 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09177fea-f28f-4078-b595-de6b37eddcf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:49.646865 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09177fea-f28f-4078-b595-de6b37eddcf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:49.647132 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09177fea-f28f-4078-b595-de6b37eddcf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:49.647633 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09177fea-f28f-4078-b595-de6b37eddcf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:49.648156 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09177fea-f28f-4078-b595-de6b37eddcf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:49.649845 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09177fea-f28f-4078-b595-de6b37eddcf9 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:49.660300 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1080/2163] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:37:49.666301 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3625f-a762-4144-b864-8e3f1cb0d486 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:49.674555 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3625f-a762-4144-b864-8e3f1cb0d486 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:49.679193 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21956b09-bf00-436c-b7c0-5c7f80f8ee3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:49.679848 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21956b09-bf00-436c-b7c0-5c7f80f8ee3c admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:49.680130 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21956b09-bf00-436c-b7c0-5c7f80f8ee3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:49.680441 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21956b09-bf00-436c-b7c0-5c7f80f8ee3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:49.681229 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21956b09-bf00-436c-b7c0-5c7f80f8ee3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:49.682813 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21956b09-bf00-436c-b7c0-5c7f80f8ee3c admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:49.693580 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1084/2164] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:37:49.697721 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09177fea-f28f-4078-b595-de6b37eddcf9 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:49.708332 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09177fea-f28f-4078-b595-de6b37eddcf9 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:49.713282 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0cf24-89af-4c92-8429-d2136125a5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:49.714149 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0cf24-89af-4c92-8429-d2136125a5ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:49.714428 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0cf24-89af-4c92-8429-d2136125a5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:49.714700 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0cf24-89af-4c92-8429-d2136125a5ad admin admin] PATH_INFO: `/v3/projects/7c989271b6fa40a2b16167d79b9f4484/users/67cf8e0e101e4c098ef3be9115cebc01/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:49.733747 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a0cf24-89af-4c92-8429-d2136125a5ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c989271b6fa40a2b16167d79b9f4484, user_id=67cf8e0e101e4c098ef3be9115cebc01, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:49.736419 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a0cf24-89af-4c92-8429-d2136125a5ad admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:49.802555 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1081/2165] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:37:49 2022] PUT /identity/v3/projects/7c989271b6fa40a2b16167d79b9f4484/users/67cf8e0e101e4c098ef3be9115cebc01/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:37:49.813536 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae45d7-192c-4f1c-9512-8e2b9247c1d3 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:49.813822 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae45d7-192c-4f1c-9512-8e2b9247c1d3 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:49.814094 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae45d7-192c-4f1c-9512-8e2b9247c1d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:49.842126 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-77ae45d7-192c-4f1c-9512-8e2b9247c1d3 None None] MFA Rules not processed for user `67cf8e0e101e4c098ef3be9115cebc01`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:37:49.843329 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-77ae45d7-192c-4f1c-9512-8e2b9247c1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:37:49.908136 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1085/2166] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:37:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:37:49.918857 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0cf24-89af-4c92-8429-d2136125a5ad admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:49.922077 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-90a0cf24-89af-4c92-8429-d2136125a5ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:37:49.981591 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0cf24-89af-4c92-8429-d2136125a5ad admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:49.985178 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3030da3-ccda-4e94-832c-d00d7bf000be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:49.985821 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3030da3-ccda-4e94-832c-d00d7bf000be service cinder] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:49.986102 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3030da3-ccda-4e94-832c-d00d7bf000be service cinder] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:49.986376 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3030da3-ccda-4e94-832c-d00d7bf000be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:49.995160 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3030da3-ccda-4e94-832c-d00d7bf000be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:49.997182 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3030da3-ccda-4e94-832c-d00d7bf000be service cinder] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:50.002378 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:37:50.007006 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1082/2167] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:37:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:37:50.031856 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae45d7-192c-4f1c-9512-8e2b9247c1d3 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:50.098862 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae45d7-192c-4f1c-9512-8e2b9247c1d3 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:50.103509 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4107a-bc31-433b-913e-fcaf28087017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:50.104502 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4107a-bc31-433b-913e-fcaf28087017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:50.104783 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4107a-bc31-433b-913e-fcaf28087017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:50.105061 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4107a-bc31-433b-913e-fcaf28087017 admin admin] PATH_INFO: `/v3/users/67cf8e0e101e4c098ef3be9115cebc01` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:50.106790 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c4107a-bc31-433b-913e-fcaf28087017 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67cf8e0e101e4c098ef3be9115cebc01)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:50.109351 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c4107a-bc31-433b-913e-fcaf28087017 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:50.334994 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:37:50.348847 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-90c4107a-bc31-433b-913e-fcaf28087017 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67cf8e0e101e4c098ef3be9115cebc01'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:37:50.349546 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-90c4107a-bc31-433b-913e-fcaf28087017 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67cf8e0e101e4c098ef3be9115cebc01'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:37:50.425930 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-90c4107a-bc31-433b-913e-fcaf28087017 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67cf8e0e101e4c098ef3be9115cebc01'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:37:50.426543 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-90c4107a-bc31-433b-913e-fcaf28087017 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67cf8e0e101e4c098ef3be9115cebc01'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:37:50.434071 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-90c4107a-bc31-433b-913e-fcaf28087017 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67cf8e0e101e4c098ef3be9115cebc01'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:37:50.452650 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1086/2168] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:37:50 2022] DELETE /identity/v3/users/67cf8e0e101e4c098ef3be9115cebc01 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:37:50.457396 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8393e-70b4-4e19-98c5-16c43a972381 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:50.457961 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8393e-70b4-4e19-98c5-16c43a972381 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:50.458076 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8393e-70b4-4e19-98c5-16c43a972381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:50.475751 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-efe8393e-70b4-4e19-98c5-16c43a972381 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:37:50.476981 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-efe8393e-70b4-4e19-98c5-16c43a972381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:37:50.534992 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1083/2169] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:37:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:37:50.545695 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4107a-bc31-433b-913e-fcaf28087017 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:50.547043 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-90c4107a-bc31-433b-913e-fcaf28087017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:37:50.613871 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4107a-bc31-433b-913e-fcaf28087017 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:50.615364 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55999a2-fdc9-4a0e-a101-db5192866bfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:50.618781 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55999a2-fdc9-4a0e-a101-db5192866bfe service neutron] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:50.619076 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55999a2-fdc9-4a0e-a101-db5192866bfe service neutron] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:50.619362 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55999a2-fdc9-4a0e-a101-db5192866bfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:50.629702 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55999a2-fdc9-4a0e-a101-db5192866bfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:50.637335 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55999a2-fdc9-4a0e-a101-db5192866bfe service neutron] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:50.642132 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1087/2170] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:37:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:37:51.021745 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe8393e-70b4-4e19-98c5-16c43a972381 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:51.023297 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-efe8393e-70b4-4e19-98c5-16c43a972381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:37:51.036029 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe8393e-70b4-4e19-98c5-16c43a972381 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:51.040617 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91dd7c-6414-426d-b3fb-8eb01468bb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:51.041481 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91dd7c-6414-426d-b3fb-8eb01468bb04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:51.041774 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91dd7c-6414-426d-b3fb-8eb01468bb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:51.042030 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91dd7c-6414-426d-b3fb-8eb01468bb04 admin admin] PATH_INFO: `/v3/projects/7c989271b6fa40a2b16167d79b9f4484` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:51.043231 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b91dd7c-6414-426d-b3fb-8eb01468bb04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c989271b6fa40a2b16167d79b9f4484)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:51.045175 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b91dd7c-6414-426d-b3fb-8eb01468bb04 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:51.163589 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-7b91dd7c-6414-426d-b3fb-8eb01468bb04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c989271b6fa40a2b16167d79b9f4484', 'request_id': 'req-7b91dd7c-6414-426d-b3fb-8eb01468bb04'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:37:51.225450 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-7b91dd7c-6414-426d-b3fb-8eb01468bb04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c989271b6fa40a2b16167d79b9f4484', 'request_id': 'req-7b91dd7c-6414-426d-b3fb-8eb01468bb04'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:37:51.232209 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-7b91dd7c-6414-426d-b3fb-8eb01468bb04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c989271b6fa40a2b16167d79b9f4484', 'request_id': 'req-7b91dd7c-6414-426d-b3fb-8eb01468bb04'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:37:51.243920 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-7b91dd7c-6414-426d-b3fb-8eb01468bb04 admin admin] The token cache is being invalidate because project 7c989271b6fa40a2b16167d79b9f4484 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:37:51.244223 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-7b91dd7c-6414-426d-b3fb-8eb01468bb04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:37:51.244891 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-7b91dd7c-6414-426d-b3fb-8eb01468bb04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:37:51.246996 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1084/2171] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:37:51 2022] DELETE /identity/v3/projects/7c989271b6fa40a2b16167d79b9f4484 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:37:51.252437 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69aec06-0c19-44f7-8a81-28730e756fce None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:51.252811 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69aec06-0c19-44f7-8a81-28730e756fce None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:51.253143 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69aec06-0c19-44f7-8a81-28730e756fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:51.272986 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-e69aec06-0c19-44f7-8a81-28730e756fce None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:37:51.274201 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-e69aec06-0c19-44f7-8a81-28730e756fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:37:51.334788 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1088/2172] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:37:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:37:51.343431 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7520a6a-efd8-48ed-bd0f-b1e6ee0dc6c1 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:51.343720 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7520a6a-efd8-48ed-bd0f-b1e6ee0dc6c1 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:51.344005 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7520a6a-efd8-48ed-bd0f-b1e6ee0dc6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:51.362983 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-d7520a6a-efd8-48ed-bd0f-b1e6ee0dc6c1 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:37:51.364279 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-d7520a6a-efd8-48ed-bd0f-b1e6ee0dc6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:37:51.372742 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1085/2173] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:37:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:37:51.376969 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69aec06-0c19-44f7-8a81-28730e756fce None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:51.386587 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69aec06-0c19-44f7-8a81-28730e756fce None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:51.391807 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df8614-b0bb-4644-a4d4-8419ccf89ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:51.392486 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df8614-b0bb-4644-a4d4-8419ccf89ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:51.392771 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df8614-b0bb-4644-a4d4-8419ccf89ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:51.393046 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df8614-b0bb-4644-a4d4-8419ccf89ae6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:51.393772 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03df8614-b0bb-4644-a4d4-8419ccf89ae6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:37:51.394078 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03df8614-b0bb-4644-a4d4-8419ccf89ae6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:51.395691 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03df8614-b0bb-4644-a4d4-8419ccf89ae6 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:51.407645 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1089/2174] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:37:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:37:51.411701 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7520a6a-efd8-48ed-bd0f-b1e6ee0dc6c1 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:51.421018 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7520a6a-efd8-48ed-bd0f-b1e6ee0dc6c1 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:51.426021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0e2d20-88e8-4dc0-a084-0e0079e562f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:51.426683 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e2d20-88e8-4dc0-a084-0e0079e562f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:51.426968 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e2d20-88e8-4dc0-a084-0e0079e562f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:51.427269 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e2d20-88e8-4dc0-a084-0e0079e562f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:51.427962 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0e2d20-88e8-4dc0-a084-0e0079e562f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:51.429916 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0e2d20-88e8-4dc0-a084-0e0079e562f1 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:51.529418 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1086/2175] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:37:51 2022] POST /identity/v3/projects => generated 371 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:37:51.542837 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df8614-b0bb-4644-a4d4-8419ccf89ae6 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:51.553723 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df8614-b0bb-4644-a4d4-8419ccf89ae6 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:51.589932 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:37:51.614911 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f715b1a-b54a-49ac-b614-09e3a6fcbe81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:51.615572 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f715b1a-b54a-49ac-b614-09e3a6fcbe81 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:51.615850 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f715b1a-b54a-49ac-b614-09e3a6fcbe81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:51.616118 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f715b1a-b54a-49ac-b614-09e3a6fcbe81 admin admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:51.616848 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f715b1a-b54a-49ac-b614-09e3a6fcbe81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:51.618908 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f715b1a-b54a-49ac-b614-09e3a6fcbe81 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:51.694566 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1090/2176] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:37:51 2022] POST /identity/v3/users => generated 286 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 09:37:51.699145 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0e2d20-88e8-4dc0-a084-0e0079e562f1 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:51.710085 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0e2d20-88e8-4dc0-a084-0e0079e562f1 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:51.714942 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f54b4d-1d3f-4e06-90f9-9d44666adba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:51.715709 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f54b4d-1d3f-4e06-90f9-9d44666adba0 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:51.715914 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f54b4d-1d3f-4e06-90f9-9d44666adba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:51.716225 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f54b4d-1d3f-4e06-90f9-9d44666adba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:51.716956 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f54b4d-1d3f-4e06-90f9-9d44666adba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:51.718562 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f54b4d-1d3f-4e06-90f9-9d44666adba0 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:51.729664 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1087/2177] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 09:37:51.734263 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f715b1a-b54a-49ac-b614-09e3a6fcbe81 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:51.745115 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f715b1a-b54a-49ac-b614-09e3a6fcbe81 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:51.750539 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324816b1-d765-49bd-bf0b-ef24dbea45ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:51.751210 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324816b1-d765-49bd-bf0b-ef24dbea45ba admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:51.751645 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324816b1-d765-49bd-bf0b-ef24dbea45ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:51.751821 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324816b1-d765-49bd-bf0b-ef24dbea45ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:51.752569 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324816b1-d765-49bd-bf0b-ef24dbea45ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:51.754285 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324816b1-d765-49bd-bf0b-ef24dbea45ba admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:51.764991 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1091/2178] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 09:37:51.769260 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f54b4d-1d3f-4e06-90f9-9d44666adba0 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:51.779459 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f54b4d-1d3f-4e06-90f9-9d44666adba0 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:51.784247 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95885f46-ace6-46b6-a87b-ed48127727b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:51.785127 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95885f46-ace6-46b6-a87b-ed48127727b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:51.785409 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95885f46-ace6-46b6-a87b-ed48127727b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:51.785684 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95885f46-ace6-46b6-a87b-ed48127727b3 admin admin] PATH_INFO: `/v3/projects/6b9d83dd20c744bdb87c90594016af65/users/2b93f2292e2c40cfade9c4f04eb1bc12/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:51.802375 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95885f46-ace6-46b6-a87b-ed48127727b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b9d83dd20c744bdb87c90594016af65, user_id=2b93f2292e2c40cfade9c4f04eb1bc12, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:51.805134 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95885f46-ace6-46b6-a87b-ed48127727b3 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:51.877715 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1088/2179] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:37:51 2022] PUT /identity/v3/projects/6b9d83dd20c744bdb87c90594016af65/users/2b93f2292e2c40cfade9c4f04eb1bc12/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:37:51.883333 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b31e8-b1d8-4950-8205-fe2e6c0a92b1 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:51.883333 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b31e8-b1d8-4950-8205-fe2e6c0a92b1 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:51.883333 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b31e8-b1d8-4950-8205-fe2e6c0a92b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:51.901014 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-654b31e8-b1d8-4950-8205-fe2e6c0a92b1 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:37:51.902246 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-654b31e8-b1d8-4950-8205-fe2e6c0a92b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:37:51.966425 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1092/2180] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:37:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:37:51.977647 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95885f46-ace6-46b6-a87b-ed48127727b3 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:51.979339 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-95885f46-ace6-46b6-a87b-ed48127727b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:37:52.002068 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:37:52.036965 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95885f46-ace6-46b6-a87b-ed48127727b3 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:52.041353 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d65ba2-a8d9-483e-b4c3-1a7f4473b775 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:52.041996 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d65ba2-a8d9-483e-b4c3-1a7f4473b775 service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:52.042282 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d65ba2-a8d9-483e-b4c3-1a7f4473b775 service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:52.042555 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d65ba2-a8d9-483e-b4c3-1a7f4473b775 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:52.052534 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d65ba2-a8d9-483e-b4c3-1a7f4473b775 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:52.053952 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d65ba2-a8d9-483e-b4c3-1a7f4473b775 service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:52.063601 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1089/2181] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:37:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:37:54.963326 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9a93a-8863-4fa8-b3fb-239b673bf218 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:54.963860 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9a93a-8863-4fa8-b3fb-239b673bf218 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:54.963945 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9a93a-8863-4fa8-b3fb-239b673bf218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:54.986045 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-1eb9a93a-8863-4fa8-b3fb-239b673bf218 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:37:54.987540 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-1eb9a93a-8863-4fa8-b3fb-239b673bf218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:37:54.998298 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1093/2182] 10.222.0.69 () {58 vars in 1016 bytes} [Mon Jun 27 09:37:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:37:55.023795 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d65ba2-a8d9-483e-b4c3-1a7f4473b775 service neutron] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:55.025803 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-27d65ba2-a8d9-483e-b4c3-1a7f4473b775 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:37:55.125479 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d65ba2-a8d9-483e-b4c3-1a7f4473b775 service neutron] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:55.132646 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5d0cf-01f8-4315-8248-c5fc65e7445c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:55.133417 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5d0cf-01f8-4315-8248-c5fc65e7445c service nova] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:55.133849 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5d0cf-01f8-4315-8248-c5fc65e7445c service nova] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:55.134116 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5d0cf-01f8-4315-8248-c5fc65e7445c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:55.148074 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e5d0cf-01f8-4315-8248-c5fc65e7445c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:55.149839 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e5d0cf-01f8-4315-8248-c5fc65e7445c service nova] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:55.162872 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1090/2183] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:37:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:37:57.549582 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331a1c0-7bb0-47f6-9cb9-f06bae5f1883 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:57.550302 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331a1c0-7bb0-47f6-9cb9-f06bae5f1883 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:57.550488 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331a1c0-7bb0-47f6-9cb9-f06bae5f1883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:57.583588 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-0331a1c0-7bb0-47f6-9cb9-f06bae5f1883 None None] MFA Rules not processed for user `2b93f2292e2c40cfade9c4f04eb1bc12`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:37:57.584893 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-0331a1c0-7bb0-47f6-9cb9-f06bae5f1883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:37:57.661021 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1094/2184] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:37:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:37:57.665508 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5d0cf-01f8-4315-8248-c5fc65e7445c service nova] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:57.676080 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5d0cf-01f8-4315-8248-c5fc65e7445c service nova] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:57.680744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef5d9d-26eb-41c4-be63-9e0307752a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:57.681397 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef5d9d-26eb-41c4-be63-9e0307752a77 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:57.681681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef5d9d-26eb-41c4-be63-9e0307752a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:57.681958 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef5d9d-26eb-41c4-be63-9e0307752a77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:57.682658 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef5d9d-26eb-41c4-be63-9e0307752a77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:57.685439 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef5d9d-26eb-41c4-be63-9e0307752a77 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:57.778325 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1091/2185] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:37:57 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:37:57.779605 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331a1c0-7bb0-47f6-9cb9-f06bae5f1883 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:57.791202 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331a1c0-7bb0-47f6-9cb9-f06bae5f1883 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:57.836856 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:37:57.866995 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc1190-db02-4bdd-b49a-079039ad58b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:57.867682 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc1190-db02-4bdd-b49a-079039ad58b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:57.867961 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc1190-db02-4bdd-b49a-079039ad58b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:57.868293 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc1190-db02-4bdd-b49a-079039ad58b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:57.871407 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc1190-db02-4bdd-b49a-079039ad58b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:57.873455 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc1190-db02-4bdd-b49a-079039ad58b3 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:57.990333 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1095/2186] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:37:57 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:37:57.991720 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef5d9d-26eb-41c4-be63-9e0307752a77 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:58.003524 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef5d9d-26eb-41c4-be63-9e0307752a77 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:58.009759 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a1c9a-8469-449b-b941-7dad76d6c2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:58.010439 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a1c9a-8469-449b-b941-7dad76d6c2c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:58.010930 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a1c9a-8469-449b-b941-7dad76d6c2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:58.011210 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a1c9a-8469-449b-b941-7dad76d6c2c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:58.012138 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51a1c9a-8469-449b-b941-7dad76d6c2c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:58.014102 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51a1c9a-8469-449b-b941-7dad76d6c2c4 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:58.031723 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1092/2187] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:37:58.037782 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc1190-db02-4bdd-b49a-079039ad58b3 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:58.048956 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc1190-db02-4bdd-b49a-079039ad58b3 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:58.053707 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846d595-a311-43f2-a050-d2bccb3ae969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:58.054596 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846d595-a311-43f2-a050-d2bccb3ae969 admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:58.054885 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846d595-a311-43f2-a050-d2bccb3ae969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:58.055147 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846d595-a311-43f2-a050-d2bccb3ae969 admin admin] PATH_INFO: `/v3/projects/0eea87959c9448e9a1b19146af592806/users/ec43aed384424cf29e10b94e239c36d5/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:58.072106 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2846d595-a311-43f2-a050-d2bccb3ae969 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eea87959c9448e9a1b19146af592806, user_id=ec43aed384424cf29e10b94e239c36d5, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:58.074561 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2846d595-a311-43f2-a050-d2bccb3ae969 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:58.175479 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1096/2188] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:37:58 2022] PUT /identity/v3/projects/0eea87959c9448e9a1b19146af592806/users/ec43aed384424cf29e10b94e239c36d5/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:37:58.179611 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a1c9a-8469-449b-b941-7dad76d6c2c4 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:58.189876 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a1c9a-8469-449b-b941-7dad76d6c2c4 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:58.249940 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54346c1-8260-4a09-9a64-dc2ce8b1c7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:58.250597 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54346c1-8260-4a09-9a64-dc2ce8b1c7a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:58.250876 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54346c1-8260-4a09-9a64-dc2ce8b1c7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:58.251153 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54346c1-8260-4a09-9a64-dc2ce8b1c7a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:58.251875 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54346c1-8260-4a09-9a64-dc2ce8b1c7a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:58.253585 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54346c1-8260-4a09-9a64-dc2ce8b1c7a0 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:58.264627 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1093/2189] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:37:58.269046 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846d595-a311-43f2-a050-d2bccb3ae969 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:37:58.280223 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846d595-a311-43f2-a050-d2bccb3ae969 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:37:58.285133 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94398788-f668-45d8-9006-b731a36c737b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:37:58.286093 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94398788-f668-45d8-9006-b731a36c737b admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:37:58.286555 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94398788-f668-45d8-9006-b731a36c737b admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:37:58.286766 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94398788-f668-45d8-9006-b731a36c737b admin admin] PATH_INFO: `/v3/projects/0eea87959c9448e9a1b19146af592806/users/ec43aed384424cf29e10b94e239c36d5/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:37:58.288807 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94398788-f668-45d8-9006-b731a36c737b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eea87959c9448e9a1b19146af592806, user_id=ec43aed384424cf29e10b94e239c36d5, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:37:58.291464 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94398788-f668-45d8-9006-b731a36c737b admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:37:58.302364 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1097/2190] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:37:58 2022] PUT /identity/v3/projects/0eea87959c9448e9a1b19146af592806/users/ec43aed384424cf29e10b94e239c36d5/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:38:01.408805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5bc54-340f-4a7c-8839-e1bf3ade8903 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:38:01.409322 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5bc54-340f-4a7c-8839-e1bf3ade8903 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:38:01.409404 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5bc54-340f-4a7c-8839-e1bf3ade8903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:38:01.446112 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-94d5bc54-340f-4a7c-8839-e1bf3ade8903 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:38:01.447464 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-94d5bc54-340f-4a7c-8839-e1bf3ade8903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:38:01.474867 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:38:01.574180 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1094/2191] 10.222.0.69 () {58 vars in 1016 bytes} [Mon Jun 27 09:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:38:01.597797 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94398788-f668-45d8-9006-b731a36c737b admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:38:01.599861 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-94398788-f668-45d8-9006-b731a36c737b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:38:01.696010 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94398788-f668-45d8-9006-b731a36c737b admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:38:01.703502 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496dcbb2-211f-4416-8ff1-9610424d99c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:38:01.704488 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496dcbb2-211f-4416-8ff1-9610424d99c4 service nova] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:38:01.705007 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496dcbb2-211f-4416-8ff1-9610424d99c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:38:01.705495 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496dcbb2-211f-4416-8ff1-9610424d99c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:38:01.716649 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496dcbb2-211f-4416-8ff1-9610424d99c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:38:01.718783 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496dcbb2-211f-4416-8ff1-9610424d99c4 service nova] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:38:01.740589 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1098/2192] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:38:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:38:04.680973 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c42ce-d44e-4357-9b39-0706715298da None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:38:04.681855 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c42ce-d44e-4357-9b39-0706715298da None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:38:04.682300 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c42ce-d44e-4357-9b39-0706715298da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:38:04.712454 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-a71c42ce-d44e-4357-9b39-0706715298da None None] MFA Rules not processed for user `ec43aed384424cf29e10b94e239c36d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:38:04.713838 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-a71c42ce-d44e-4357-9b39-0706715298da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:38:04.794907 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1095/2193] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:38:04 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:38:04.802464 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496dcbb2-211f-4416-8ff1-9610424d99c4 service nova] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:38:04.814522 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496dcbb2-211f-4416-8ff1-9610424d99c4 service nova] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:38:04.820102 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db88469-eb8a-4dd5-bb2f-9a6e5901d6eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:38:04.820803 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db88469-eb8a-4dd5-bb2f-9a6e5901d6eb service nova] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:38:04.821086 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db88469-eb8a-4dd5-bb2f-9a6e5901d6eb service nova] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:38:04.821360 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db88469-eb8a-4dd5-bb2f-9a6e5901d6eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:38:04.881327 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db88469-eb8a-4dd5-bb2f-9a6e5901d6eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:38:04.882939 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db88469-eb8a-4dd5-bb2f-9a6e5901d6eb service nova] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:38:04.893194 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1099/2194] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:38:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:38:05.713599 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246bbeb-287c-4f69-b76a-bcb98f9cd0c6 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:38:05.714108 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246bbeb-287c-4f69-b76a-bcb98f9cd0c6 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:38:05.715311 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246bbeb-287c-4f69-b76a-bcb98f9cd0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:38:05.738305 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-f246bbeb-287c-4f69-b76a-bcb98f9cd0c6 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:38:05.739539 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-f246bbeb-287c-4f69-b76a-bcb98f9cd0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:38:05.748104 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1096/2195] 10.222.0.69 () {58 vars in 1016 bytes} [Mon Jun 27 09:38:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:38:05.783728 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db88469-eb8a-4dd5-bb2f-9a6e5901d6eb service nova] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:38:05.795460 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db88469-eb8a-4dd5-bb2f-9a6e5901d6eb service nova] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:38:05.802268 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d38538-c86a-464a-8090-20ac68283b2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:38:05.803366 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d38538-c86a-464a-8090-20ac68283b2c service nova] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:38:05.803978 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d38538-c86a-464a-8090-20ac68283b2c service nova] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:38:05.803978 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d38538-c86a-464a-8090-20ac68283b2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:38:05.813857 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d38538-c86a-464a-8090-20ac68283b2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:38:05.816920 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d38538-c86a-464a-8090-20ac68283b2c service nova] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:38:05.825777 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1100/2196] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:38:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:38:07.827935 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4f564-b1bc-4aa7-b466-1c6be5976dba None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:38:07.828615 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4f564-b1bc-4aa7-b466-1c6be5976dba None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:38:07.828713 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4f564-b1bc-4aa7-b466-1c6be5976dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:38:07.847087 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-f2f4f564-b1bc-4aa7-b466-1c6be5976dba None None] MFA Rules not processed for user `2b93f2292e2c40cfade9c4f04eb1bc12`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:38:07.848333 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-f2f4f564-b1bc-4aa7-b466-1c6be5976dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:38:07.857919 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1097/2197] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:38:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:38:15.820930 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=94,keystone:INSERT=5 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:38:17.842506 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=62 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:38:29.546126 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537aa3c-f377-4029-b757-7e2125eb51d0 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:38:29.546605 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537aa3c-f377-4029-b757-7e2125eb51d0 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:38:29.546712 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537aa3c-f377-4029-b757-7e2125eb51d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:38:29.566770 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-b537aa3c-f377-4029-b757-7e2125eb51d0 None None] MFA Rules not processed for user `ab7398448109433c8d3839e0ffb747d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:38:29.567918 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-b537aa3c-f377-4029-b757-7e2125eb51d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:38:29.637334 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1101/2198] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:38:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:38:39.627656 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=25 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:38:50.781727 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4f564-b1bc-4aa7-b466-1c6be5976dba None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:38:50.783782 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-f2f4f564-b1bc-4aa7-b466-1c6be5976dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:38:50.843672 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4f564-b1bc-4aa7-b466-1c6be5976dba None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:38:50.848017 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937129d-d77a-4357-9f34-849de09bdf5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:38:50.848770 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937129d-d77a-4357-9f34-849de09bdf5a service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:38:50.849176 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937129d-d77a-4357-9f34-849de09bdf5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:38:50.849472 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937129d-d77a-4357-9f34-849de09bdf5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:38:50.859536 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7937129d-d77a-4357-9f34-849de09bdf5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:38:50.861297 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7937129d-d77a-4357-9f34-849de09bdf5a service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:38:50.871262 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1098/2199] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:38:50 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:38:53.581078 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791736ef-584f-477a-b836-c77d5c2a65bb None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:38:53.581593 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791736ef-584f-477a-b836-c77d5c2a65bb None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:38:53.581892 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791736ef-584f-477a-b836-c77d5c2a65bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:38:53.601315 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-791736ef-584f-477a-b836-c77d5c2a65bb None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:38:53.602538 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-791736ef-584f-477a-b836-c77d5c2a65bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:38:53.610851 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1102/2200] 10.222.0.69 () {58 vars in 1016 bytes} [Mon Jun 27 09:38:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:38:53.632840 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937129d-d77a-4357-9f34-849de09bdf5a service neutron] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:38:53.646289 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937129d-d77a-4357-9f34-849de09bdf5a service neutron] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:38:53.659730 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a59a14b-1e36-459f-a77e-09defb6266bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:38:53.660427 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59a14b-1e36-459f-a77e-09defb6266bd service nova] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:38:53.660769 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59a14b-1e36-459f-a77e-09defb6266bd service nova] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:38:53.661019 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59a14b-1e36-459f-a77e-09defb6266bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:38:53.670626 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a59a14b-1e36-459f-a77e-09defb6266bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:38:53.672239 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a59a14b-1e36-459f-a77e-09defb6266bd service nova] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:38:53.682785 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1099/2201] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:38:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:38:59.018382 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073a7aa-50a1-4833-9363-bca6e891ccc4 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:38:59.018948 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073a7aa-50a1-4833-9363-bca6e891ccc4 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:38:59.018948 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073a7aa-50a1-4833-9363-bca6e891ccc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:38:59.037376 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-5073a7aa-50a1-4833-9363-bca6e891ccc4 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:38:59.038647 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-5073a7aa-50a1-4833-9363-bca6e891ccc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:38:59.046610 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1103/2202] 10.222.0.69 () {58 vars in 1016 bytes} [Mon Jun 27 09:38:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 09:38:59.070940 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a59a14b-1e36-459f-a77e-09defb6266bd service nova] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:38:59.087038 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a59a14b-1e36-459f-a77e-09defb6266bd service nova] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:38:59.096152 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541e53b-c766-47f6-b0e8-cae933d1e18b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:38:59.096152 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541e53b-c766-47f6-b0e8-cae933d1e18b service nova] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:38:59.096152 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541e53b-c766-47f6-b0e8-cae933d1e18b service nova] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:38:59.096152 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541e53b-c766-47f6-b0e8-cae933d1e18b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:38:59.114939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e541e53b-c766-47f6-b0e8-cae933d1e18b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:38:59.114939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e541e53b-c766-47f6-b0e8-cae933d1e18b service nova] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:38:59.124501 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1100/2203] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:38:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 09:38:59.256288 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af914146-dc98-430a-a58a-97171c7c388e None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:38:59.257348 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af914146-dc98-430a-a58a-97171c7c388e None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:38:59.257348 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af914146-dc98-430a-a58a-97171c7c388e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:38:59.307735 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-af914146-dc98-430a-a58a-97171c7c388e None None] MFA Rules not processed for user `8f5d1f2327914f9fb070c6212582b6dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:38:59.309003 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-af914146-dc98-430a-a58a-97171c7c388e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:38:59.377695 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1104/2204] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Jun 27 09:38:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:38:59.531451 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541e53b-c766-47f6-b0e8-cae933d1e18b service nova] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:38:59.532998 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-e541e53b-c766-47f6-b0e8-cae933d1e18b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:38:59.625245 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541e53b-c766-47f6-b0e8-cae933d1e18b service nova] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:38:59.631573 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89864513-a674-4910-a1ea-145260236f9b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5477b14dae24fd3a644c9cbd6ff85ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:38:59.632148 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89864513-a674-4910-a1ea-145260236f9b service swift] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:38:59.632469 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89864513-a674-4910-a1ea-145260236f9b service swift] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:38:59.632746 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89864513-a674-4910-a1ea-145260236f9b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:38:59.641087 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89864513-a674-4910-a1ea-145260236f9b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:38:59.643763 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89864513-a674-4910-a1ea-145260236f9b service swift] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:38:59.652107 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1101/2205] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Jun 27 09:38:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 09:39:04.015239 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a611a06-e1e0-4ab7-b5e9-74101f6236ea None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:39:04.015758 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a611a06-e1e0-4ab7-b5e9-74101f6236ea None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:39:04.015758 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a611a06-e1e0-4ab7-b5e9-74101f6236ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:39:04.041454 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-8a611a06-e1e0-4ab7-b5e9-74101f6236ea None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:39:04.047191 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-8a611a06-e1e0-4ab7-b5e9-74101f6236ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:39:04.059534 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1105/2206] 10.222.0.69 () {58 vars in 1016 bytes} [Mon Jun 27 09:39:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:39:04.099904 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89864513-a674-4910-a1ea-145260236f9b service swift] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:39:04.115020 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89864513-a674-4910-a1ea-145260236f9b service swift] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:39:04.132438 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b65d83-f2e9-4980-82ba-2c9b381989a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:39:04.132438 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b65d83-f2e9-4980-82ba-2c9b381989a7 service nova] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:39:04.132438 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b65d83-f2e9-4980-82ba-2c9b381989a7 service nova] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:39:04.132438 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b65d83-f2e9-4980-82ba-2c9b381989a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:39:04.135926 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b65d83-f2e9-4980-82ba-2c9b381989a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:39:04.137644 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b65d83-f2e9-4980-82ba-2c9b381989a7 service nova] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:39:04.148577 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1102/2207] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:39:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:39:11.501358 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c787525-87a5-4da6-99df-3fb41a66b197 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:39:11.502006 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c787525-87a5-4da6-99df-3fb41a66b197 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:39:11.502006 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c787525-87a5-4da6-99df-3fb41a66b197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:39:11.522324 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-9c787525-87a5-4da6-99df-3fb41a66b197 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:39:11.523617 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-9c787525-87a5-4da6-99df-3fb41a66b197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:39:11.536829 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1106/2208] 10.222.0.69 () {58 vars in 1016 bytes} [Mon Jun 27 09:39:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:39:11.559568 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b65d83-f2e9-4980-82ba-2c9b381989a7 service nova] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:39:11.571082 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b65d83-f2e9-4980-82ba-2c9b381989a7 service nova] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:39:11.576566 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc29bf7-f34b-45f8-84af-33afe39e9db5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:39:11.577199 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc29bf7-f34b-45f8-84af-33afe39e9db5 service nova] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:39:11.577478 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc29bf7-f34b-45f8-84af-33afe39e9db5 service nova] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:39:11.577750 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc29bf7-f34b-45f8-84af-33afe39e9db5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:39:11.586304 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc29bf7-f34b-45f8-84af-33afe39e9db5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:39:11.587869 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc29bf7-f34b-45f8-84af-33afe39e9db5 service nova] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:39:11.597677 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1103/2209] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:39:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:39:16.804586 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d083f2d-0780-4daf-b046-bf6c8baab022 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:39:16.805265 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d083f2d-0780-4daf-b046-bf6c8baab022 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:39:16.805265 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d083f2d-0780-4daf-b046-bf6c8baab022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:39:16.823482 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-6d083f2d-0780-4daf-b046-bf6c8baab022 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:39:16.824873 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-6d083f2d-0780-4daf-b046-bf6c8baab022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:39:16.834170 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1107/2210] 10.222.0.69 () {58 vars in 1016 bytes} [Mon Jun 27 09:39:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:39:16.865061 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc29bf7-f34b-45f8-84af-33afe39e9db5 service nova] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:39:16.877439 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc29bf7-f34b-45f8-84af-33afe39e9db5 service nova] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:39:16.883434 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e7d6c2-08b8-4f3d-ae58-8992ea12236a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:39:16.884172 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7d6c2-08b8-4f3d-ae58-8992ea12236a service nova] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:39:16.884591 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7d6c2-08b8-4f3d-ae58-8992ea12236a service nova] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:39:16.884933 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7d6c2-08b8-4f3d-ae58-8992ea12236a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:39:16.895602 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e7d6c2-08b8-4f3d-ae58-8992ea12236a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:39:16.897605 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e7d6c2-08b8-4f3d-ae58-8992ea12236a service nova] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:39:16.911616 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1104/2211] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:39:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:39:22.150997 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042520ff-cf9e-4b04-80b8-f4bd615a0368 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:39:22.151954 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042520ff-cf9e-4b04-80b8-f4bd615a0368 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:39:22.152282 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042520ff-cf9e-4b04-80b8-f4bd615a0368 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:39:22.153915 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1108/2212] 10.222.0.62 () {54 vars in 921 bytes} [Mon Jun 27 09:39:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:39:22.160547 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d66123-3828-489a-b733-90986382c5ec None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:39:22.160971 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d66123-3828-489a-b733-90986382c5ec None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:39:22.161129 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d66123-3828-489a-b733-90986382c5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:39:22.171962 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=98 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:39:22.212960 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-57d66123-3828-489a-b733-90986382c5ec None None] MFA Rules not processed for user `2c1434a85b30411c9c59cc50c3980cd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:39:22.214418 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-57d66123-3828-489a-b733-90986382c5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:39:22.226017 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1105/2213] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Jun 27 09:39:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:39:22.240189 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042520ff-cf9e-4b04-80b8-f4bd615a0368 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:39:22.242019 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-042520ff-cf9e-4b04-80b8-f4bd615a0368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:39:22.247357 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=56 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:39:22.327208 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042520ff-cf9e-4b04-80b8-f4bd615a0368 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:39:22.330836 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698a637-2a7a-496e-a44a-5a79ece61baa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6f97b803a28453c8b78fd8380ac64ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:39:22.331508 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698a637-2a7a-496e-a44a-5a79ece61baa service glance] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:39:22.332466 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698a637-2a7a-496e-a44a-5a79ece61baa service glance] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:39:22.332741 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698a637-2a7a-496e-a44a-5a79ece61baa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:39:22.343269 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d698a637-2a7a-496e-a44a-5a79ece61baa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:39:22.348168 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d698a637-2a7a-496e-a44a-5a79ece61baa service glance] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:39:22.357145 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1109/2214] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:39:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:39:22.591545 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad712e83-5b42-45a2-bd96-52830330c052 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:39:22.591831 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad712e83-5b42-45a2-bd96-52830330c052 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:39:22.592107 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad712e83-5b42-45a2-bd96-52830330c052 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:39:22.593667 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1106/2215] 10.222.0.62 () {54 vars in 921 bytes} [Mon Jun 27 09:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:39:22.598490 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa0f38-931d-457a-bf20-e652120bfc77 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:39:22.600122 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa0f38-931d-457a-bf20-e652120bfc77 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:39:22.600122 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa0f38-931d-457a-bf20-e652120bfc77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:39:22.617921 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-e1aa0f38-931d-457a-bf20-e652120bfc77 None None] MFA Rules not processed for user `097b991d67164cda94cc5aa24397f414`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:39:22.619221 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-e1aa0f38-931d-457a-bf20-e652120bfc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:39:22.625985 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1110/2216] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Jun 27 09:39:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:39:22.638566 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad712e83-5b42-45a2-bd96-52830330c052 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:39:22.652799 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad712e83-5b42-45a2-bd96-52830330c052 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:39:22.656377 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e55686f-97a4-45e6-835a-b6f9da0cb9b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:39:22.657212 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55686f-97a4-45e6-835a-b6f9da0cb9b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:39:22.657505 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55686f-97a4-45e6-835a-b6f9da0cb9b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:39:22.657781 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55686f-97a4-45e6-835a-b6f9da0cb9b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:39:22.666443 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e55686f-97a4-45e6-835a-b6f9da0cb9b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:39:22.667873 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e55686f-97a4-45e6-835a-b6f9da0cb9b2 service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:39:22.676740 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1107/2217] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:39:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:39:22.762393 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a7cad-f4e9-418f-9a32-edd0469dde4c None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:39:22.763141 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a7cad-f4e9-418f-9a32-edd0469dde4c None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:39:22.763449 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a7cad-f4e9-418f-9a32-edd0469dde4c None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:39:22.765547 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1111/2218] 10.222.0.62 () {54 vars in 921 bytes} [Mon Jun 27 09:39:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:39:22.779813 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722f8d4-14ba-494e-900f-9b455507e536 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:39:22.780509 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722f8d4-14ba-494e-900f-9b455507e536 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:39:22.783379 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722f8d4-14ba-494e-900f-9b455507e536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:39:22.801990 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-7722f8d4-14ba-494e-900f-9b455507e536 None None] MFA Rules not processed for user `2c1434a85b30411c9c59cc50c3980cd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:39:22.803205 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-7722f8d4-14ba-494e-900f-9b455507e536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:39:22.813010 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1108/2219] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Jun 27 09:39:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 09:39:22.839865 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a7cad-f4e9-418f-9a32-edd0469dde4c None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:39:22.852326 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a7cad-f4e9-418f-9a32-edd0469dde4c None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:39:22.857315 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4159304f-d2e8-445a-bb85-aa94d68cea7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:39:22.857955 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159304f-d2e8-445a-bb85-aa94d68cea7c service neutron] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:39:22.858237 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159304f-d2e8-445a-bb85-aa94d68cea7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:39:22.858486 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159304f-d2e8-445a-bb85-aa94d68cea7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:39:22.870889 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4159304f-d2e8-445a-bb85-aa94d68cea7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:39:22.872863 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4159304f-d2e8-445a-bb85-aa94d68cea7c service neutron] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:39:22.886064 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1112/2220] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:39:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:39:32.796172 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=17 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:39:32.880287 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=43 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:39:34.467262 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7722f8d4-14ba-494e-900f-9b455507e536 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:39:34.478012 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7722f8d4-14ba-494e-900f-9b455507e536 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:39:34.482226 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51695e72-2edc-4c0f-9656-b6ab3cad7fe1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:39:34.482925 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51695e72-2edc-4c0f-9656-b6ab3cad7fe1 service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:39:34.483190 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51695e72-2edc-4c0f-9656-b6ab3cad7fe1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:39:34.483412 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51695e72-2edc-4c0f-9656-b6ab3cad7fe1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:39:34.485616 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-51695e72-2edc-4c0f-9656-b6ab3cad7fe1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:39:34.500551 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51695e72-2edc-4c0f-9656-b6ab3cad7fe1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:39:34.501993 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51695e72-2edc-4c0f-9656-b6ab3cad7fe1 service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:39:34.514342 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1109/2221] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:39:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:39:35.332314 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f66745-fe05-40db-985f-877ea00d4efc None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:39:35.332314 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f66745-fe05-40db-985f-877ea00d4efc None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:39:35.332314 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f66745-fe05-40db-985f-877ea00d4efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:39:35.347725 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-b4f66745-fe05-40db-985f-877ea00d4efc None None] MFA Rules not processed for user `8f5d1f2327914f9fb070c6212582b6dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:39:35.349518 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-b4f66745-fe05-40db-985f-877ea00d4efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:39:35.357014 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1113/2222] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Jun 27 09:39:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:39:35.369856 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51695e72-2edc-4c0f-9656-b6ab3cad7fe1 service neutron] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:39:35.381621 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51695e72-2edc-4c0f-9656-b6ab3cad7fe1 service neutron] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:39:35.387131 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aaa961-1b30-4e40-96b3-99234082f29b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5477b14dae24fd3a644c9cbd6ff85ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:39:35.387776 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aaa961-1b30-4e40-96b3-99234082f29b service swift] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:39:35.388058 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aaa961-1b30-4e40-96b3-99234082f29b service swift] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:39:35.388365 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aaa961-1b30-4e40-96b3-99234082f29b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:39:35.397055 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aaa961-1b30-4e40-96b3-99234082f29b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:39:35.398656 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aaa961-1b30-4e40-96b3-99234082f29b service swift] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:39:35.409515 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1110/2223] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Jun 27 09:39:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 09:39:37.051614 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f66745-fe05-40db-985f-877ea00d4efc None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:39:37.062797 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f66745-fe05-40db-985f-877ea00d4efc None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:39:37.067419 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f1a510-0fe7-4c09-ae53-ff01a6cce87f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:39:37.068094 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1a510-0fe7-4c09-ae53-ff01a6cce87f service neutron] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:39:37.068467 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1a510-0fe7-4c09-ae53-ff01a6cce87f service neutron] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:39:37.068750 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1a510-0fe7-4c09-ae53-ff01a6cce87f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:39:37.070576 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-33f1a510-0fe7-4c09-ae53-ff01a6cce87f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:39:37.096877 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f1a510-0fe7-4c09-ae53-ff01a6cce87f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:39:37.098377 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f1a510-0fe7-4c09-ae53-ff01a6cce87f service neutron] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:39:37.111353 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1114/2224] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:39:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:39:45.405882 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=12 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:39:47.105432 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=9 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:39:49.472171 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aaa961-1b30-4e40-96b3-99234082f29b service swift] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:39:49.486130 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aaa961-1b30-4e40-96b3-99234082f29b service swift] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:39:49.491855 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810d576-0493-489f-867c-7a7f36775d20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:39:49.492642 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810d576-0493-489f-867c-7a7f36775d20 service nova] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:39:49.492924 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810d576-0493-489f-867c-7a7f36775d20 service nova] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:39:49.493201 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810d576-0493-489f-867c-7a7f36775d20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:39:49.495168 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-1810d576-0493-489f-867c-7a7f36775d20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:39:49.563414 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1810d576-0493-489f-867c-7a7f36775d20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:39:49.565038 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1810d576-0493-489f-867c-7a7f36775d20 service nova] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:39:49.574590 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1111/2225] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:39:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:39:51.902320 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f1a510-0fe7-4c09-ae53-ff01a6cce87f service neutron] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:39:51.912824 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f1a510-0fe7-4c09-ae53-ff01a6cce87f service neutron] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:39:51.916700 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cbca32-98ed-49a8-85f6-cfe471c0020b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6f97b803a28453c8b78fd8380ac64ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:39:51.917241 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cbca32-98ed-49a8-85f6-cfe471c0020b service glance] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:39:51.917524 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cbca32-98ed-49a8-85f6-cfe471c0020b service glance] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:39:51.917800 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cbca32-98ed-49a8-85f6-cfe471c0020b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:39:51.919695 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-00cbca32-98ed-49a8-85f6-cfe471c0020b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:39:51.984635 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cbca32-98ed-49a8-85f6-cfe471c0020b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:39:51.986005 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cbca32-98ed-49a8-85f6-cfe471c0020b service glance] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:39:51.996142 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1115/2226] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:39:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:39:59.570374 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=28 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:40:00.234760 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810d576-0493-489f-867c-7a7f36775d20 service nova] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:40:00.245004 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810d576-0493-489f-867c-7a7f36775d20 service nova] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:40:00.249060 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87554038-6349-4409-a728-91334dc19f30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:40:00.249721 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87554038-6349-4409-a728-91334dc19f30 service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:40:00.249994 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87554038-6349-4409-a728-91334dc19f30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:40:00.250456 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87554038-6349-4409-a728-91334dc19f30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:40:00.252348 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-87554038-6349-4409-a728-91334dc19f30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:40:00.262552 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87554038-6349-4409-a728-91334dc19f30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:40:00.263982 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87554038-6349-4409-a728-91334dc19f30 service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:40:00.272915 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1112/2227] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:40:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:40:01.991069 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=28 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:40:03.292003 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d94622-3f2c-4938-a58d-2e272d3a66f8 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:40:03.292737 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d94622-3f2c-4938-a58d-2e272d3a66f8 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:40:03.292737 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d94622-3f2c-4938-a58d-2e272d3a66f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:40:03.315832 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-80d94622-3f2c-4938-a58d-2e272d3a66f8 None None] MFA Rules not processed for user `8a959557b0064aff8e2308e842859481`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:40:03.315832 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-80d94622-3f2c-4938-a58d-2e272d3a66f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:40:03.319628 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1116/2228] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:40:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:40:03.742021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b005a-a5dc-41e5-b9f1-47b7badb1459 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:40:03.742530 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b005a-a5dc-41e5-b9f1-47b7badb1459 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:40:03.742639 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b005a-a5dc-41e5-b9f1-47b7badb1459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:40:03.760190 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-965b005a-a5dc-41e5-b9f1-47b7badb1459 None None] MFA Rules not processed for user `8f5d1f2327914f9fb070c6212582b6dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:40:03.761828 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-965b005a-a5dc-41e5-b9f1-47b7badb1459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:40:03.769414 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1113/2229] 10.222.0.62 () {58 vars in 967 bytes} [Mon Jun 27 09:40:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 09:40:03.794748 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d94622-3f2c-4938-a58d-2e272d3a66f8 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:40:03.807972 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d94622-3f2c-4938-a58d-2e272d3a66f8 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:40:03.813006 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f45b93-a2bf-46e7-ad5c-7aeb383299ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5477b14dae24fd3a644c9cbd6ff85ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:40:03.813648 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f45b93-a2bf-46e7-ad5c-7aeb383299ed service swift] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:40:03.814415 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f45b93-a2bf-46e7-ad5c-7aeb383299ed service swift] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:40:03.814697 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f45b93-a2bf-46e7-ad5c-7aeb383299ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:40:03.823622 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f45b93-a2bf-46e7-ad5c-7aeb383299ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:40:03.825273 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f45b93-a2bf-46e7-ad5c-7aeb383299ed service swift] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:40:03.834273 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1117/2230] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Jun 27 09:40:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 09:40:10.845026 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965b005a-a5dc-41e5-b9f1-47b7badb1459 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:40:10.859963 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965b005a-a5dc-41e5-b9f1-47b7badb1459 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:40:10.866262 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ada33-fee1-49ec-8a48-d1bbf4082d23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:40:10.866956 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ada33-fee1-49ec-8a48-d1bbf4082d23 service nova] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:40:10.867236 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ada33-fee1-49ec-8a48-d1bbf4082d23 service nova] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:40:10.867508 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ada33-fee1-49ec-8a48-d1bbf4082d23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:40:10.869527 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-6e7ada33-fee1-49ec-8a48-d1bbf4082d23 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:40:10.882856 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ada33-fee1-49ec-8a48-d1bbf4082d23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:40:10.884485 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ada33-fee1-49ec-8a48-d1bbf4082d23 service nova] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:40:10.896720 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1114/2231] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:40:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:40:13.831372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=9 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:40:19.535380 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f45b93-a2bf-46e7-ad5c-7aeb383299ed service swift] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:40:19.536860 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-f1f45b93-a2bf-46e7-ad5c-7aeb383299ed service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:40:19.555325 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f45b93-a2bf-46e7-ad5c-7aeb383299ed service swift] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:40:19.559905 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27332fb9-946d-40cf-80de-43b437428ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:40:19.560861 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27332fb9-946d-40cf-80de-43b437428ff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:40:19.561139 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27332fb9-946d-40cf-80de-43b437428ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:40:19.561410 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27332fb9-946d-40cf-80de-43b437428ff8 admin admin] PATH_INFO: `/v3/users/ab7398448109433c8d3839e0ffb747d3` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:40:19.562608 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27332fb9-946d-40cf-80de-43b437428ff8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab7398448109433c8d3839e0ffb747d3)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:40:19.564755 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27332fb9-946d-40cf-80de-43b437428ff8 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:40:19.747908 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8658f4-8f2b-4e03-8e18-17dcdaf51991 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:40:19.748588 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8658f4-8f2b-4e03-8e18-17dcdaf51991 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:40:19.748588 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8658f4-8f2b-4e03-8e18-17dcdaf51991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:40:19.760564 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-27332fb9-946d-40cf-80de-43b437428ff8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab7398448109433c8d3839e0ffb747d3'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:40:19.761385 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-27332fb9-946d-40cf-80de-43b437428ff8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab7398448109433c8d3839e0ffb747d3'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:40:19.766814 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-cb8658f4-8f2b-4e03-8e18-17dcdaf51991 None None] MFA Rules not processed for user `4c30a14c11d24ff3bd270c8e865a55d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:40:19.768022 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-cb8658f4-8f2b-4e03-8e18-17dcdaf51991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:40:19.775582 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1115/2232] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:40:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 09:40:19.847895 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-27332fb9-946d-40cf-80de-43b437428ff8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab7398448109433c8d3839e0ffb747d3'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:40:19.848807 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-27332fb9-946d-40cf-80de-43b437428ff8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab7398448109433c8d3839e0ffb747d3'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:40:19.857068 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-27332fb9-946d-40cf-80de-43b437428ff8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab7398448109433c8d3839e0ffb747d3'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:40:19.876216 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1118/2233] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:40:19 2022] DELETE /identity/v3/users/ab7398448109433c8d3839e0ffb747d3 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:40:20.091341 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8658f4-8f2b-4e03-8e18-17dcdaf51991 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:40:20.100911 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8658f4-8f2b-4e03-8e18-17dcdaf51991 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:40:20.118226 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27332fb9-946d-40cf-80de-43b437428ff8 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:40:20.119715 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-27332fb9-946d-40cf-80de-43b437428ff8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:40:20.161114 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a23cd7-31fc-4c2b-bf32-175f6c7945bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:40:20.161761 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a23cd7-31fc-4c2b-bf32-175f6c7945bb service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:40:20.162046 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a23cd7-31fc-4c2b-bf32-175f6c7945bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:40:20.162322 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a23cd7-31fc-4c2b-bf32-175f6c7945bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:40:20.164218 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-e6a23cd7-31fc-4c2b-bf32-175f6c7945bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:40:20.176749 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a23cd7-31fc-4c2b-bf32-175f6c7945bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:40:20.178194 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a23cd7-31fc-4c2b-bf32-175f6c7945bb service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:40:20.186475 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1116/2234] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:40:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:40:20.197995 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27332fb9-946d-40cf-80de-43b437428ff8 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:40:20.203035 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba40309d-8e7b-4bec-aecc-fe820ce6d009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:40:20.203951 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40309d-8e7b-4bec-aecc-fe820ce6d009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:40:20.204266 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40309d-8e7b-4bec-aecc-fe820ce6d009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:40:20.204541 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40309d-8e7b-4bec-aecc-fe820ce6d009 admin admin] PATH_INFO: `/v3/projects/3a25038bb95f486ea1a518d3379b989b` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:40:20.205911 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba40309d-8e7b-4bec-aecc-fe820ce6d009 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a25038bb95f486ea1a518d3379b989b)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:40:20.207996 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba40309d-8e7b-4bec-aecc-fe820ce6d009 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:40:20.327216 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-ba40309d-8e7b-4bec-aecc-fe820ce6d009 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a25038bb95f486ea1a518d3379b989b', 'request_id': 'req-ba40309d-8e7b-4bec-aecc-fe820ce6d009'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:40:20.596384 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-ba40309d-8e7b-4bec-aecc-fe820ce6d009 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a25038bb95f486ea1a518d3379b989b', 'request_id': 'req-ba40309d-8e7b-4bec-aecc-fe820ce6d009'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:40:20.603502 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-ba40309d-8e7b-4bec-aecc-fe820ce6d009 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a25038bb95f486ea1a518d3379b989b', 'request_id': 'req-ba40309d-8e7b-4bec-aecc-fe820ce6d009'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:40:20.614817 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-ba40309d-8e7b-4bec-aecc-fe820ce6d009 admin admin] The token cache is being invalidate because project 3a25038bb95f486ea1a518d3379b989b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:40:20.615098 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-ba40309d-8e7b-4bec-aecc-fe820ce6d009 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:40:20.615719 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-ba40309d-8e7b-4bec-aecc-fe820ce6d009 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:40:20.617295 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1119/2235] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:40:20 2022] DELETE /identity/v3/projects/3a25038bb95f486ea1a518d3379b989b => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:40:20.737691 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a23cd7-31fc-4c2b-bf32-175f6c7945bb service neutron] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:40:20.739767 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-e6a23cd7-31fc-4c2b-bf32-175f6c7945bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:40:20.826583 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a23cd7-31fc-4c2b-bf32-175f6c7945bb service neutron] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:40:20.885946 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eddbf1a-0f41-452a-9307-fe264f3229a6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbaf738138b40b2a06bb63934f6608c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:40:20.886585 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eddbf1a-0f41-452a-9307-fe264f3229a6 service placement] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:40:20.886867 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eddbf1a-0f41-452a-9307-fe264f3229a6 service placement] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:40:20.887143 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eddbf1a-0f41-452a-9307-fe264f3229a6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:40:20.889132 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-7eddbf1a-0f41-452a-9307-fe264f3229a6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:40:20.897898 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:40:20.900230 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eddbf1a-0f41-452a-9307-fe264f3229a6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:40:20.901842 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eddbf1a-0f41-452a-9307-fe264f3229a6 service placement] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:40:20.911697 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1117/2236] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:40:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:40:30.611766 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:40:30.933507 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=2 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:40:31.727780 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba40309d-8e7b-4bec-aecc-fe820ce6d009 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:40:31.732047 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-ba40309d-8e7b-4bec-aecc-fe820ce6d009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:40:31.804226 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba40309d-8e7b-4bec-aecc-fe820ce6d009 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:40:31.810241 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf00c2-6f34-432c-833a-8bf02daa18aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:40:31.810900 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf00c2-6f34-432c-833a-8bf02daa18aa service nova] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:40:31.811179 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf00c2-6f34-432c-833a-8bf02daa18aa service nova] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:40:31.811454 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf00c2-6f34-432c-833a-8bf02daa18aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:40:31.813318 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-a6bf00c2-6f34-432c-833a-8bf02daa18aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:40:31.827252 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bf00c2-6f34-432c-833a-8bf02daa18aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:40:31.832309 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bf00c2-6f34-432c-833a-8bf02daa18aa service nova] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:40:31.840972 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1120/2237] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:40:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:40:33.284343 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eddbf1a-0f41-452a-9307-fe264f3229a6 service placement] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:40:33.286260 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-7eddbf1a-0f41-452a-9307-fe264f3229a6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:40:33.358452 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eddbf1a-0f41-452a-9307-fe264f3229a6 service placement] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:40:33.363410 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb771c-4b1a-4c36-9587-e1fb23843bfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:40:33.364914 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb771c-4b1a-4c36-9587-e1fb23843bfd service cinder] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:40:33.365269 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb771c-4b1a-4c36-9587-e1fb23843bfd service cinder] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:40:33.365554 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb771c-4b1a-4c36-9587-e1fb23843bfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:40:33.367676 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-6ffb771c-4b1a-4c36-9587-e1fb23843bfd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:40:33.436854 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb771c-4b1a-4c36-9587-e1fb23843bfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:40:33.438580 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb771c-4b1a-4c36-9587-e1fb23843bfd service cinder] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:40:33.449216 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1118/2238] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:40:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:40:33.811842 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf00c2-6f34-432c-833a-8bf02daa18aa service nova] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:40:33.823739 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf00c2-6f34-432c-833a-8bf02daa18aa service nova] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:40:33.843477 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f2494-d929-4f47-af62-90525bd02e67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:40:33.844225 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f2494-d929-4f47-af62-90525bd02e67 service nova] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:40:33.844515 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f2494-d929-4f47-af62-90525bd02e67 service nova] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:40:33.846025 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f2494-d929-4f47-af62-90525bd02e67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:40:33.846716 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-682f2494-d929-4f47-af62-90525bd02e67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:40:33.865904 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f2494-d929-4f47-af62-90525bd02e67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:40:33.868177 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f2494-d929-4f47-af62-90525bd02e67 service nova] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:40:33.888390 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1121/2239] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:40:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:40:43.443916 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=48 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:40:43.866365 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0067b-abd6-4532-8eb8-0cf49397c873 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:40:43.866651 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0067b-abd6-4532-8eb8-0cf49397c873 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:40:43.866928 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0067b-abd6-4532-8eb8-0cf49397c873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:40:43.882457 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=40 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:40:43.885073 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-33d0067b-abd6-4532-8eb8-0cf49397c873 None None] MFA Rules not processed for user `d67234e9868b4d34a1532b1aedf33221`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:40:43.886308 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-33d0067b-abd6-4532-8eb8-0cf49397c873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:40:43.893377 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1119/2240] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:40:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:40:44.198760 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f2494-d929-4f47-af62-90525bd02e67 service nova] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:40:44.200181 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-682f2494-d929-4f47-af62-90525bd02e67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:40:44.255162 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f2494-d929-4f47-af62-90525bd02e67 service nova] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:40:44.259271 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6195e6-d00e-40da-adff-4775d2388072 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:40:44.259902 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6195e6-d00e-40da-adff-4775d2388072 service neutron] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:40:44.260179 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6195e6-d00e-40da-adff-4775d2388072 service neutron] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:40:44.260482 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6195e6-d00e-40da-adff-4775d2388072 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:40:44.262304 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-4c6195e6-d00e-40da-adff-4775d2388072 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:40:44.272520 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6195e6-d00e-40da-adff-4775d2388072 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:40:44.274585 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6195e6-d00e-40da-adff-4775d2388072 service neutron] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:40:44.286156 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1122/2241] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:40:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:40:44.482626 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6d148-104b-4f88-9fe2-a2da42dc47fb None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:40:44.483131 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6d148-104b-4f88-9fe2-a2da42dc47fb None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:40:44.483370 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6d148-104b-4f88-9fe2-a2da42dc47fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:40:44.501944 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-39c6d148-104b-4f88-9fe2-a2da42dc47fb None None] MFA Rules not processed for user `8f5d1f2327914f9fb070c6212582b6dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:40:44.503411 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-39c6d148-104b-4f88-9fe2-a2da42dc47fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:40:44.563040 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1120/2242] 10.222.0.62 () {58 vars in 967 bytes} [Mon Jun 27 09:40:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:40:44.575612 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6195e6-d00e-40da-adff-4775d2388072 service neutron] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:40:44.577057 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-4c6195e6-d00e-40da-adff-4775d2388072 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:40:44.650889 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6195e6-d00e-40da-adff-4775d2388072 service neutron] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:40:44.655112 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793793ce-bb82-4110-9d6c-64f505231fe3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5477b14dae24fd3a644c9cbd6ff85ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:40:44.655771 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793793ce-bb82-4110-9d6c-64f505231fe3 service swift] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:40:44.656176 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793793ce-bb82-4110-9d6c-64f505231fe3 service swift] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:40:44.656367 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793793ce-bb82-4110-9d6c-64f505231fe3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:40:44.666699 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793793ce-bb82-4110-9d6c-64f505231fe3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:40:44.668479 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793793ce-bb82-4110-9d6c-64f505231fe3 service swift] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:40:44.679430 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1123/2243] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Jun 27 09:40:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 09:40:54.555753 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=28 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:40:54.603678 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6d148-104b-4f88-9fe2-a2da42dc47fb None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:40:54.605163 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-39c6d148-104b-4f88-9fe2-a2da42dc47fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:40:54.673355 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6d148-104b-4f88-9fe2-a2da42dc47fb None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:40:54.675283 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=58 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:40:54.678247 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a9778-8afb-4ccc-9bf7-c82f34acbacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:40:54.679101 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a9778-8afb-4ccc-9bf7-c82f34acbacc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:40:54.679376 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a9778-8afb-4ccc-9bf7-c82f34acbacc admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:40:54.679648 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a9778-8afb-4ccc-9bf7-c82f34acbacc admin admin] PATH_INFO: `/v3/users/1d4e3faf5cb3420d94270c200b446419` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:40:54.681705 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a9778-8afb-4ccc-9bf7-c82f34acbacc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d4e3faf5cb3420d94270c200b446419)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:40:54.683598 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a9778-8afb-4ccc-9bf7-c82f34acbacc admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:40:54.878218 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-8f5a9778-8afb-4ccc-9bf7-c82f34acbacc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d4e3faf5cb3420d94270c200b446419'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:40:54.885476 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-8f5a9778-8afb-4ccc-9bf7-c82f34acbacc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d4e3faf5cb3420d94270c200b446419'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:40:54.955529 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-8f5a9778-8afb-4ccc-9bf7-c82f34acbacc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d4e3faf5cb3420d94270c200b446419'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:40:54.956154 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-8f5a9778-8afb-4ccc-9bf7-c82f34acbacc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d4e3faf5cb3420d94270c200b446419'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:40:54.969151 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-8f5a9778-8afb-4ccc-9bf7-c82f34acbacc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d4e3faf5cb3420d94270c200b446419'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:40:54.975089 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1121/2244] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:40:54 2022] DELETE /identity/v3/users/1d4e3faf5cb3420d94270c200b446419 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:40:55.237180 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793793ce-bb82-4110-9d6c-64f505231fe3 service swift] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:40:55.252710 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793793ce-bb82-4110-9d6c-64f505231fe3 service swift] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:40:55.330206 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cad4c8-4085-4b6f-b42d-29306f4ffb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:40:55.331103 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cad4c8-4085-4b6f-b42d-29306f4ffb8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:40:55.331384 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cad4c8-4085-4b6f-b42d-29306f4ffb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:40:55.331658 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cad4c8-4085-4b6f-b42d-29306f4ffb8f admin admin] PATH_INFO: `/v3/projects/f5c582ef3f51401194776ad3ef175c8d` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:40:55.332869 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cad4c8-4085-4b6f-b42d-29306f4ffb8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5c582ef3f51401194776ad3ef175c8d)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:40:55.334784 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cad4c8-4085-4b6f-b42d-29306f4ffb8f admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:40:55.446417 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-85cad4c8-4085-4b6f-b42d-29306f4ffb8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5c582ef3f51401194776ad3ef175c8d', 'request_id': 'req-85cad4c8-4085-4b6f-b42d-29306f4ffb8f'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:40:55.542984 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-85cad4c8-4085-4b6f-b42d-29306f4ffb8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5c582ef3f51401194776ad3ef175c8d', 'request_id': 'req-85cad4c8-4085-4b6f-b42d-29306f4ffb8f'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:40:55.549191 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-85cad4c8-4085-4b6f-b42d-29306f4ffb8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5c582ef3f51401194776ad3ef175c8d', 'request_id': 'req-85cad4c8-4085-4b6f-b42d-29306f4ffb8f'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:40:55.560276 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-85cad4c8-4085-4b6f-b42d-29306f4ffb8f admin admin] The token cache is being invalidate because project f5c582ef3f51401194776ad3ef175c8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:40:55.560571 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-85cad4c8-4085-4b6f-b42d-29306f4ffb8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:40:55.561265 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-85cad4c8-4085-4b6f-b42d-29306f4ffb8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:40:55.562894 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1124/2245] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:40:55 2022] DELETE /identity/v3/projects/f5c582ef3f51401194776ad3ef175c8d => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:40:55.572754 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a9778-8afb-4ccc-9bf7-c82f34acbacc admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:40:55.574257 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-8f5a9778-8afb-4ccc-9bf7-c82f34acbacc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:40:55.587882 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a9778-8afb-4ccc-9bf7-c82f34acbacc admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:40:55.645947 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10350a1-6d36-430e-974b-16e11e03bd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:40:55.646824 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10350a1-6d36-430e-974b-16e11e03bd3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:40:55.647108 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10350a1-6d36-430e-974b-16e11e03bd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:40:55.647383 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10350a1-6d36-430e-974b-16e11e03bd3e admin admin] PATH_INFO: `/v3/users/dbb22a58e1374b6facc64673cc1986c3` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:40:55.649131 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10350a1-6d36-430e-974b-16e11e03bd3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbb22a58e1374b6facc64673cc1986c3)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:40:55.651131 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10350a1-6d36-430e-974b-16e11e03bd3e admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:40:55.674235 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:40:55.903069 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-c10350a1-6d36-430e-974b-16e11e03bd3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbb22a58e1374b6facc64673cc1986c3'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:40:55.910096 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-c10350a1-6d36-430e-974b-16e11e03bd3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbb22a58e1374b6facc64673cc1986c3'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:40:56.007408 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-c10350a1-6d36-430e-974b-16e11e03bd3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbb22a58e1374b6facc64673cc1986c3'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:40:56.008081 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-c10350a1-6d36-430e-974b-16e11e03bd3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbb22a58e1374b6facc64673cc1986c3'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:40:56.023311 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-c10350a1-6d36-430e-974b-16e11e03bd3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbb22a58e1374b6facc64673cc1986c3'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:40:56.029661 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1122/2246] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:40:55 2022] DELETE /identity/v3/users/dbb22a58e1374b6facc64673cc1986c3 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:40:56.306041 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cad4c8-4085-4b6f-b42d-29306f4ffb8f admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:40:56.307649 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-85cad4c8-4085-4b6f-b42d-29306f4ffb8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:40:56.321420 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cad4c8-4085-4b6f-b42d-29306f4ffb8f admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:40:56.385322 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f7420b-1397-4136-99d9-27a032a742aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:40:56.386190 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7420b-1397-4136-99d9-27a032a742aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:40:56.386475 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7420b-1397-4136-99d9-27a032a742aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:40:56.386747 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7420b-1397-4136-99d9-27a032a742aa admin admin] PATH_INFO: `/v3/projects/708523e470d446668cc7086b524ccf0d` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:40:56.388059 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f7420b-1397-4136-99d9-27a032a742aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=708523e470d446668cc7086b524ccf0d)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:40:56.390079 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f7420b-1397-4136-99d9-27a032a742aa admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:40:56.493726 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:40:56.505611 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-f4f7420b-1397-4136-99d9-27a032a742aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '708523e470d446668cc7086b524ccf0d', 'request_id': 'req-f4f7420b-1397-4136-99d9-27a032a742aa'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:40:56.583960 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-f4f7420b-1397-4136-99d9-27a032a742aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '708523e470d446668cc7086b524ccf0d', 'request_id': 'req-f4f7420b-1397-4136-99d9-27a032a742aa'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:40:56.590678 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-f4f7420b-1397-4136-99d9-27a032a742aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '708523e470d446668cc7086b524ccf0d', 'request_id': 'req-f4f7420b-1397-4136-99d9-27a032a742aa'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:40:56.603042 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-f4f7420b-1397-4136-99d9-27a032a742aa admin admin] The token cache is being invalidate because project 708523e470d446668cc7086b524ccf0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:40:56.603330 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-f4f7420b-1397-4136-99d9-27a032a742aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:40:56.603992 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-f4f7420b-1397-4136-99d9-27a032a742aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:40:56.605611 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1125/2247] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:40:56 2022] DELETE /identity/v3/projects/708523e470d446668cc7086b524ccf0d => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:41:06.412583 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:41:06.709566 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:41:07.218378 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10350a1-6d36-430e-974b-16e11e03bd3e admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:07.219823 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-c10350a1-6d36-430e-974b-16e11e03bd3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:41:07.297810 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10350a1-6d36-430e-974b-16e11e03bd3e admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:07.361092 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef715966-aa61-40da-923c-f3eb3ff1803a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:07.361744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef715966-aa61-40da-923c-f3eb3ff1803a service nova] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:07.362030 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef715966-aa61-40da-923c-f3eb3ff1803a service nova] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:07.362310 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef715966-aa61-40da-923c-f3eb3ff1803a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:07.364120 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-ef715966-aa61-40da-923c-f3eb3ff1803a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:41:07.425520 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef715966-aa61-40da-923c-f3eb3ff1803a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:07.426443 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef715966-aa61-40da-923c-f3eb3ff1803a service nova] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:07.436036 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1123/2248] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:41:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:41:17.430930 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=84 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:41:19.260029 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e1a4c-74d7-4ec9-9a09-df1023323269 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:19.260615 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e1a4c-74d7-4ec9-9a09-df1023323269 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:19.260615 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e1a4c-74d7-4ec9-9a09-df1023323269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:19.279465 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-bb1e1a4c-74d7-4ec9-9a09-df1023323269 None None] MFA Rules not processed for user `2def17c362a347c2baf8b42ceb0383f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:41:19.280748 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-bb1e1a4c-74d7-4ec9-9a09-df1023323269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:41:19.288134 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1126/2249] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:41:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:41:29.273650 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=3 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:41:34.092064 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef715966-aa61-40da-923c-f3eb3ff1803a service nova] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:34.093604 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-ef715966-aa61-40da-923c-f3eb3ff1803a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:41:34.177964 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef715966-aa61-40da-923c-f3eb3ff1803a service nova] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:34.182931 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359ab7d-0466-4658-8966-4629d0bea60e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:34.183579 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359ab7d-0466-4658-8966-4629d0bea60e service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:34.183942 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359ab7d-0466-4658-8966-4629d0bea60e service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:34.184245 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359ab7d-0466-4658-8966-4629d0bea60e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:34.186545 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-3359ab7d-0466-4658-8966-4629d0bea60e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:41:34.255888 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3359ab7d-0466-4658-8966-4629d0bea60e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:34.257423 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3359ab7d-0466-4658-8966-4629d0bea60e service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:34.268034 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1124/2250] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:41:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 09:41:38.710994 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e1a4c-74d7-4ec9-9a09-df1023323269 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:38.712743 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-bb1e1a4c-74d7-4ec9-9a09-df1023323269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:41:38.785947 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e1a4c-74d7-4ec9-9a09-df1023323269 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:38.791175 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf42483-c0c3-4f9a-bc69-bb4f09591f3e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbaf738138b40b2a06bb63934f6608c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:38.791877 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf42483-c0c3-4f9a-bc69-bb4f09591f3e service placement] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:38.792104 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf42483-c0c3-4f9a-bc69-bb4f09591f3e service placement] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:38.792433 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf42483-c0c3-4f9a-bc69-bb4f09591f3e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:38.794284 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-3bf42483-c0c3-4f9a-bc69-bb4f09591f3e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:41:38.807360 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf42483-c0c3-4f9a-bc69-bb4f09591f3e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:38.808379 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359ab7d-0466-4658-8966-4629d0bea60e service neutron] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:38.809270 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf42483-c0c3-4f9a-bc69-bb4f09591f3e service placement] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:38.810315 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-3359ab7d-0466-4658-8966-4629d0bea60e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:41:38.819987 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1127/2251] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:41:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:41:38.826838 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359ab7d-0466-4658-8966-4629d0bea60e service neutron] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:38.831599 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5c574-2e22-4840-b47b-df72c6886bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:38.832504 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5c574-2e22-4840-b47b-df72c6886bd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:38.832837 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5c574-2e22-4840-b47b-df72c6886bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:38.833060 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5c574-2e22-4840-b47b-df72c6886bd9 admin admin] PATH_INFO: `/v3/users/8a959557b0064aff8e2308e842859481` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:38.834641 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5c574-2e22-4840-b47b-df72c6886bd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a959557b0064aff8e2308e842859481)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:38.836606 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5c574-2e22-4840-b47b-df72c6886bd9 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:39.001886 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-1eb5c574-2e22-4840-b47b-df72c6886bd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a959557b0064aff8e2308e842859481'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:39.008742 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-1eb5c574-2e22-4840-b47b-df72c6886bd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a959557b0064aff8e2308e842859481'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:39.091019 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-1eb5c574-2e22-4840-b47b-df72c6886bd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a959557b0064aff8e2308e842859481'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:39.091562 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-1eb5c574-2e22-4840-b47b-df72c6886bd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a959557b0064aff8e2308e842859481'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:39.104620 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-1eb5c574-2e22-4840-b47b-df72c6886bd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a959557b0064aff8e2308e842859481'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:39.111256 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1125/2252] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:41:38 2022] DELETE /identity/v3/users/8a959557b0064aff8e2308e842859481 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:41:39.349049 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf42483-c0c3-4f9a-bc69-bb4f09591f3e service placement] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:39.361613 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf42483-c0c3-4f9a-bc69-bb4f09591f3e service placement] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:39.423054 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0b3d6-95d2-44c3-926d-94d4a2762a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:39.423944 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0b3d6-95d2-44c3-926d-94d4a2762a28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:39.424271 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0b3d6-95d2-44c3-926d-94d4a2762a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:39.424528 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0b3d6-95d2-44c3-926d-94d4a2762a28 admin admin] PATH_INFO: `/v3/projects/8a4172de74f54f9fa1b4a2d24908de24` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:39.425770 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0b3d6-95d2-44c3-926d-94d4a2762a28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a4172de74f54f9fa1b4a2d24908de24)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:39.427720 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0b3d6-95d2-44c3-926d-94d4a2762a28 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:39.572143 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-bda0b3d6-95d2-44c3-926d-94d4a2762a28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a4172de74f54f9fa1b4a2d24908de24', 'request_id': 'req-bda0b3d6-95d2-44c3-926d-94d4a2762a28'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:39.651358 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-bda0b3d6-95d2-44c3-926d-94d4a2762a28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a4172de74f54f9fa1b4a2d24908de24', 'request_id': 'req-bda0b3d6-95d2-44c3-926d-94d4a2762a28'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:39.657563 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-bda0b3d6-95d2-44c3-926d-94d4a2762a28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a4172de74f54f9fa1b4a2d24908de24', 'request_id': 'req-bda0b3d6-95d2-44c3-926d-94d4a2762a28'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:39.669262 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-bda0b3d6-95d2-44c3-926d-94d4a2762a28 admin admin] The token cache is being invalidate because project 8a4172de74f54f9fa1b4a2d24908de24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:41:39.669542 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-bda0b3d6-95d2-44c3-926d-94d4a2762a28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:39.673233 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-bda0b3d6-95d2-44c3-926d-94d4a2762a28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:39.673233 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1128/2253] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:41:39 2022] DELETE /identity/v3/projects/8a4172de74f54f9fa1b4a2d24908de24 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:41:39.676591 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe984c98-e088-423c-9c07-899c6fadac1f None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:39.676879 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe984c98-e088-423c-9c07-899c6fadac1f None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:39.677149 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe984c98-e088-423c-9c07-899c6fadac1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:39.695718 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-fe984c98-e088-423c-9c07-899c6fadac1f None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:41:39.696962 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-fe984c98-e088-423c-9c07-899c6fadac1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:41:39.714181 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:41:39.765107 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1126/2254] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:41:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:41:39.767024 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b185cef-473d-46db-bd44-a938604d9ae2 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:39.767521 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b185cef-473d-46db-bd44-a938604d9ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:39.767622 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b185cef-473d-46db-bd44-a938604d9ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:39.786444 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-6b185cef-473d-46db-bd44-a938604d9ae2 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:41:39.787655 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-6b185cef-473d-46db-bd44-a938604d9ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:41:39.796188 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1129/2255] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:41:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:41:39.800491 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe984c98-e088-423c-9c07-899c6fadac1f None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:39.810584 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe984c98-e088-423c-9c07-899c6fadac1f None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:39.816081 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee54617d-95a8-48c3-946f-c2721eaaf25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:39.816769 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54617d-95a8-48c3-946f-c2721eaaf25c admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:39.817055 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54617d-95a8-48c3-946f-c2721eaaf25c admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:39.817335 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54617d-95a8-48c3-946f-c2721eaaf25c admin admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:39.818063 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee54617d-95a8-48c3-946f-c2721eaaf25c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:41:39.818374 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee54617d-95a8-48c3-946f-c2721eaaf25c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:39.819974 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee54617d-95a8-48c3-946f-c2721eaaf25c admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:39.831791 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1127/2256] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:41:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:41:39.836268 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b185cef-473d-46db-bd44-a938604d9ae2 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:39.846214 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b185cef-473d-46db-bd44-a938604d9ae2 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:39.851061 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba8f9b-456c-401e-96d8-7f8ceba95a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:39.851728 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba8f9b-456c-401e-96d8-7f8ceba95a14 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:39.852007 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba8f9b-456c-401e-96d8-7f8ceba95a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:39.852308 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba8f9b-456c-401e-96d8-7f8ceba95a14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:39.853012 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdba8f9b-456c-401e-96d8-7f8ceba95a14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:39.855496 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdba8f9b-456c-401e-96d8-7f8ceba95a14 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:39.866121 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:41:39.962084 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1130/2257] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:41:39 2022] POST /identity/v3/projects => generated 363 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:41:39.966478 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee54617d-95a8-48c3-946f-c2721eaaf25c admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:39.977471 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee54617d-95a8-48c3-946f-c2721eaaf25c admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:40.044683 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dbc4b8-69e5-4234-bd5d-c1565f95ea4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:40.045353 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dbc4b8-69e5-4234-bd5d-c1565f95ea4c admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:40.045627 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dbc4b8-69e5-4234-bd5d-c1565f95ea4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:40.045899 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dbc4b8-69e5-4234-bd5d-c1565f95ea4c admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:40.046594 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dbc4b8-69e5-4234-bd5d-c1565f95ea4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:40.048516 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dbc4b8-69e5-4234-bd5d-c1565f95ea4c admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:40.155237 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1128/2258] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:41:39 2022] POST /identity/v3/users => generated 282 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:41:40.159394 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba8f9b-456c-401e-96d8-7f8ceba95a14 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:40.169793 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba8f9b-456c-401e-96d8-7f8ceba95a14 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:40.174763 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9c062-6606-4abe-9a0b-92c3e3004a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:40.175419 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9c062-6606-4abe-9a0b-92c3e3004a70 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:40.175709 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9c062-6606-4abe-9a0b-92c3e3004a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:40.176689 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9c062-6606-4abe-9a0b-92c3e3004a70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:40.176882 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c9c062-6606-4abe-9a0b-92c3e3004a70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:40.178522 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c9c062-6606-4abe-9a0b-92c3e3004a70 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:40.188794 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1131/2259] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:41:40.192869 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dbc4b8-69e5-4234-bd5d-c1565f95ea4c admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:40.203393 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dbc4b8-69e5-4234-bd5d-c1565f95ea4c admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:40.207967 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2fdb16-b944-4ef6-ba8c-61d31408d2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:40.208659 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fdb16-b944-4ef6-ba8c-61d31408d2b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:40.208942 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fdb16-b944-4ef6-ba8c-61d31408d2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:40.209218 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fdb16-b944-4ef6-ba8c-61d31408d2b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:40.209939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2fdb16-b944-4ef6-ba8c-61d31408d2b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:40.211530 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2fdb16-b944-4ef6-ba8c-61d31408d2b0 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:40.222452 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1129/2260] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:41:40.226849 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9c062-6606-4abe-9a0b-92c3e3004a70 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:40.237096 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9c062-6606-4abe-9a0b-92c3e3004a70 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:40.241697 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4efe2-9c5f-4f65-9876-42b7e02e8049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:40.242571 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4efe2-9c5f-4f65-9876-42b7e02e8049 admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:40.242848 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4efe2-9c5f-4f65-9876-42b7e02e8049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:40.243125 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4efe2-9c5f-4f65-9876-42b7e02e8049 admin admin] PATH_INFO: `/v3/projects/d8633931a16b447888ff813b6fbd110a/users/fbe52810cd624d48be53c1c865ab4e93/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:40.257638 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f4efe2-9c5f-4f65-9876-42b7e02e8049 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8633931a16b447888ff813b6fbd110a, user_id=fbe52810cd624d48be53c1c865ab4e93, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:40.260831 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f4efe2-9c5f-4f65-9876-42b7e02e8049 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:40.354756 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1132/2261] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:41:40 2022] PUT /identity/v3/projects/d8633931a16b447888ff813b6fbd110a/users/fbe52810cd624d48be53c1c865ab4e93/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:41:40.366401 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5b26a-acae-49be-aacb-fcdcdcfec196 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:40.366807 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5b26a-acae-49be-aacb-fcdcdcfec196 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:40.371322 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5b26a-acae-49be-aacb-fcdcdcfec196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:40.394160 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-fbf5b26a-acae-49be-aacb-fcdcdcfec196 None None] MFA Rules not processed for user `fbe52810cd624d48be53c1c865ab4e93`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:41:40.395366 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-fbf5b26a-acae-49be-aacb-fcdcdcfec196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:41:40.461103 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1130/2262] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:41:40 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:41:40.465506 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4efe2-9c5f-4f65-9876-42b7e02e8049 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:40.527099 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4efe2-9c5f-4f65-9876-42b7e02e8049 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:40.531821 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b4bb6-89e4-4abd-b6d1-7463738b5f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:40.532506 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b4bb6-89e4-4abd-b6d1-7463738b5f42 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:40.532792 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b4bb6-89e4-4abd-b6d1-7463738b5f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:40.533067 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b4bb6-89e4-4abd-b6d1-7463738b5f42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:40.533768 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b4bb6-89e4-4abd-b6d1-7463738b5f42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:40.535763 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b4bb6-89e4-4abd-b6d1-7463738b5f42 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:40.618416 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1133/2263] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:41:40 2022] POST /identity/v3/projects => generated 363 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 09:41:40.622758 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5b26a-acae-49be-aacb-fcdcdcfec196 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:40.633369 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5b26a-acae-49be-aacb-fcdcdcfec196 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:40.646476 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:41:40.690687 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921eacd-cbf2-4fcb-ac7b-d2be0f8a14af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:40.691591 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921eacd-cbf2-4fcb-ac7b-d2be0f8a14af admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:40.691869 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921eacd-cbf2-4fcb-ac7b-d2be0f8a14af admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:40.692154 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921eacd-cbf2-4fcb-ac7b-d2be0f8a14af admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:40.696385 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921eacd-cbf2-4fcb-ac7b-d2be0f8a14af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:40.696385 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921eacd-cbf2-4fcb-ac7b-d2be0f8a14af admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:40.782727 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1131/2264] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:41:40 2022] POST /identity/v3/users => generated 288 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:41:40.786825 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b4bb6-89e4-4abd-b6d1-7463738b5f42 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:40.798357 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b4bb6-89e4-4abd-b6d1-7463738b5f42 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:40.803079 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74351535-051c-4008-8dda-8a194fbb5333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:40.803730 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74351535-051c-4008-8dda-8a194fbb5333 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:40.804008 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74351535-051c-4008-8dda-8a194fbb5333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:40.804320 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74351535-051c-4008-8dda-8a194fbb5333 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:40.805044 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74351535-051c-4008-8dda-8a194fbb5333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:40.806632 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74351535-051c-4008-8dda-8a194fbb5333 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:40.818183 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1134/2265] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:41:40.822476 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921eacd-cbf2-4fcb-ac7b-d2be0f8a14af admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:40.832580 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921eacd-cbf2-4fcb-ac7b-d2be0f8a14af admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:40.837461 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18d171-bfd2-4728-a5ab-bdb9e68e530d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:40.839528 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18d171-bfd2-4728-a5ab-bdb9e68e530d admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:40.839528 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18d171-bfd2-4728-a5ab-bdb9e68e530d admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:40.839528 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18d171-bfd2-4728-a5ab-bdb9e68e530d admin admin] PATH_INFO: `/v3/projects/ee13f3ae4b854f1bb19b09406ce2f9c6/users/c63cabe74eb148c798ad6aed52f893f6/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:40.854542 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18d171-bfd2-4728-a5ab-bdb9e68e530d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee13f3ae4b854f1bb19b09406ce2f9c6, user_id=c63cabe74eb148c798ad6aed52f893f6, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:40.857609 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18d171-bfd2-4728-a5ab-bdb9e68e530d admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:40.966453 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1132/2266] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:41:40 2022] PUT /identity/v3/projects/ee13f3ae4b854f1bb19b09406ce2f9c6/users/c63cabe74eb148c798ad6aed52f893f6/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:41:40.970460 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74351535-051c-4008-8dda-8a194fbb5333 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:40.982098 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74351535-051c-4008-8dda-8a194fbb5333 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:41.042723 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007c474-742e-4ceb-8a88-7728f1edd97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:41.043315 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007c474-742e-4ceb-8a88-7728f1edd97c admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:41.043600 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007c474-742e-4ceb-8a88-7728f1edd97c admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:41.043879 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007c474-742e-4ceb-8a88-7728f1edd97c admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:41.044649 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d007c474-742e-4ceb-8a88-7728f1edd97c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:41.046249 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d007c474-742e-4ceb-8a88-7728f1edd97c admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:41.057823 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1135/2267] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:41:41.063936 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18d171-bfd2-4728-a5ab-bdb9e68e530d admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:41.076754 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18d171-bfd2-4728-a5ab-bdb9e68e530d admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:41.087888 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793b7ea-4ed5-409e-b22b-2e291aa193fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:41.089100 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793b7ea-4ed5-409e-b22b-2e291aa193fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:41.089380 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793b7ea-4ed5-409e-b22b-2e291aa193fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:41.089649 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793b7ea-4ed5-409e-b22b-2e291aa193fe admin admin] PATH_INFO: `/v3/projects/ee13f3ae4b854f1bb19b09406ce2f9c6/users/c63cabe74eb148c798ad6aed52f893f6/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:41.091622 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793b7ea-4ed5-409e-b22b-2e291aa193fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee13f3ae4b854f1bb19b09406ce2f9c6, user_id=c63cabe74eb148c798ad6aed52f893f6, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:41.094277 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793b7ea-4ed5-409e-b22b-2e291aa193fe admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:41.106109 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1133/2268] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:41:41 2022] PUT /identity/v3/projects/ee13f3ae4b854f1bb19b09406ce2f9c6/users/c63cabe74eb148c798ad6aed52f893f6/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:41:41.116419 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65619571-adea-45b9-ab4e-ac5bb0b1452d None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:41.116716 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65619571-adea-45b9-ab4e-ac5bb0b1452d None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:41.116993 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65619571-adea-45b9-ab4e-ac5bb0b1452d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:41.143428 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-65619571-adea-45b9-ab4e-ac5bb0b1452d None None] MFA Rules not processed for user `c63cabe74eb148c798ad6aed52f893f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:41:41.144756 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-65619571-adea-45b9-ab4e-ac5bb0b1452d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:41:41.149844 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:41:41.215008 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1136/2269] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:41:41 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:41:41.226549 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793b7ea-4ed5-409e-b22b-2e291aa193fe admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:41.228305 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-c793b7ea-4ed5-409e-b22b-2e291aa193fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:41:41.284957 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793b7ea-4ed5-409e-b22b-2e291aa193fe admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:41.288572 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac108c93-f34f-475b-b2e2-37495192ee8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:41.289203 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac108c93-f34f-475b-b2e2-37495192ee8b service cinder] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:41.289483 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac108c93-f34f-475b-b2e2-37495192ee8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:41.289755 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac108c93-f34f-475b-b2e2-37495192ee8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:41.299347 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac108c93-f34f-475b-b2e2-37495192ee8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:41.300737 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac108c93-f34f-475b-b2e2-37495192ee8b service cinder] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:41.310081 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1134/2270] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:41:41 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:41:41.503913 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65619571-adea-45b9-ab4e-ac5bb0b1452d None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:41.513654 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65619571-adea-45b9-ab4e-ac5bb0b1452d None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:41.517396 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664c3ea-1a00-4af1-b692-1fb26e1278d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:41.518035 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664c3ea-1a00-4af1-b692-1fb26e1278d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:41.518317 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664c3ea-1a00-4af1-b692-1fb26e1278d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:41.518876 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664c3ea-1a00-4af1-b692-1fb26e1278d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:41.577721 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d664c3ea-1a00-4af1-b692-1fb26e1278d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:41.579500 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d664c3ea-1a00-4af1-b692-1fb26e1278d4 service cinder] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:41.589552 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1137/2271] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:41:41 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:41:45.116176 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac108c93-f34f-475b-b2e2-37495192ee8b service cinder] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:45.179147 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac108c93-f34f-475b-b2e2-37495192ee8b service cinder] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:45.184488 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3dd750-4d42-4534-bf68-abe2de273ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:45.185359 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3dd750-4d42-4534-bf68-abe2de273ab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:45.185639 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3dd750-4d42-4534-bf68-abe2de273ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:45.185931 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3dd750-4d42-4534-bf68-abe2de273ab3 admin admin] PATH_INFO: `/v3/users/fbe52810cd624d48be53c1c865ab4e93` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:45.187202 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3dd750-4d42-4534-bf68-abe2de273ab3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbe52810cd624d48be53c1c865ab4e93)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:45.189179 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3dd750-4d42-4534-bf68-abe2de273ab3 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:45.203887 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:41:45.315355 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-ef3dd750-4d42-4534-bf68-abe2de273ab3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbe52810cd624d48be53c1c865ab4e93'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:45.322063 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-ef3dd750-4d42-4534-bf68-abe2de273ab3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbe52810cd624d48be53c1c865ab4e93'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:45.417027 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-ef3dd750-4d42-4534-bf68-abe2de273ab3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbe52810cd624d48be53c1c865ab4e93'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:45.417757 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-ef3dd750-4d42-4534-bf68-abe2de273ab3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbe52810cd624d48be53c1c865ab4e93'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:45.430758 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-ef3dd750-4d42-4534-bf68-abe2de273ab3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbe52810cd624d48be53c1c865ab4e93'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:45.436838 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1135/2272] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:41:45 2022] DELETE /identity/v3/users/fbe52810cd624d48be53c1c865ab4e93 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:41:45.441466 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92c926-778a-43b0-96e3-8ff7ce09b825 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:45.441953 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92c926-778a-43b0-96e3-8ff7ce09b825 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:45.442061 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92c926-778a-43b0-96e3-8ff7ce09b825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:45.460215 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-da92c926-778a-43b0-96e3-8ff7ce09b825 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:41:45.461469 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-da92c926-778a-43b0-96e3-8ff7ce09b825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:41:45.519718 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1138/2273] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:41:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:41:45.530170 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3dd750-4d42-4534-bf68-abe2de273ab3 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:45.531570 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-ef3dd750-4d42-4534-bf68-abe2de273ab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:41:45.594179 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3dd750-4d42-4534-bf68-abe2de273ab3 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:45.597990 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1026188d-8a6b-4728-80cb-829cac39c4c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:45.598633 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026188d-8a6b-4728-80cb-829cac39c4c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:45.598922 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026188d-8a6b-4728-80cb-829cac39c4c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:45.599227 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026188d-8a6b-4728-80cb-829cac39c4c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:45.609233 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1026188d-8a6b-4728-80cb-829cac39c4c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:45.610718 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1026188d-8a6b-4728-80cb-829cac39c4c2 service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:45.621712 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1136/2274] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:41:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:41:46.035272 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92c926-778a-43b0-96e3-8ff7ce09b825 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:46.036811 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-da92c926-778a-43b0-96e3-8ff7ce09b825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:41:46.050170 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92c926-778a-43b0-96e3-8ff7ce09b825 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:46.055029 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2eadf6-8f7e-466e-abd7-210a880bf062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:46.055914 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2eadf6-8f7e-466e-abd7-210a880bf062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:46.056216 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2eadf6-8f7e-466e-abd7-210a880bf062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:46.056507 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2eadf6-8f7e-466e-abd7-210a880bf062 admin admin] PATH_INFO: `/v3/projects/d8633931a16b447888ff813b6fbd110a` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:46.058298 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2eadf6-8f7e-466e-abd7-210a880bf062 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8633931a16b447888ff813b6fbd110a)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:46.060256 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2eadf6-8f7e-466e-abd7-210a880bf062 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:46.169525 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:41:46.178117 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-bb2eadf6-8f7e-466e-abd7-210a880bf062 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8633931a16b447888ff813b6fbd110a', 'request_id': 'req-bb2eadf6-8f7e-466e-abd7-210a880bf062'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:46.239042 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-bb2eadf6-8f7e-466e-abd7-210a880bf062 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8633931a16b447888ff813b6fbd110a', 'request_id': 'req-bb2eadf6-8f7e-466e-abd7-210a880bf062'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:46.246938 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-bb2eadf6-8f7e-466e-abd7-210a880bf062 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8633931a16b447888ff813b6fbd110a', 'request_id': 'req-bb2eadf6-8f7e-466e-abd7-210a880bf062'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:46.258359 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-bb2eadf6-8f7e-466e-abd7-210a880bf062 admin admin] The token cache is being invalidate because project d8633931a16b447888ff813b6fbd110a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:41:46.263873 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-bb2eadf6-8f7e-466e-abd7-210a880bf062 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:46.263873 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-bb2eadf6-8f7e-466e-abd7-210a880bf062 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:46.263873 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1139/2275] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:41:46 2022] DELETE /identity/v3/projects/d8633931a16b447888ff813b6fbd110a => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:41:46.265026 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1026188d-8a6b-4728-80cb-829cac39c4c2 service neutron] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:46.275168 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1026188d-8a6b-4728-80cb-829cac39c4c2 service neutron] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:46.334234 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf91fd4-955b-4f1e-b24d-c712916dd3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:46.335141 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf91fd4-955b-4f1e-b24d-c712916dd3fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:46.335424 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf91fd4-955b-4f1e-b24d-c712916dd3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:46.335702 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf91fd4-955b-4f1e-b24d-c712916dd3fc admin admin] PATH_INFO: `/v3/users/c63cabe74eb148c798ad6aed52f893f6` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:46.337019 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf91fd4-955b-4f1e-b24d-c712916dd3fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c63cabe74eb148c798ad6aed52f893f6)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:46.341399 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf91fd4-955b-4f1e-b24d-c712916dd3fc admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:46.570747 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:41:46.578690 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-bdf91fd4-955b-4f1e-b24d-c712916dd3fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c63cabe74eb148c798ad6aed52f893f6'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:46.585683 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-bdf91fd4-955b-4f1e-b24d-c712916dd3fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c63cabe74eb148c798ad6aed52f893f6'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:46.656496 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-bdf91fd4-955b-4f1e-b24d-c712916dd3fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c63cabe74eb148c798ad6aed52f893f6'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:46.657112 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-bdf91fd4-955b-4f1e-b24d-c712916dd3fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c63cabe74eb148c798ad6aed52f893f6'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:46.671092 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-bdf91fd4-955b-4f1e-b24d-c712916dd3fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c63cabe74eb148c798ad6aed52f893f6'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:46.676967 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1137/2276] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:41:46 2022] DELETE /identity/v3/users/c63cabe74eb148c798ad6aed52f893f6 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:41:47.110958 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2eadf6-8f7e-466e-abd7-210a880bf062 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:47.113587 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-bb2eadf6-8f7e-466e-abd7-210a880bf062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:41:47.130802 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2eadf6-8f7e-466e-abd7-210a880bf062 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:47.195299 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f2d6a-f75c-45e5-aebb-e9aa0f438603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:47.196168 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f2d6a-f75c-45e5-aebb-e9aa0f438603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:47.196478 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f2d6a-f75c-45e5-aebb-e9aa0f438603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:47.196756 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f2d6a-f75c-45e5-aebb-e9aa0f438603 admin admin] PATH_INFO: `/v3/projects/ee13f3ae4b854f1bb19b09406ce2f9c6` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:47.198678 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30f2d6a-f75c-45e5-aebb-e9aa0f438603 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee13f3ae4b854f1bb19b09406ce2f9c6)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:47.200671 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30f2d6a-f75c-45e5-aebb-e9aa0f438603 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:47.278774 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-f30f2d6a-f75c-45e5-aebb-e9aa0f438603 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee13f3ae4b854f1bb19b09406ce2f9c6', 'request_id': 'req-f30f2d6a-f75c-45e5-aebb-e9aa0f438603'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:47.330587 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-f30f2d6a-f75c-45e5-aebb-e9aa0f438603 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee13f3ae4b854f1bb19b09406ce2f9c6', 'request_id': 'req-f30f2d6a-f75c-45e5-aebb-e9aa0f438603'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:47.336415 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-f30f2d6a-f75c-45e5-aebb-e9aa0f438603 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee13f3ae4b854f1bb19b09406ce2f9c6', 'request_id': 'req-f30f2d6a-f75c-45e5-aebb-e9aa0f438603'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:47.347441 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-f30f2d6a-f75c-45e5-aebb-e9aa0f438603 admin admin] The token cache is being invalidate because project ee13f3ae4b854f1bb19b09406ce2f9c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:41:47.347720 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-f30f2d6a-f75c-45e5-aebb-e9aa0f438603 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:47.348372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-f30f2d6a-f75c-45e5-aebb-e9aa0f438603 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:47.349892 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1140/2277] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:41:47 2022] DELETE /identity/v3/projects/ee13f3ae4b854f1bb19b09406ce2f9c6 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:41:47.354972 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7d8c0-3f7d-433f-b894-371f5140624f None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:47.355436 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7d8c0-3f7d-433f-b894-371f5140624f None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:47.355544 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7d8c0-3f7d-433f-b894-371f5140624f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:47.375656 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-33e7d8c0-3f7d-433f-b894-371f5140624f None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:41:47.376831 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-33e7d8c0-3f7d-433f-b894-371f5140624f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:41:47.436307 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1138/2278] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:41:47.444330 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307dc44e-ff87-416f-a00f-23a4ddabbd96 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:47.444623 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307dc44e-ff87-416f-a00f-23a4ddabbd96 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:47.444903 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307dc44e-ff87-416f-a00f-23a4ddabbd96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:47.464153 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-307dc44e-ff87-416f-a00f-23a4ddabbd96 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:41:47.465409 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-307dc44e-ff87-416f-a00f-23a4ddabbd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:41:47.473599 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1141/2279] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:41:47.477827 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7d8c0-3f7d-433f-b894-371f5140624f None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:47.487753 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7d8c0-3f7d-433f-b894-371f5140624f None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:47.492929 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4298096-0e28-4474-9df5-0d136097dc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:47.493653 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4298096-0e28-4474-9df5-0d136097dc63 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:47.493857 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4298096-0e28-4474-9df5-0d136097dc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:47.494127 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4298096-0e28-4474-9df5-0d136097dc63 admin admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:47.494868 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4298096-0e28-4474-9df5-0d136097dc63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:41:47.495683 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4298096-0e28-4474-9df5-0d136097dc63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:47.497301 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4298096-0e28-4474-9df5-0d136097dc63 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:47.508865 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1139/2280] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:41:47.513812 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307dc44e-ff87-416f-a00f-23a4ddabbd96 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:47.523200 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307dc44e-ff87-416f-a00f-23a4ddabbd96 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:47.528498 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540f5eb-895d-4178-9496-60983d142459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:47.529187 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540f5eb-895d-4178-9496-60983d142459 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:47.529613 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540f5eb-895d-4178-9496-60983d142459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:47.529893 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540f5eb-895d-4178-9496-60983d142459 admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:47.530595 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7540f5eb-895d-4178-9496-60983d142459 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:47.532573 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7540f5eb-895d-4178-9496-60983d142459 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:47.618548 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1142/2281] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:41:47 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:41:47.623198 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4298096-0e28-4474-9df5-0d136097dc63 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:47.633307 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4298096-0e28-4474-9df5-0d136097dc63 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:47.688225 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964de022-ccc7-4ae1-a574-14352cb2afd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:47.689030 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964de022-ccc7-4ae1-a574-14352cb2afd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:47.689320 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964de022-ccc7-4ae1-a574-14352cb2afd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:47.689595 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964de022-ccc7-4ae1-a574-14352cb2afd8 admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:47.690306 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964de022-ccc7-4ae1-a574-14352cb2afd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:47.692250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964de022-ccc7-4ae1-a574-14352cb2afd8 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:47.770752 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1140/2282] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:41:47 2022] POST /identity/v3/users => generated 289 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:41:47.774957 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540f5eb-895d-4178-9496-60983d142459 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:47.785426 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540f5eb-895d-4178-9496-60983d142459 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:47.790157 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f33ba1-a09b-455d-980c-41b70d09d554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:47.790813 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f33ba1-a09b-455d-980c-41b70d09d554 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:47.791097 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f33ba1-a09b-455d-980c-41b70d09d554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:47.791375 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f33ba1-a09b-455d-980c-41b70d09d554 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:47.792101 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f33ba1-a09b-455d-980c-41b70d09d554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:47.794238 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f33ba1-a09b-455d-980c-41b70d09d554 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:47.804629 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1143/2283] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:41:47.808638 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964de022-ccc7-4ae1-a574-14352cb2afd8 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:47.819110 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964de022-ccc7-4ae1-a574-14352cb2afd8 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:47.823796 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb0fae-79db-46af-9559-e0f58dc72307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:47.824520 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb0fae-79db-46af-9559-e0f58dc72307 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:47.824800 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb0fae-79db-46af-9559-e0f58dc72307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:47.825075 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb0fae-79db-46af-9559-e0f58dc72307 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:47.825800 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cb0fae-79db-46af-9559-e0f58dc72307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:47.827447 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cb0fae-79db-46af-9559-e0f58dc72307 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:47.837585 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1141/2284] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:41:47.841842 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f33ba1-a09b-455d-980c-41b70d09d554 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:47.851816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f33ba1-a09b-455d-980c-41b70d09d554 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:47.857107 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9883e-9329-47d0-a037-b0eff0b7cd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:47.858008 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9883e-9329-47d0-a037-b0eff0b7cd32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:47.858290 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9883e-9329-47d0-a037-b0eff0b7cd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:47.858566 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9883e-9329-47d0-a037-b0eff0b7cd32 admin admin] PATH_INFO: `/v3/projects/d54eea47ffee4a8d8083bf57bc392c77/users/8380972d125d4b6a8ecbf52129a44a7b/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:47.870547 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:41:47.874753 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9883e-9329-47d0-a037-b0eff0b7cd32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d54eea47ffee4a8d8083bf57bc392c77, user_id=8380972d125d4b6a8ecbf52129a44a7b, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:47.877911 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9883e-9329-47d0-a037-b0eff0b7cd32 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:47.978843 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1144/2285] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:41:47 2022] PUT /identity/v3/projects/d54eea47ffee4a8d8083bf57bc392c77/users/8380972d125d4b6a8ecbf52129a44a7b/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:41:47.989467 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58aed7-106d-4ea3-8469-927ece07990e None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:47.991116 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58aed7-106d-4ea3-8469-927ece07990e None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:47.991116 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58aed7-106d-4ea3-8469-927ece07990e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:48.017670 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-cb58aed7-106d-4ea3-8469-927ece07990e None None] MFA Rules not processed for user `8380972d125d4b6a8ecbf52129a44a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:41:48.018927 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-cb58aed7-106d-4ea3-8469-927ece07990e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:41:48.030390 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:41:48.088937 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1142/2286] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:41:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:41:48.094089 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9883e-9329-47d0-a037-b0eff0b7cd32 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:48.163568 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9883e-9329-47d0-a037-b0eff0b7cd32 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:48.169530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f041278-a468-4eea-8874-51107a919e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:48.170186 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f041278-a468-4eea-8874-51107a919e31 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:48.170465 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f041278-a468-4eea-8874-51107a919e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:48.170739 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f041278-a468-4eea-8874-51107a919e31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:48.171459 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f041278-a468-4eea-8874-51107a919e31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:48.173417 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f041278-a468-4eea-8874-51107a919e31 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:48.264823 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1145/2287] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:41:48 2022] POST /identity/v3/projects => generated 377 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:41:48.268993 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58aed7-106d-4ea3-8469-927ece07990e None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:48.280068 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58aed7-106d-4ea3-8469-927ece07990e None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:48.333884 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f80c6-d692-468a-9082-5717b97c6b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:48.334524 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f80c6-d692-468a-9082-5717b97c6b91 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:48.334872 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f80c6-d692-468a-9082-5717b97c6b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:48.335069 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f80c6-d692-468a-9082-5717b97c6b91 admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:48.335761 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f80c6-d692-468a-9082-5717b97c6b91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:48.337741 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f80c6-d692-468a-9082-5717b97c6b91 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:48.445872 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1143/2288] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:41:48 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:41:48.450778 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f041278-a468-4eea-8874-51107a919e31 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:48.461743 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f041278-a468-4eea-8874-51107a919e31 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:48.467331 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9018d0-cde3-4707-92ec-198dc6f8f4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:48.467989 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9018d0-cde3-4707-92ec-198dc6f8f4ad admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:48.468381 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9018d0-cde3-4707-92ec-198dc6f8f4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:48.468590 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9018d0-cde3-4707-92ec-198dc6f8f4ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:48.469322 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9018d0-cde3-4707-92ec-198dc6f8f4ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:48.470931 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9018d0-cde3-4707-92ec-198dc6f8f4ad admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:48.482077 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1146/2289] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:41:48.486224 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f80c6-d692-468a-9082-5717b97c6b91 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:48.496347 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f80c6-d692-468a-9082-5717b97c6b91 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:48.500930 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc3ca3-432f-4d08-bf89-e45a085f9c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:48.501570 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc3ca3-432f-4d08-bf89-e45a085f9c71 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:48.501847 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc3ca3-432f-4d08-bf89-e45a085f9c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:48.502115 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc3ca3-432f-4d08-bf89-e45a085f9c71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:48.502864 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc3ca3-432f-4d08-bf89-e45a085f9c71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:48.504470 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc3ca3-432f-4d08-bf89-e45a085f9c71 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:48.514820 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1144/2290] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 09:41:48.519060 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9018d0-cde3-4707-92ec-198dc6f8f4ad admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:48.530024 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9018d0-cde3-4707-92ec-198dc6f8f4ad admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:48.534707 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33cee4-4e9b-4ff6-8815-0b27fbc01705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:48.535583 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33cee4-4e9b-4ff6-8815-0b27fbc01705 admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:48.535864 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33cee4-4e9b-4ff6-8815-0b27fbc01705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:48.536140 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33cee4-4e9b-4ff6-8815-0b27fbc01705 admin admin] PATH_INFO: `/v3/projects/d86c49d944464d848f76c0780ebf4637/users/688aff3d65dd4f919fa145649f74c75c/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:48.551810 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac33cee4-4e9b-4ff6-8815-0b27fbc01705 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d86c49d944464d848f76c0780ebf4637, user_id=688aff3d65dd4f919fa145649f74c75c, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:48.554503 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac33cee4-4e9b-4ff6-8815-0b27fbc01705 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:48.605158 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1147/2291] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:41:48 2022] PUT /identity/v3/projects/d86c49d944464d848f76c0780ebf4637/users/688aff3d65dd4f919fa145649f74c75c/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:41:48.615618 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d833e4-3983-4d04-a939-bf222b5f4d5a None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:48.615906 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d833e4-3983-4d04-a939-bf222b5f4d5a None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:48.616183 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d833e4-3983-4d04-a939-bf222b5f4d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:48.643407 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-80d833e4-3983-4d04-a939-bf222b5f4d5a None None] MFA Rules not processed for user `688aff3d65dd4f919fa145649f74c75c`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:41:48.644660 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-80d833e4-3983-4d04-a939-bf222b5f4d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:41:48.709712 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1145/2292] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:41:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:41:48.714182 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33cee4-4e9b-4ff6-8815-0b27fbc01705 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:48.774161 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33cee4-4e9b-4ff6-8815-0b27fbc01705 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:48.778710 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b127b5d-2d71-40b7-9046-da5c0679f5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:48.779351 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b127b5d-2d71-40b7-9046-da5c0679f5e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:48.779628 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b127b5d-2d71-40b7-9046-da5c0679f5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:48.779898 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b127b5d-2d71-40b7-9046-da5c0679f5e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:48.780614 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b127b5d-2d71-40b7-9046-da5c0679f5e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:48.782492 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b127b5d-2d71-40b7-9046-da5c0679f5e6 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:48.875873 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1148/2293] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:41:48 2022] POST /identity/v3/projects => generated 379 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:41:48.879883 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d833e4-3983-4d04-a939-bf222b5f4d5a None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:48.891426 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d833e4-3983-4d04-a939-bf222b5f4d5a None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:48.903473 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:41:48.946708 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b5f26-21c7-48d6-a4de-6116228e5536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:48.947373 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b5f26-21c7-48d6-a4de-6116228e5536 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:48.947660 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b5f26-21c7-48d6-a4de-6116228e5536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:48.947934 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b5f26-21c7-48d6-a4de-6116228e5536 admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:48.948665 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34b5f26-21c7-48d6-a4de-6116228e5536 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:48.951221 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34b5f26-21c7-48d6-a4de-6116228e5536 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:49.063113 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1146/2294] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:41:48 2022] POST /identity/v3/users => generated 296 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:41:49.067192 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b127b5d-2d71-40b7-9046-da5c0679f5e6 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:49.077699 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b127b5d-2d71-40b7-9046-da5c0679f5e6 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:49.082910 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072916b4-708b-4b34-87f7-7c45486242dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:49.083618 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072916b4-708b-4b34-87f7-7c45486242dc admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:49.083900 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072916b4-708b-4b34-87f7-7c45486242dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:49.084173 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072916b4-708b-4b34-87f7-7c45486242dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:49.084933 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072916b4-708b-4b34-87f7-7c45486242dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:49.086551 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072916b4-708b-4b34-87f7-7c45486242dc admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:49.097247 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1149/2295] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 09:41:49.106181 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b5f26-21c7-48d6-a4de-6116228e5536 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:49.112732 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b5f26-21c7-48d6-a4de-6116228e5536 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:49.117539 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a892ed4-1162-4a47-81a7-cad425c0f9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:49.118465 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a892ed4-1162-4a47-81a7-cad425c0f9a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:49.118743 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a892ed4-1162-4a47-81a7-cad425c0f9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:49.119016 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a892ed4-1162-4a47-81a7-cad425c0f9a0 admin admin] PATH_INFO: `/v3/projects/a31817b60dcb47eaad5d81b469026ab2/users/66399dc7afdc4de4b16a48111b624ecc/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:49.137565 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a892ed4-1162-4a47-81a7-cad425c0f9a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a31817b60dcb47eaad5d81b469026ab2, user_id=66399dc7afdc4de4b16a48111b624ecc, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:49.140567 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a892ed4-1162-4a47-81a7-cad425c0f9a0 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:49.211155 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1147/2296] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:41:49 2022] PUT /identity/v3/projects/a31817b60dcb47eaad5d81b469026ab2/users/66399dc7afdc4de4b16a48111b624ecc/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:41:49.215735 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072916b4-708b-4b34-87f7-7c45486242dc admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:49.225910 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072916b4-708b-4b34-87f7-7c45486242dc admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:49.238912 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:41:49.288481 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d57811e-9c03-4a0e-b595-3b92b3a062df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:49.289293 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57811e-9c03-4a0e-b595-3b92b3a062df admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:49.289668 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57811e-9c03-4a0e-b595-3b92b3a062df admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:49.290619 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57811e-9c03-4a0e-b595-3b92b3a062df admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:49.290980 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d57811e-9c03-4a0e-b595-3b92b3a062df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:49.296921 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d57811e-9c03-4a0e-b595-3b92b3a062df admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:49.313463 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1150/2297] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 09:41:49.317959 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a892ed4-1162-4a47-81a7-cad425c0f9a0 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:49.328418 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a892ed4-1162-4a47-81a7-cad425c0f9a0 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:49.333152 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4897c5c-fe7a-4db9-b413-c0b0d8b70712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:49.334036 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4897c5c-fe7a-4db9-b413-c0b0d8b70712 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:49.334322 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4897c5c-fe7a-4db9-b413-c0b0d8b70712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:49.334598 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4897c5c-fe7a-4db9-b413-c0b0d8b70712 admin admin] PATH_INFO: `/v3/projects/a31817b60dcb47eaad5d81b469026ab2/users/66399dc7afdc4de4b16a48111b624ecc/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:49.336936 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4897c5c-fe7a-4db9-b413-c0b0d8b70712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a31817b60dcb47eaad5d81b469026ab2, user_id=66399dc7afdc4de4b16a48111b624ecc, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:49.339356 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4897c5c-fe7a-4db9-b413-c0b0d8b70712 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:49.350004 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1148/2298] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:41:49 2022] PUT /identity/v3/projects/a31817b60dcb47eaad5d81b469026ab2/users/66399dc7afdc4de4b16a48111b624ecc/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:41:49.360854 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa948f-44ba-45c4-a703-ee8750198352 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:49.363248 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa948f-44ba-45c4-a703-ee8750198352 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:49.363248 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa948f-44ba-45c4-a703-ee8750198352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:49.388827 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-b6aa948f-44ba-45c4-a703-ee8750198352 None None] MFA Rules not processed for user `66399dc7afdc4de4b16a48111b624ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:41:49.390073 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-b6aa948f-44ba-45c4-a703-ee8750198352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:41:49.459295 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1151/2299] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:41:49 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:41:49.472358 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4897c5c-fe7a-4db9-b413-c0b0d8b70712 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:49.474137 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-e4897c5c-fe7a-4db9-b413-c0b0d8b70712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:41:49.531838 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4897c5c-fe7a-4db9-b413-c0b0d8b70712 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:49.535460 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf5d0e-a53c-4ef1-bb39-62a909c125be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:49.536096 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf5d0e-a53c-4ef1-bb39-62a909c125be service cinder] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:49.536426 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf5d0e-a53c-4ef1-bb39-62a909c125be service cinder] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:49.536702 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf5d0e-a53c-4ef1-bb39-62a909c125be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:49.546595 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf5d0e-a53c-4ef1-bb39-62a909c125be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:49.548303 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf5d0e-a53c-4ef1-bb39-62a909c125be service cinder] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:49.558091 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1149/2300] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:41:49 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:41:49.677526 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa948f-44ba-45c4-a703-ee8750198352 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:49.678969 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-b6aa948f-44ba-45c4-a703-ee8750198352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:41:49.690906 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa948f-44ba-45c4-a703-ee8750198352 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:49.694640 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db11a90-e613-49d7-ab12-e1c25eee5f5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:49.695280 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db11a90-e613-49d7-ab12-e1c25eee5f5d service cinder] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:49.695563 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db11a90-e613-49d7-ab12-e1c25eee5f5d service cinder] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:49.695839 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db11a90-e613-49d7-ab12-e1c25eee5f5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:49.753662 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db11a90-e613-49d7-ab12-e1c25eee5f5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:49.755089 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db11a90-e613-49d7-ab12-e1c25eee5f5d service cinder] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:49.764333 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1152/2301] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:41:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:41:53.768903 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf5d0e-a53c-4ef1-bb39-62a909c125be service cinder] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:53.837149 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf5d0e-a53c-4ef1-bb39-62a909c125be service cinder] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:53.842563 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb00d7-ed73-4e89-a2d4-303333f61e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:53.844127 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb00d7-ed73-4e89-a2d4-303333f61e9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:53.850733 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb00d7-ed73-4e89-a2d4-303333f61e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:53.850733 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb00d7-ed73-4e89-a2d4-303333f61e9b admin admin] PATH_INFO: `/v3/users/8380972d125d4b6a8ecbf52129a44a7b` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:53.850733 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb00d7-ed73-4e89-a2d4-303333f61e9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8380972d125d4b6a8ecbf52129a44a7b)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:53.850733 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb00d7-ed73-4e89-a2d4-303333f61e9b admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:53.869889 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:41:54.077585 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-cebb00d7-ed73-4e89-a2d4-303333f61e9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8380972d125d4b6a8ecbf52129a44a7b'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:54.084714 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-cebb00d7-ed73-4e89-a2d4-303333f61e9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8380972d125d4b6a8ecbf52129a44a7b'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:54.193403 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-cebb00d7-ed73-4e89-a2d4-303333f61e9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8380972d125d4b6a8ecbf52129a44a7b'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:54.194010 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-cebb00d7-ed73-4e89-a2d4-303333f61e9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8380972d125d4b6a8ecbf52129a44a7b'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:54.207730 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-cebb00d7-ed73-4e89-a2d4-303333f61e9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8380972d125d4b6a8ecbf52129a44a7b'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:54.214063 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1150/2302] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:41:53 2022] DELETE /identity/v3/users/8380972d125d4b6a8ecbf52129a44a7b => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:41:54.218538 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e33950-401d-4d31-95d9-cea069c11813 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:54.219031 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e33950-401d-4d31-95d9-cea069c11813 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:54.219146 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e33950-401d-4d31-95d9-cea069c11813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:54.241798 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-f6e33950-401d-4d31-95d9-cea069c11813 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:41:54.243014 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-f6e33950-401d-4d31-95d9-cea069c11813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:41:54.274344 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:41:54.303515 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1153/2303] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:41:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:41:54.314507 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb00d7-ed73-4e89-a2d4-303333f61e9b admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:54.315902 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-cebb00d7-ed73-4e89-a2d4-303333f61e9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:41:54.377186 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb00d7-ed73-4e89-a2d4-303333f61e9b admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:54.380798 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bdb429-aeb0-410a-8b04-e65fc37e89a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:54.381649 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bdb429-aeb0-410a-8b04-e65fc37e89a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:54.381937 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bdb429-aeb0-410a-8b04-e65fc37e89a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:54.382209 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bdb429-aeb0-410a-8b04-e65fc37e89a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:54.398601 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bdb429-aeb0-410a-8b04-e65fc37e89a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:54.398601 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bdb429-aeb0-410a-8b04-e65fc37e89a5 service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:54.406128 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1151/2304] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:41:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 09:41:54.910630 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e33950-401d-4d31-95d9-cea069c11813 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:54.912898 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-f6e33950-401d-4d31-95d9-cea069c11813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:41:54.935955 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e33950-401d-4d31-95d9-cea069c11813 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:54.941950 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb78408-242e-45f8-8160-9d2f27732b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:54.943556 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb78408-242e-45f8-8160-9d2f27732b34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:54.943733 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb78408-242e-45f8-8160-9d2f27732b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:54.944374 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb78408-242e-45f8-8160-9d2f27732b34 admin admin] PATH_INFO: `/v3/projects/d54eea47ffee4a8d8083bf57bc392c77` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:54.945941 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb78408-242e-45f8-8160-9d2f27732b34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d54eea47ffee4a8d8083bf57bc392c77)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:54.948581 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb78408-242e-45f8-8160-9d2f27732b34 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:55.046869 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-7cb78408-242e-45f8-8160-9d2f27732b34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd54eea47ffee4a8d8083bf57bc392c77', 'request_id': 'req-7cb78408-242e-45f8-8160-9d2f27732b34'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:55.096443 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-7cb78408-242e-45f8-8160-9d2f27732b34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd54eea47ffee4a8d8083bf57bc392c77', 'request_id': 'req-7cb78408-242e-45f8-8160-9d2f27732b34'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:55.102554 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-7cb78408-242e-45f8-8160-9d2f27732b34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd54eea47ffee4a8d8083bf57bc392c77', 'request_id': 'req-7cb78408-242e-45f8-8160-9d2f27732b34'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:55.116584 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-7cb78408-242e-45f8-8160-9d2f27732b34 admin admin] The token cache is being invalidate because project d54eea47ffee4a8d8083bf57bc392c77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:41:55.116870 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-7cb78408-242e-45f8-8160-9d2f27732b34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:55.117529 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-7cb78408-242e-45f8-8160-9d2f27732b34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:55.119085 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1154/2305] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:41:54 2022] DELETE /identity/v3/projects/d54eea47ffee4a8d8083bf57bc392c77 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:41:55.123087 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bdb429-aeb0-410a-8b04-e65fc37e89a5 service neutron] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:55.133180 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bdb429-aeb0-410a-8b04-e65fc37e89a5 service neutron] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:55.195962 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a124612-54cd-483f-9093-f2940fbf383e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:55.197021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a124612-54cd-483f-9093-f2940fbf383e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:55.197403 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a124612-54cd-483f-9093-f2940fbf383e admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:55.197831 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a124612-54cd-483f-9093-f2940fbf383e admin admin] PATH_INFO: `/v3/users/688aff3d65dd4f919fa145649f74c75c` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:55.199687 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a124612-54cd-483f-9093-f2940fbf383e admin admin] RBAC: Authorizing `identity:delete_user(user_id=688aff3d65dd4f919fa145649f74c75c)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:55.201652 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a124612-54cd-483f-9093-f2940fbf383e admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:55.406564 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:41:55.417294 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-8a124612-54cd-483f-9093-f2940fbf383e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '688aff3d65dd4f919fa145649f74c75c'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:55.425619 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-8a124612-54cd-483f-9093-f2940fbf383e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '688aff3d65dd4f919fa145649f74c75c'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:55.530316 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-8a124612-54cd-483f-9093-f2940fbf383e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '688aff3d65dd4f919fa145649f74c75c'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:55.530962 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-8a124612-54cd-483f-9093-f2940fbf383e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '688aff3d65dd4f919fa145649f74c75c'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:55.545654 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-8a124612-54cd-483f-9093-f2940fbf383e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '688aff3d65dd4f919fa145649f74c75c'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:55.551920 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1152/2306] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:41:55 2022] DELETE /identity/v3/users/688aff3d65dd4f919fa145649f74c75c => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:41:55.996782 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb78408-242e-45f8-8160-9d2f27732b34 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:55.998493 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-7cb78408-242e-45f8-8160-9d2f27732b34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:41:56.014062 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb78408-242e-45f8-8160-9d2f27732b34 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:56.080843 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0807871-cb06-4e68-bfe1-5a5a6e636a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:56.081842 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0807871-cb06-4e68-bfe1-5a5a6e636a8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:56.082011 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0807871-cb06-4e68-bfe1-5a5a6e636a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:56.082286 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0807871-cb06-4e68-bfe1-5a5a6e636a8b admin admin] PATH_INFO: `/v3/projects/d86c49d944464d848f76c0780ebf4637` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:56.084887 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0807871-cb06-4e68-bfe1-5a5a6e636a8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d86c49d944464d848f76c0780ebf4637)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:56.087087 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0807871-cb06-4e68-bfe1-5a5a6e636a8b admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:56.178127 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-e0807871-cb06-4e68-bfe1-5a5a6e636a8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd86c49d944464d848f76c0780ebf4637', 'request_id': 'req-e0807871-cb06-4e68-bfe1-5a5a6e636a8b'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:56.233269 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-e0807871-cb06-4e68-bfe1-5a5a6e636a8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd86c49d944464d848f76c0780ebf4637', 'request_id': 'req-e0807871-cb06-4e68-bfe1-5a5a6e636a8b'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:56.238679 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:41:56.242498 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-e0807871-cb06-4e68-bfe1-5a5a6e636a8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd86c49d944464d848f76c0780ebf4637', 'request_id': 'req-e0807871-cb06-4e68-bfe1-5a5a6e636a8b'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:56.255544 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-e0807871-cb06-4e68-bfe1-5a5a6e636a8b admin admin] The token cache is being invalidate because project d86c49d944464d848f76c0780ebf4637 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:41:56.255860 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-e0807871-cb06-4e68-bfe1-5a5a6e636a8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:56.256542 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-e0807871-cb06-4e68-bfe1-5a5a6e636a8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:56.258092 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1155/2307] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:41:55 2022] DELETE /identity/v3/projects/d86c49d944464d848f76c0780ebf4637 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:41:56.262159 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a124612-54cd-483f-9093-f2940fbf383e admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:56.263577 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-8a124612-54cd-483f-9093-f2940fbf383e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:41:56.276245 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a124612-54cd-483f-9093-f2940fbf383e admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:56.342335 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ca9d5-0e8d-4db2-94ab-b903479ddd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:56.343213 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ca9d5-0e8d-4db2-94ab-b903479ddd64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:56.343494 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ca9d5-0e8d-4db2-94ab-b903479ddd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:56.343768 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ca9d5-0e8d-4db2-94ab-b903479ddd64 admin admin] PATH_INFO: `/v3/users/66399dc7afdc4de4b16a48111b624ecc` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:56.345068 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ca9d5-0e8d-4db2-94ab-b903479ddd64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66399dc7afdc4de4b16a48111b624ecc)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:56.347134 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ca9d5-0e8d-4db2-94ab-b903479ddd64 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:56.561251 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-150ca9d5-0e8d-4db2-94ab-b903479ddd64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66399dc7afdc4de4b16a48111b624ecc'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:56.568107 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-150ca9d5-0e8d-4db2-94ab-b903479ddd64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66399dc7afdc4de4b16a48111b624ecc'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:56.616323 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-150ca9d5-0e8d-4db2-94ab-b903479ddd64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66399dc7afdc4de4b16a48111b624ecc'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:56.616970 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-150ca9d5-0e8d-4db2-94ab-b903479ddd64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66399dc7afdc4de4b16a48111b624ecc'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:56.629834 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-150ca9d5-0e8d-4db2-94ab-b903479ddd64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66399dc7afdc4de4b16a48111b624ecc'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:56.635808 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1153/2308] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:41:56 2022] DELETE /identity/v3/users/66399dc7afdc4de4b16a48111b624ecc => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:41:57.015222 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0807871-cb06-4e68-bfe1-5a5a6e636a8b admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:57.017063 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-e0807871-cb06-4e68-bfe1-5a5a6e636a8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:41:57.032772 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0807871-cb06-4e68-bfe1-5a5a6e636a8b admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:57.099804 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a09edf-23b0-4e28-ae34-e238dd9acbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:57.100828 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a09edf-23b0-4e28-ae34-e238dd9acbaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:57.101061 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a09edf-23b0-4e28-ae34-e238dd9acbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:57.106260 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a09edf-23b0-4e28-ae34-e238dd9acbaa admin admin] PATH_INFO: `/v3/projects/a31817b60dcb47eaad5d81b469026ab2` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:57.106260 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a09edf-23b0-4e28-ae34-e238dd9acbaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=a31817b60dcb47eaad5d81b469026ab2)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:57.106746 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a09edf-23b0-4e28-ae34-e238dd9acbaa admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:57.316359 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-e0a09edf-23b0-4e28-ae34-e238dd9acbaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a31817b60dcb47eaad5d81b469026ab2', 'request_id': 'req-e0a09edf-23b0-4e28-ae34-e238dd9acbaa'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:57.382343 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-e0a09edf-23b0-4e28-ae34-e238dd9acbaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a31817b60dcb47eaad5d81b469026ab2', 'request_id': 'req-e0a09edf-23b0-4e28-ae34-e238dd9acbaa'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:57.398921 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-e0a09edf-23b0-4e28-ae34-e238dd9acbaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a31817b60dcb47eaad5d81b469026ab2', 'request_id': 'req-e0a09edf-23b0-4e28-ae34-e238dd9acbaa'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:57.408530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-e0a09edf-23b0-4e28-ae34-e238dd9acbaa admin admin] The token cache is being invalidate because project a31817b60dcb47eaad5d81b469026ab2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:41:57.409940 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-e0a09edf-23b0-4e28-ae34-e238dd9acbaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:57.410947 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-e0a09edf-23b0-4e28-ae34-e238dd9acbaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:41:57.412629 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1156/2309] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:41:57 2022] DELETE /identity/v3/projects/a31817b60dcb47eaad5d81b469026ab2 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:41:57.420161 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb8ccc-81a4-4ec1-84ec-58a52e59939f None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:57.420962 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb8ccc-81a4-4ec1-84ec-58a52e59939f None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:57.420962 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb8ccc-81a4-4ec1-84ec-58a52e59939f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:57.440223 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-dceb8ccc-81a4-4ec1-84ec-58a52e59939f None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:41:57.441563 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-dceb8ccc-81a4-4ec1-84ec-58a52e59939f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:41:57.473948 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:41:57.505786 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1154/2310] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:41:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:41:57.516100 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2849e6-2390-4f2d-a1ab-d299bf07ad9b None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:57.516448 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2849e6-2390-4f2d-a1ab-d299bf07ad9b None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:57.517251 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2849e6-2390-4f2d-a1ab-d299bf07ad9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:57.534911 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-6f2849e6-2390-4f2d-a1ab-d299bf07ad9b None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:41:57.536113 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-6f2849e6-2390-4f2d-a1ab-d299bf07ad9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:41:57.544650 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1157/2311] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:41:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:41:57.552622 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb8ccc-81a4-4ec1-84ec-58a52e59939f None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:57.558401 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb8ccc-81a4-4ec1-84ec-58a52e59939f None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:57.563792 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e52d7-51d4-41bb-ab85-3326f9c835a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:57.564486 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e52d7-51d4-41bb-ab85-3326f9c835a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:57.564771 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e52d7-51d4-41bb-ab85-3326f9c835a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:57.565042 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e52d7-51d4-41bb-ab85-3326f9c835a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:57.565765 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1e52d7-51d4-41bb-ab85-3326f9c835a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:41:57.566073 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1e52d7-51d4-41bb-ab85-3326f9c835a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:57.567681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1e52d7-51d4-41bb-ab85-3326f9c835a2 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:57.580100 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1155/2312] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:41:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:41:57.584535 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2849e6-2390-4f2d-a1ab-d299bf07ad9b None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:57.594063 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2849e6-2390-4f2d-a1ab-d299bf07ad9b None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:57.598787 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc61e6-2af5-49bb-91f4-860d13c6772e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:57.599435 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc61e6-2af5-49bb-91f4-860d13c6772e admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:57.599716 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc61e6-2af5-49bb-91f4-860d13c6772e admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:57.599989 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc61e6-2af5-49bb-91f4-860d13c6772e admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:57.600718 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc61e6-2af5-49bb-91f4-860d13c6772e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:57.602619 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc61e6-2af5-49bb-91f4-860d13c6772e admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:57.701169 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1158/2313] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:41:57 2022] POST /identity/v3/projects => generated 367 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:41:57.702532 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e52d7-51d4-41bb-ab85-3326f9c835a2 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:57.712563 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e52d7-51d4-41bb-ab85-3326f9c835a2 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:57.768449 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc89c1c-d254-4176-87a7-97c8d6230da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:57.769116 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc89c1c-d254-4176-87a7-97c8d6230da5 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:57.769395 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc89c1c-d254-4176-87a7-97c8d6230da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:57.769668 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc89c1c-d254-4176-87a7-97c8d6230da5 admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:57.770347 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc89c1c-d254-4176-87a7-97c8d6230da5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:57.772304 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc89c1c-d254-4176-87a7-97c8d6230da5 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:57.879479 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1156/2314] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:41:57 2022] POST /identity/v3/users => generated 284 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:41:57.883564 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc61e6-2af5-49bb-91f4-860d13c6772e admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:57.894453 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc61e6-2af5-49bb-91f4-860d13c6772e admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:57.899469 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd3fcc-56a9-4e1d-9b4b-c7f75d7f6155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:57.900145 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd3fcc-56a9-4e1d-9b4b-c7f75d7f6155 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:57.906250 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd3fcc-56a9-4e1d-9b4b-c7f75d7f6155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:57.906250 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd3fcc-56a9-4e1d-9b4b-c7f75d7f6155 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:57.906250 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd3fcc-56a9-4e1d-9b4b-c7f75d7f6155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:57.906250 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd3fcc-56a9-4e1d-9b4b-c7f75d7f6155 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:57.914944 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1159/2315] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:41:57.919297 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc89c1c-d254-4176-87a7-97c8d6230da5 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:57.929398 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc89c1c-d254-4176-87a7-97c8d6230da5 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:57.934079 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c504c70-80d5-4956-ab3c-d96a881576fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:57.934734 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c504c70-80d5-4956-ab3c-d96a881576fb admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:57.935009 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c504c70-80d5-4956-ab3c-d96a881576fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:57.935287 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c504c70-80d5-4956-ab3c-d96a881576fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:57.936044 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c504c70-80d5-4956-ab3c-d96a881576fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:57.937683 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c504c70-80d5-4956-ab3c-d96a881576fb admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:57.949669 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1157/2316] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:41:57.953818 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd3fcc-56a9-4e1d-9b4b-c7f75d7f6155 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:57.964577 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd3fcc-56a9-4e1d-9b4b-c7f75d7f6155 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:57.970910 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d049e-15ba-4da9-adfb-cee6d394dc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:57.971798 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d049e-15ba-4da9-adfb-cee6d394dc51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:57.972105 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d049e-15ba-4da9-adfb-cee6d394dc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:57.972399 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d049e-15ba-4da9-adfb-cee6d394dc51 admin admin] PATH_INFO: `/v3/projects/b9a06b73251e4703a72fbaf937ef9751/users/4e2d9faa15a440509605149e33ebd37e/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:57.988287 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d049e-15ba-4da9-adfb-cee6d394dc51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9a06b73251e4703a72fbaf937ef9751, user_id=4e2d9faa15a440509605149e33ebd37e, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:57.990939 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d049e-15ba-4da9-adfb-cee6d394dc51 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:58.052433 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1160/2317] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:41:57 2022] PUT /identity/v3/projects/b9a06b73251e4703a72fbaf937ef9751/users/4e2d9faa15a440509605149e33ebd37e/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:41:58.063400 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4052770-1a39-449e-a241-6bb2b5b1516c None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:58.063689 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4052770-1a39-449e-a241-6bb2b5b1516c None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:58.063965 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4052770-1a39-449e-a241-6bb2b5b1516c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:58.098983 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-d4052770-1a39-449e-a241-6bb2b5b1516c None None] MFA Rules not processed for user `4e2d9faa15a440509605149e33ebd37e`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:41:58.100176 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-d4052770-1a39-449e-a241-6bb2b5b1516c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:41:58.184572 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1158/2318] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:41:58 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:41:58.189666 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d049e-15ba-4da9-adfb-cee6d394dc51 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:58.211570 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:41:58.262923 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d049e-15ba-4da9-adfb-cee6d394dc51 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:58.270574 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e69e65-7d0f-435f-a9e7-150fc4aaaada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:58.271254 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e69e65-7d0f-435f-a9e7-150fc4aaaada admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:58.271547 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e69e65-7d0f-435f-a9e7-150fc4aaaada admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:58.271884 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e69e65-7d0f-435f-a9e7-150fc4aaaada admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:58.272635 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e69e65-7d0f-435f-a9e7-150fc4aaaada admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:58.274654 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e69e65-7d0f-435f-a9e7-150fc4aaaada admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:58.356034 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1161/2319] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:41:58 2022] POST /identity/v3/projects => generated 367 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:41:58.360418 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4052770-1a39-449e-a241-6bb2b5b1516c None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:58.371963 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4052770-1a39-449e-a241-6bb2b5b1516c None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:58.400246 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:41:58.435235 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c9403-b883-4b71-aaea-3e2d41964132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:58.435904 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c9403-b883-4b71-aaea-3e2d41964132 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:58.436187 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c9403-b883-4b71-aaea-3e2d41964132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:58.436503 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c9403-b883-4b71-aaea-3e2d41964132 admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:58.437316 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c9403-b883-4b71-aaea-3e2d41964132 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:58.439138 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c9403-b883-4b71-aaea-3e2d41964132 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:58.566547 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1159/2320] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:41:58 2022] POST /identity/v3/users => generated 290 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:41:58.570570 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e69e65-7d0f-435f-a9e7-150fc4aaaada admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:58.583326 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e69e65-7d0f-435f-a9e7-150fc4aaaada admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:58.602317 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66eb4c9-0fd4-4f60-9c85-5b3dbe06c049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:58.602317 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66eb4c9-0fd4-4f60-9c85-5b3dbe06c049 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:58.602317 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66eb4c9-0fd4-4f60-9c85-5b3dbe06c049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:58.602317 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66eb4c9-0fd4-4f60-9c85-5b3dbe06c049 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:58.603020 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66eb4c9-0fd4-4f60-9c85-5b3dbe06c049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:58.603020 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66eb4c9-0fd4-4f60-9c85-5b3dbe06c049 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:58.603433 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1162/2321] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:41:58.614442 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c9403-b883-4b71-aaea-3e2d41964132 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:58.619284 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c9403-b883-4b71-aaea-3e2d41964132 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:58.625664 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c63f9-da54-4905-bcfa-2fa15a6eb0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:58.626609 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c63f9-da54-4905-bcfa-2fa15a6eb0f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:58.626927 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c63f9-da54-4905-bcfa-2fa15a6eb0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:58.627154 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c63f9-da54-4905-bcfa-2fa15a6eb0f1 admin admin] PATH_INFO: `/v3/projects/da52a87991a4456b9c80d44b464e687e/users/a295c2314de7408abcaae82ac3cacc1d/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:58.648879 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c63f9-da54-4905-bcfa-2fa15a6eb0f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da52a87991a4456b9c80d44b464e687e, user_id=a295c2314de7408abcaae82ac3cacc1d, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:58.651528 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c63f9-da54-4905-bcfa-2fa15a6eb0f1 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:58.765679 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1160/2322] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:41:58 2022] PUT /identity/v3/projects/da52a87991a4456b9c80d44b464e687e/users/a295c2314de7408abcaae82ac3cacc1d/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:41:58.769667 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66eb4c9-0fd4-4f60-9c85-5b3dbe06c049 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:58.779528 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66eb4c9-0fd4-4f60-9c85-5b3dbe06c049 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:58.835799 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad471e-bab7-4569-8bea-337c549d3034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:58.836503 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad471e-bab7-4569-8bea-337c549d3034 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:58.836812 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad471e-bab7-4569-8bea-337c549d3034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:58.837206 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad471e-bab7-4569-8bea-337c549d3034 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:58.838203 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad471e-bab7-4569-8bea-337c549d3034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:58.839800 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad471e-bab7-4569-8bea-337c549d3034 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:58.850343 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1163/2323] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:41:58.854556 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c63f9-da54-4905-bcfa-2fa15a6eb0f1 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:58.865633 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c63f9-da54-4905-bcfa-2fa15a6eb0f1 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:58.870222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd3296-ba39-4d61-82a3-2b1994dadd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:58.874482 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd3296-ba39-4d61-82a3-2b1994dadd03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:58.874482 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd3296-ba39-4d61-82a3-2b1994dadd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:58.874482 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd3296-ba39-4d61-82a3-2b1994dadd03 admin admin] PATH_INFO: `/v3/projects/da52a87991a4456b9c80d44b464e687e/users/a295c2314de7408abcaae82ac3cacc1d/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:58.874482 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd3296-ba39-4d61-82a3-2b1994dadd03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da52a87991a4456b9c80d44b464e687e, user_id=a295c2314de7408abcaae82ac3cacc1d, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:58.877010 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd3296-ba39-4d61-82a3-2b1994dadd03 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:58.887478 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1161/2324] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:41:58 2022] PUT /identity/v3/projects/da52a87991a4456b9c80d44b464e687e/users/a295c2314de7408abcaae82ac3cacc1d/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:41:58.898690 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fcf1c0-de39-4a48-a580-1026742c7b15 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:58.903309 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fcf1c0-de39-4a48-a580-1026742c7b15 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:58.903309 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fcf1c0-de39-4a48-a580-1026742c7b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:58.928835 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-73fcf1c0-de39-4a48-a580-1026742c7b15 None None] MFA Rules not processed for user `a295c2314de7408abcaae82ac3cacc1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:41:58.930039 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-73fcf1c0-de39-4a48-a580-1026742c7b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:41:59.001889 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1164/2325] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:41:58 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:41:59.013371 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd3296-ba39-4d61-82a3-2b1994dadd03 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:59.015107 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-50cd3296-ba39-4d61-82a3-2b1994dadd03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:41:59.073561 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd3296-ba39-4d61-82a3-2b1994dadd03 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:59.077222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa82a776-ed1b-4871-86a0-208b46506bc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:59.077860 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82a776-ed1b-4871-86a0-208b46506bc1 service cinder] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:59.078142 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82a776-ed1b-4871-86a0-208b46506bc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:59.078416 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82a776-ed1b-4871-86a0-208b46506bc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:59.087491 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa82a776-ed1b-4871-86a0-208b46506bc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:59.088943 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa82a776-ed1b-4871-86a0-208b46506bc1 service cinder] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:59.098212 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1162/2326] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:41:59 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:41:59.269849 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fcf1c0-de39-4a48-a580-1026742c7b15 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:41:59.280173 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fcf1c0-de39-4a48-a580-1026742c7b15 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:41:59.284023 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b79a5c-6636-4532-9914-bd61ff823cdb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:41:59.284698 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b79a5c-6636-4532-9914-bd61ff823cdb service cinder] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:41:59.284981 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b79a5c-6636-4532-9914-bd61ff823cdb service cinder] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:41:59.285261 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b79a5c-6636-4532-9914-bd61ff823cdb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:41:59.295190 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:41:59.346079 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b79a5c-6636-4532-9914-bd61ff823cdb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:41:59.347503 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b79a5c-6636-4532-9914-bd61ff823cdb service cinder] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:41:59.357326 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1165/2327] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:41:59 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:42:06.826847 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa82a776-ed1b-4871-86a0-208b46506bc1 service cinder] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:42:06.889781 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa82a776-ed1b-4871-86a0-208b46506bc1 service cinder] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:42:06.894731 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845fcce-1a45-479c-9709-54adf53b9c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:42:06.895607 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845fcce-1a45-479c-9709-54adf53b9c3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:06.895895 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845fcce-1a45-479c-9709-54adf53b9c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:06.896170 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845fcce-1a45-479c-9709-54adf53b9c3d admin admin] PATH_INFO: `/v3/users/4e2d9faa15a440509605149e33ebd37e` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:06.897435 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6845fcce-1a45-479c-9709-54adf53b9c3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e2d9faa15a440509605149e33ebd37e)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:42:06.899393 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6845fcce-1a45-479c-9709-54adf53b9c3d admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:42:07.028173 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:42:07.149785 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-6845fcce-1a45-479c-9709-54adf53b9c3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e2d9faa15a440509605149e33ebd37e'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:42:07.156477 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-6845fcce-1a45-479c-9709-54adf53b9c3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e2d9faa15a440509605149e33ebd37e'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:42:07.233631 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-6845fcce-1a45-479c-9709-54adf53b9c3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e2d9faa15a440509605149e33ebd37e'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:42:07.234437 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-6845fcce-1a45-479c-9709-54adf53b9c3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e2d9faa15a440509605149e33ebd37e'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:42:07.252967 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-6845fcce-1a45-479c-9709-54adf53b9c3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e2d9faa15a440509605149e33ebd37e'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:42:07.268325 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1163/2328] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:42:06 2022] DELETE /identity/v3/users/4e2d9faa15a440509605149e33ebd37e => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:42:07.275711 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb254ef-af43-4206-ba46-9f7859ee5943 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:07.275711 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb254ef-af43-4206-ba46-9f7859ee5943 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:07.275711 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb254ef-af43-4206-ba46-9f7859ee5943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:07.294450 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-feb254ef-af43-4206-ba46-9f7859ee5943 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:42:07.296361 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-feb254ef-af43-4206-ba46-9f7859ee5943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:42:07.370673 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1166/2329] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:42:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:42:07.375509 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845fcce-1a45-479c-9709-54adf53b9c3d admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:42:07.377205 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-6845fcce-1a45-479c-9709-54adf53b9c3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:42:07.439470 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845fcce-1a45-479c-9709-54adf53b9c3d admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:42:07.443396 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f5f61-aaf4-4132-b5da-3f415c04b03e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:42:07.444061 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f5f61-aaf4-4132-b5da-3f415c04b03e service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:07.444636 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f5f61-aaf4-4132-b5da-3f415c04b03e service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:07.445117 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f5f61-aaf4-4132-b5da-3f415c04b03e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:07.456376 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f5f61-aaf4-4132-b5da-3f415c04b03e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:42:07.457828 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f5f61-aaf4-4132-b5da-3f415c04b03e service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:42:07.469239 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1164/2330] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:42:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:42:07.932858 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb254ef-af43-4206-ba46-9f7859ee5943 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:42:07.934327 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-feb254ef-af43-4206-ba46-9f7859ee5943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:42:07.953867 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb254ef-af43-4206-ba46-9f7859ee5943 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:42:07.962383 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe4f4b1-a29a-4365-a8f9-063bc5652b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:42:07.963261 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4f4b1-a29a-4365-a8f9-063bc5652b59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:07.963544 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4f4b1-a29a-4365-a8f9-063bc5652b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:07.963798 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4f4b1-a29a-4365-a8f9-063bc5652b59 admin admin] PATH_INFO: `/v3/projects/b9a06b73251e4703a72fbaf937ef9751` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:07.965087 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe4f4b1-a29a-4365-a8f9-063bc5652b59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9a06b73251e4703a72fbaf937ef9751)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:42:07.967638 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe4f4b1-a29a-4365-a8f9-063bc5652b59 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:42:08.129828 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-dbe4f4b1-a29a-4365-a8f9-063bc5652b59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9a06b73251e4703a72fbaf937ef9751', 'request_id': 'req-dbe4f4b1-a29a-4365-a8f9-063bc5652b59'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:42:08.216652 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-dbe4f4b1-a29a-4365-a8f9-063bc5652b59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9a06b73251e4703a72fbaf937ef9751', 'request_id': 'req-dbe4f4b1-a29a-4365-a8f9-063bc5652b59'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:42:08.222776 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-dbe4f4b1-a29a-4365-a8f9-063bc5652b59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9a06b73251e4703a72fbaf937ef9751', 'request_id': 'req-dbe4f4b1-a29a-4365-a8f9-063bc5652b59'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:42:08.235728 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-dbe4f4b1-a29a-4365-a8f9-063bc5652b59 admin admin] The token cache is being invalidate because project b9a06b73251e4703a72fbaf937ef9751 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:42:08.236021 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-dbe4f4b1-a29a-4365-a8f9-063bc5652b59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:42:08.236871 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-dbe4f4b1-a29a-4365-a8f9-063bc5652b59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:42:08.241392 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1167/2331] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:42:07 2022] DELETE /identity/v3/projects/b9a06b73251e4703a72fbaf937ef9751 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:42:08.242664 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f5f61-aaf4-4132-b5da-3f415c04b03e service neutron] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:42:08.255750 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f5f61-aaf4-4132-b5da-3f415c04b03e service neutron] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:42:08.328779 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e19031-6687-42e4-a0c6-5d430be879be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:42:08.329802 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e19031-6687-42e4-a0c6-5d430be879be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:08.330184 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e19031-6687-42e4-a0c6-5d430be879be admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:08.330519 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e19031-6687-42e4-a0c6-5d430be879be admin admin] PATH_INFO: `/v3/users/a295c2314de7408abcaae82ac3cacc1d` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:08.331845 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e19031-6687-42e4-a0c6-5d430be879be admin admin] RBAC: Authorizing `identity:delete_user(user_id=a295c2314de7408abcaae82ac3cacc1d)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:42:08.333962 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e19031-6687-42e4-a0c6-5d430be879be admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:42:08.534505 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-b6e19031-6687-42e4-a0c6-5d430be879be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a295c2314de7408abcaae82ac3cacc1d'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:42:08.536038 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:42:08.547059 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-b6e19031-6687-42e4-a0c6-5d430be879be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a295c2314de7408abcaae82ac3cacc1d'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:42:08.662014 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-b6e19031-6687-42e4-a0c6-5d430be879be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a295c2314de7408abcaae82ac3cacc1d'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:42:08.662688 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-b6e19031-6687-42e4-a0c6-5d430be879be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a295c2314de7408abcaae82ac3cacc1d'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:42:08.676628 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-b6e19031-6687-42e4-a0c6-5d430be879be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a295c2314de7408abcaae82ac3cacc1d'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:42:08.683147 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1165/2332] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:42:08 2022] DELETE /identity/v3/users/a295c2314de7408abcaae82ac3cacc1d => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:42:09.092341 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe4f4b1-a29a-4365-a8f9-063bc5652b59 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:42:09.093768 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-dbe4f4b1-a29a-4365-a8f9-063bc5652b59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:42:09.111180 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe4f4b1-a29a-4365-a8f9-063bc5652b59 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:42:09.145350 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:42:09.176640 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515353ec-5640-4079-a506-b274d0168396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:42:09.177520 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515353ec-5640-4079-a506-b274d0168396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:09.177804 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515353ec-5640-4079-a506-b274d0168396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:09.178080 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515353ec-5640-4079-a506-b274d0168396 admin admin] PATH_INFO: `/v3/projects/da52a87991a4456b9c80d44b464e687e` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:09.179361 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515353ec-5640-4079-a506-b274d0168396 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da52a87991a4456b9c80d44b464e687e)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:42:09.181306 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515353ec-5640-4079-a506-b274d0168396 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:42:09.273780 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-515353ec-5640-4079-a506-b274d0168396 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da52a87991a4456b9c80d44b464e687e', 'request_id': 'req-515353ec-5640-4079-a506-b274d0168396'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:42:09.335851 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-515353ec-5640-4079-a506-b274d0168396 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da52a87991a4456b9c80d44b464e687e', 'request_id': 'req-515353ec-5640-4079-a506-b274d0168396'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:42:09.342489 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-515353ec-5640-4079-a506-b274d0168396 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da52a87991a4456b9c80d44b464e687e', 'request_id': 'req-515353ec-5640-4079-a506-b274d0168396'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:42:09.353774 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-515353ec-5640-4079-a506-b274d0168396 admin admin] The token cache is being invalidate because project da52a87991a4456b9c80d44b464e687e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:42:09.354059 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-515353ec-5640-4079-a506-b274d0168396 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:42:09.354694 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-515353ec-5640-4079-a506-b274d0168396 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:42:09.356547 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1168/2333] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:42:09 2022] DELETE /identity/v3/projects/da52a87991a4456b9c80d44b464e687e => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:42:09.361415 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658173d5-52b6-414e-9e86-13f70040daee None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:09.361882 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658173d5-52b6-414e-9e86-13f70040daee None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:09.362004 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658173d5-52b6-414e-9e86-13f70040daee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:09.380420 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-658173d5-52b6-414e-9e86-13f70040daee None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:42:09.381637 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-658173d5-52b6-414e-9e86-13f70040daee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:42:09.446541 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1166/2334] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:42:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:42:09.454541 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024357b-227b-40c0-9197-a3395d7c26ea None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:09.454834 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024357b-227b-40c0-9197-a3395d7c26ea None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:09.455113 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024357b-227b-40c0-9197-a3395d7c26ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:09.474905 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-b024357b-227b-40c0-9197-a3395d7c26ea None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:42:09.476113 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-b024357b-227b-40c0-9197-a3395d7c26ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:42:09.484732 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1169/2335] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:42:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:42:09.488948 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658173d5-52b6-414e-9e86-13f70040daee None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:42:09.498723 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658173d5-52b6-414e-9e86-13f70040daee None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:42:09.503709 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9230c5-34fc-443c-b6ee-bd8681e1a11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:42:09.504391 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9230c5-34fc-443c-b6ee-bd8681e1a11a admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:09.504673 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9230c5-34fc-443c-b6ee-bd8681e1a11a admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:09.504947 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9230c5-34fc-443c-b6ee-bd8681e1a11a admin admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:09.505712 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9230c5-34fc-443c-b6ee-bd8681e1a11a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:42:09.506021 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9230c5-34fc-443c-b6ee-bd8681e1a11a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:42:09.507627 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9230c5-34fc-443c-b6ee-bd8681e1a11a admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:42:09.520175 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1167/2336] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:42:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:42:09.530770 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b024357b-227b-40c0-9197-a3395d7c26ea None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:42:09.535838 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b024357b-227b-40c0-9197-a3395d7c26ea None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:42:09.540910 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13467a4-ef46-4454-be22-8e6c411943b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:42:09.541605 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13467a4-ef46-4454-be22-8e6c411943b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:09.541887 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13467a4-ef46-4454-be22-8e6c411943b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:09.542164 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13467a4-ef46-4454-be22-8e6c411943b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:09.543091 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13467a4-ef46-4454-be22-8e6c411943b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:42:09.544864 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13467a4-ef46-4454-be22-8e6c411943b5 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:42:09.632508 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1170/2337] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:42:09 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:42:09.633867 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9230c5-34fc-443c-b6ee-bd8681e1a11a admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:42:09.644839 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9230c5-34fc-443c-b6ee-bd8681e1a11a admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:42:09.701434 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080782ec-d9c1-46b1-a99e-40c80d5b2148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:42:09.702098 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080782ec-d9c1-46b1-a99e-40c80d5b2148 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:09.702377 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080782ec-d9c1-46b1-a99e-40c80d5b2148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:09.702645 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080782ec-d9c1-46b1-a99e-40c80d5b2148 admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:09.703324 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080782ec-d9c1-46b1-a99e-40c80d5b2148 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:42:09.705277 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080782ec-d9c1-46b1-a99e-40c80d5b2148 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:42:09.796481 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1168/2338] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:42:09 2022] POST /identity/v3/users => generated 287 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:42:09.797636 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13467a4-ef46-4454-be22-8e6c411943b5 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:42:09.808314 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13467a4-ef46-4454-be22-8e6c411943b5 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:42:09.814034 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee726ead-39ef-46e9-ba16-e6e7dc008001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:42:09.814691 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee726ead-39ef-46e9-ba16-e6e7dc008001 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:09.815105 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee726ead-39ef-46e9-ba16-e6e7dc008001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:09.815543 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee726ead-39ef-46e9-ba16-e6e7dc008001 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:09.816114 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee726ead-39ef-46e9-ba16-e6e7dc008001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:42:09.817752 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee726ead-39ef-46e9-ba16-e6e7dc008001 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:42:09.829172 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1171/2339] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:42:09.833569 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080782ec-d9c1-46b1-a99e-40c80d5b2148 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:42:09.844049 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080782ec-d9c1-46b1-a99e-40c80d5b2148 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:42:09.849011 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf0606-818d-4e0b-b444-5306c8a9398b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:42:09.849691 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf0606-818d-4e0b-b444-5306c8a9398b admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:09.849976 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf0606-818d-4e0b-b444-5306c8a9398b admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:09.850252 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf0606-818d-4e0b-b444-5306c8a9398b admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:09.850997 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cf0606-818d-4e0b-b444-5306c8a9398b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:42:09.852701 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cf0606-818d-4e0b-b444-5306c8a9398b admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:42:09.866924 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1169/2340] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:42:09.868319 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee726ead-39ef-46e9-ba16-e6e7dc008001 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:42:09.879179 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee726ead-39ef-46e9-ba16-e6e7dc008001 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:42:09.884276 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b6e49f-ce61-48ad-96dc-6a28017f8131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:42:09.885165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6e49f-ce61-48ad-96dc-6a28017f8131 admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:09.885453 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6e49f-ce61-48ad-96dc-6a28017f8131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:09.885738 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6e49f-ce61-48ad-96dc-6a28017f8131 admin admin] PATH_INFO: `/v3/projects/ee868d940c61441c9eb2ea07b9c87f29/users/66d47247e72c41e89de8e56f78fc9b1f/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:09.904119 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b6e49f-ce61-48ad-96dc-6a28017f8131 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee868d940c61441c9eb2ea07b9c87f29, user_id=66d47247e72c41e89de8e56f78fc9b1f, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:42:09.906817 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b6e49f-ce61-48ad-96dc-6a28017f8131 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:42:10.069285 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1172/2341] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:42:09 2022] PUT /identity/v3/projects/ee868d940c61441c9eb2ea07b9c87f29/users/66d47247e72c41e89de8e56f78fc9b1f/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:42:10.074842 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995b22e-6f1c-4a13-bfdf-d3d49986580e None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:10.075256 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995b22e-6f1c-4a13-bfdf-d3d49986580e None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:10.075577 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995b22e-6f1c-4a13-bfdf-d3d49986580e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:10.093525 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-e995b22e-6f1c-4a13-bfdf-d3d49986580e None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:42:10.094741 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-e995b22e-6f1c-4a13-bfdf-d3d49986580e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:42:10.121494 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:42:10.154529 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1170/2342] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:42:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 09:42:10.164426 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b6e49f-ce61-48ad-96dc-6a28017f8131 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:42:10.166141 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-74b6e49f-ce61-48ad-96dc-6a28017f8131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:42:10.230977 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b6e49f-ce61-48ad-96dc-6a28017f8131 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:42:10.235289 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2b5d0-4deb-4106-9d27-7ad8092fa133 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:42:10.236260 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2b5d0-4deb-4106-9d27-7ad8092fa133 service neutron] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:10.236679 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2b5d0-4deb-4106-9d27-7ad8092fa133 service neutron] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:10.237081 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2b5d0-4deb-4106-9d27-7ad8092fa133 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:10.251662 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e2b5d0-4deb-4106-9d27-7ad8092fa133 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:42:10.253139 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e2b5d0-4deb-4106-9d27-7ad8092fa133 service neutron] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:42:10.264674 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1173/2343] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:42:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:42:11.600488 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27d9c0-3926-4f3b-a982-477a8fc7b491 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:11.601019 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27d9c0-3926-4f3b-a982-477a8fc7b491 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:11.601118 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27d9c0-3926-4f3b-a982-477a8fc7b491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:11.630285 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-0d27d9c0-3926-4f3b-a982-477a8fc7b491 None None] MFA Rules not processed for user `66d47247e72c41e89de8e56f78fc9b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:42:11.631513 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-0d27d9c0-3926-4f3b-a982-477a8fc7b491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:42:11.710006 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1171/2344] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:42:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:42:11.714385 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2b5d0-4deb-4106-9d27-7ad8092fa133 service neutron] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:42:11.721633 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:42:11.727825 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2b5d0-4deb-4106-9d27-7ad8092fa133 service neutron] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:42:11.733764 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecafef5-1001-4e80-bd0e-f616fd9a70d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:42:11.734929 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecafef5-1001-4e80-bd0e-f616fd9a70d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:11.735294 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecafef5-1001-4e80-bd0e-f616fd9a70d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:11.735646 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecafef5-1001-4e80-bd0e-f616fd9a70d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:11.736464 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecafef5-1001-4e80-bd0e-f616fd9a70d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:42:11.738641 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecafef5-1001-4e80-bd0e-f616fd9a70d7 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:42:11.818666 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1174/2345] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:42:11 2022] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:42:11.822767 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d27d9c0-3926-4f3b-a982-477a8fc7b491 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:42:11.833687 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d27d9c0-3926-4f3b-a982-477a8fc7b491 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:42:11.893866 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f6730e-3c0a-484f-b71f-8e104dc741fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:42:11.894540 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6730e-3c0a-484f-b71f-8e104dc741fb admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:11.894850 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6730e-3c0a-484f-b71f-8e104dc741fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:11.895125 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6730e-3c0a-484f-b71f-8e104dc741fb admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:11.895819 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f6730e-3c0a-484f-b71f-8e104dc741fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:42:11.897869 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f6730e-3c0a-484f-b71f-8e104dc741fb admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:42:12.005011 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1172/2346] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:42:11 2022] POST /identity/v3/users => generated 292 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:42:12.009124 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecafef5-1001-4e80-bd0e-f616fd9a70d7 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:42:12.019871 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecafef5-1001-4e80-bd0e-f616fd9a70d7 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:42:12.024843 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c4098-858d-4e0d-8a24-4e23577cd057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:42:12.025294 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c4098-858d-4e0d-8a24-4e23577cd057 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:12.025553 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c4098-858d-4e0d-8a24-4e23577cd057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:12.025829 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c4098-858d-4e0d-8a24-4e23577cd057 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:12.026871 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c4098-858d-4e0d-8a24-4e23577cd057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:42:12.028171 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c4098-858d-4e0d-8a24-4e23577cd057 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:42:12.039775 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1175/2347] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:42:12.044066 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f6730e-3c0a-484f-b71f-8e104dc741fb admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:42:12.055055 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f6730e-3c0a-484f-b71f-8e104dc741fb admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:42:12.059763 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7be5c-458d-49f6-8497-d82b386a19da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:42:12.060712 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7be5c-458d-49f6-8497-d82b386a19da admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:12.060994 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7be5c-458d-49f6-8497-d82b386a19da admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:12.061269 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7be5c-458d-49f6-8497-d82b386a19da admin admin] PATH_INFO: `/v3/projects/9be6d17e3c624bc3b5052b542ac4bdf4/users/dec9f3c087a64132b900f18135a8a831/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:12.076359 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d7be5c-458d-49f6-8497-d82b386a19da admin admin] RBAC: Authorizing `identity:create_grant(project_id=9be6d17e3c624bc3b5052b542ac4bdf4, user_id=dec9f3c087a64132b900f18135a8a831, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:42:12.079000 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d7be5c-458d-49f6-8497-d82b386a19da admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:42:12.154758 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1173/2348] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:42:12 2022] PUT /identity/v3/projects/9be6d17e3c624bc3b5052b542ac4bdf4/users/dec9f3c087a64132b900f18135a8a831/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:42:12.158742 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c4098-858d-4e0d-8a24-4e23577cd057 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:42:12.170747 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c4098-858d-4e0d-8a24-4e23577cd057 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:42:12.231074 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ae25c-255e-4032-9657-23468ec39bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:42:12.231801 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ae25c-255e-4032-9657-23468ec39bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:12.232088 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ae25c-255e-4032-9657-23468ec39bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:12.232402 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ae25c-255e-4032-9657-23468ec39bd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:12.233131 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ae25c-255e-4032-9657-23468ec39bd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:42:12.234726 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ae25c-255e-4032-9657-23468ec39bd5 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:42:12.244871 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1176/2349] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:42:12.252914 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7be5c-458d-49f6-8497-d82b386a19da admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:42:12.263708 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7be5c-458d-49f6-8497-d82b386a19da admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:42:12.268260 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96cee0-a98b-43b8-a49c-092f7c110993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:42:12.269148 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96cee0-a98b-43b8-a49c-092f7c110993 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:12.273196 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96cee0-a98b-43b8-a49c-092f7c110993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:12.273196 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96cee0-a98b-43b8-a49c-092f7c110993 admin admin] PATH_INFO: `/v3/projects/9be6d17e3c624bc3b5052b542ac4bdf4/users/dec9f3c087a64132b900f18135a8a831/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:12.273196 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff96cee0-a98b-43b8-a49c-092f7c110993 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9be6d17e3c624bc3b5052b542ac4bdf4, user_id=dec9f3c087a64132b900f18135a8a831, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:42:12.274318 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff96cee0-a98b-43b8-a49c-092f7c110993 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:42:12.287310 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1174/2350] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:42:12 2022] PUT /identity/v3/projects/9be6d17e3c624bc3b5052b542ac4bdf4/users/dec9f3c087a64132b900f18135a8a831/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:42:12.726799 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b054e-12b6-4c2f-9a5a-f4e449ff566b None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:12.727315 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b054e-12b6-4c2f-9a5a-f4e449ff566b None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:12.727417 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b054e-12b6-4c2f-9a5a-f4e449ff566b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:12.745872 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-b00b054e-12b6-4c2f-9a5a-f4e449ff566b None None] MFA Rules not processed for user `4c30a14c11d24ff3bd270c8e865a55d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:42:12.747105 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-b00b054e-12b6-4c2f-9a5a-f4e449ff566b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:42:12.805600 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1177/2351] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:42:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:42:13.612808 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d90ea-4284-447d-984d-681e498c3ab2 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:13.613206 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d90ea-4284-447d-984d-681e498c3ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:13.613356 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d90ea-4284-447d-984d-681e498c3ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:13.656020 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:42:13.659840 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-ae1d90ea-4284-447d-984d-681e498c3ab2 None None] MFA Rules not processed for user `dec9f3c087a64132b900f18135a8a831`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:42:13.661099 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-ae1d90ea-4284-447d-984d-681e498c3ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:42:13.741541 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1175/2352] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:42:13 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:42:13.752333 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a024bb-426e-4ccf-9072-1e4aaad62738 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:13.752894 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a024bb-426e-4ccf-9072-1e4aaad62738 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:13.752894 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a024bb-426e-4ccf-9072-1e4aaad62738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:13.770091 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-31a024bb-426e-4ccf-9072-1e4aaad62738 None None] MFA Rules not processed for user `66d47247e72c41e89de8e56f78fc9b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:42:13.771285 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-31a024bb-426e-4ccf-9072-1e4aaad62738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:42:13.827036 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1178/2353] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:42:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:42:13.838173 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d90ea-4284-447d-984d-681e498c3ab2 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:42:13.839578 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-ae1d90ea-4284-447d-984d-681e498c3ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:42:13.916780 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d90ea-4284-447d-984d-681e498c3ab2 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:42:13.923097 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634f371-df49-4fd8-8108-4a89cbaac2cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:42:13.923765 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634f371-df49-4fd8-8108-4a89cbaac2cd service nova] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:13.924061 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634f371-df49-4fd8-8108-4a89cbaac2cd service nova] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:13.924338 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634f371-df49-4fd8-8108-4a89cbaac2cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:13.933565 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a634f371-df49-4fd8-8108-4a89cbaac2cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:42:13.935168 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a634f371-df49-4fd8-8108-4a89cbaac2cd service nova] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:42:13.945230 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1176/2354] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:42:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:42:23.819486 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=92,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:42:23.940922 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=62 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:42:34.648689 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a024bb-426e-4ccf-9072-1e4aaad62738 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:42:34.655151 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-31a024bb-426e-4ccf-9072-1e4aaad62738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:42:34.709118 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a024bb-426e-4ccf-9072-1e4aaad62738 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:42:34.712711 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8358038f-230b-47c9-bd29-2ebde649dc03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:42:34.713360 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358038f-230b-47c9-bd29-2ebde649dc03 service cinder] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:34.713636 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358038f-230b-47c9-bd29-2ebde649dc03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:34.713907 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358038f-230b-47c9-bd29-2ebde649dc03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:34.724166 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8358038f-230b-47c9-bd29-2ebde649dc03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:42:34.725670 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8358038f-230b-47c9-bd29-2ebde649dc03 service cinder] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:42:34.735625 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1179/2355] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:42:34 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:42:41.275714 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634f371-df49-4fd8-8108-4a89cbaac2cd service nova] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:42:41.278018 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-a634f371-df49-4fd8-8108-4a89cbaac2cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:42:41.358941 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634f371-df49-4fd8-8108-4a89cbaac2cd service nova] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:42:41.364067 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2473ee-e4a2-459d-a5ce-b77e459a3121 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbaf738138b40b2a06bb63934f6608c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:42:41.367073 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2473ee-e4a2-459d-a5ce-b77e459a3121 service placement] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:41.367073 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2473ee-e4a2-459d-a5ce-b77e459a3121 service placement] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:41.367073 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2473ee-e4a2-459d-a5ce-b77e459a3121 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:41.367073 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-0f2473ee-e4a2-459d-a5ce-b77e459a3121 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:42:41.378972 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2473ee-e4a2-459d-a5ce-b77e459a3121 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:42:41.380580 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2473ee-e4a2-459d-a5ce-b77e459a3121 service placement] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:42:41.390810 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1177/2356] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:42:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:42:44.731288 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=26 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:42:47.839919 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8358038f-230b-47c9-bd29-2ebde649dc03 service cinder] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:42:47.843193 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-8358038f-230b-47c9-bd29-2ebde649dc03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:42:47.902722 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8358038f-230b-47c9-bd29-2ebde649dc03 service cinder] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:42:47.906381 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4fb6a-505b-49b4-b3a7-591377b7aedf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:42:47.907027 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4fb6a-505b-49b4-b3a7-591377b7aedf service neutron] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:47.907315 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4fb6a-505b-49b4-b3a7-591377b7aedf service neutron] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:47.907593 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4fb6a-505b-49b4-b3a7-591377b7aedf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:47.909527 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-c1b4fb6a-505b-49b4-b3a7-591377b7aedf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:42:47.972787 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b4fb6a-505b-49b4-b3a7-591377b7aedf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:42:47.974262 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b4fb6a-505b-49b4-b3a7-591377b7aedf service neutron] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:42:47.984326 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1180/2357] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:42:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 09:42:51.386454 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=32 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:42:51.685202 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2473ee-e4a2-459d-a5ce-b77e459a3121 service placement] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:42:51.686568 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-0f2473ee-e4a2-459d-a5ce-b77e459a3121 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:42:51.701467 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2473ee-e4a2-459d-a5ce-b77e459a3121 service placement] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:42:51.711180 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef563a-e807-4364-878b-a9f84d514e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:42:51.711180 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef563a-e807-4364-878b-a9f84d514e7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:51.711180 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef563a-e807-4364-878b-a9f84d514e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:51.711180 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef563a-e807-4364-878b-a9f84d514e7d admin admin] PATH_INFO: `/v3/users/d67234e9868b4d34a1532b1aedf33221` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:51.711604 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef563a-e807-4364-878b-a9f84d514e7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d67234e9868b4d34a1532b1aedf33221)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:42:51.711969 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef563a-e807-4364-878b-a9f84d514e7d admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:42:51.897033 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-4bef563a-e807-4364-878b-a9f84d514e7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd67234e9868b4d34a1532b1aedf33221'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:42:51.904532 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-4bef563a-e807-4364-878b-a9f84d514e7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd67234e9868b4d34a1532b1aedf33221'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:42:51.998114 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-4bef563a-e807-4364-878b-a9f84d514e7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd67234e9868b4d34a1532b1aedf33221'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:42:51.998774 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-4bef563a-e807-4364-878b-a9f84d514e7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd67234e9868b4d34a1532b1aedf33221'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:42:52.026348 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-4bef563a-e807-4364-878b-a9f84d514e7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd67234e9868b4d34a1532b1aedf33221'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:42:52.040122 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1178/2358] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:42:51 2022] DELETE /identity/v3/users/d67234e9868b4d34a1532b1aedf33221 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:42:52.285460 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4fb6a-505b-49b4-b3a7-591377b7aedf service neutron] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:42:52.297208 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4fb6a-505b-49b4-b3a7-591377b7aedf service neutron] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:42:52.358012 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfcfa25-ce84-4305-89cb-74174674d055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:42:52.358899 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfcfa25-ce84-4305-89cb-74174674d055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:52.359180 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfcfa25-ce84-4305-89cb-74174674d055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:52.359455 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfcfa25-ce84-4305-89cb-74174674d055 admin admin] PATH_INFO: `/v3/projects/594feb4bfaf64c5598a7de46231a50f6` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:52.360871 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfcfa25-ce84-4305-89cb-74174674d055 admin admin] RBAC: Authorizing `identity:delete_project(project_id=594feb4bfaf64c5598a7de46231a50f6)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:42:52.362871 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfcfa25-ce84-4305-89cb-74174674d055 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:42:52.485115 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-8dfcfa25-ce84-4305-89cb-74174674d055 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '594feb4bfaf64c5598a7de46231a50f6', 'request_id': 'req-8dfcfa25-ce84-4305-89cb-74174674d055'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:42:52.487709 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:42:52.586735 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-8dfcfa25-ce84-4305-89cb-74174674d055 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '594feb4bfaf64c5598a7de46231a50f6', 'request_id': 'req-8dfcfa25-ce84-4305-89cb-74174674d055'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:42:52.592976 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-8dfcfa25-ce84-4305-89cb-74174674d055 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '594feb4bfaf64c5598a7de46231a50f6', 'request_id': 'req-8dfcfa25-ce84-4305-89cb-74174674d055'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:42:52.605340 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-8dfcfa25-ce84-4305-89cb-74174674d055 admin admin] The token cache is being invalidate because project 594feb4bfaf64c5598a7de46231a50f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:42:52.605623 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-8dfcfa25-ce84-4305-89cb-74174674d055 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:42:52.606267 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-8dfcfa25-ce84-4305-89cb-74174674d055 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:42:52.607866 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1181/2359] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:42:52 2022] DELETE /identity/v3/projects/594feb4bfaf64c5598a7de46231a50f6 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:42:52.612977 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571eea2-b5b2-4bac-b62d-d4ea507c37c3 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:52.613464 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571eea2-b5b2-4bac-b62d-d4ea507c37c3 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:52.613563 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571eea2-b5b2-4bac-b62d-d4ea507c37c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:52.632001 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-f571eea2-b5b2-4bac-b62d-d4ea507c37c3 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:42:52.633238 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-f571eea2-b5b2-4bac-b62d-d4ea507c37c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:42:52.694532 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1179/2360] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:42:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:42:52.702326 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68c50b-256f-46ee-81d8-ebaae427f30a None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:52.702619 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68c50b-256f-46ee-81d8-ebaae427f30a None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:52.702902 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68c50b-256f-46ee-81d8-ebaae427f30a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:52.726831 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-1a68c50b-256f-46ee-81d8-ebaae427f30a None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:42:52.728316 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-1a68c50b-256f-46ee-81d8-ebaae427f30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:42:52.737850 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1182/2361] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:42:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:42:52.742584 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f571eea2-b5b2-4bac-b62d-d4ea507c37c3 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:42:52.752228 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f571eea2-b5b2-4bac-b62d-d4ea507c37c3 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:42:52.757434 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096a2c0-8434-48bd-abfd-1de7150100f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:42:52.758346 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096a2c0-8434-48bd-abfd-1de7150100f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:52.758652 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096a2c0-8434-48bd-abfd-1de7150100f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:52.758978 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096a2c0-8434-48bd-abfd-1de7150100f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:52.759706 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1096a2c0-8434-48bd-abfd-1de7150100f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:42:52.760016 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1096a2c0-8434-48bd-abfd-1de7150100f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:42:52.761659 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1096a2c0-8434-48bd-abfd-1de7150100f2 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:42:52.778284 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1180/2362] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:42:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:42:52.779675 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68c50b-256f-46ee-81d8-ebaae427f30a None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:42:52.789896 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68c50b-256f-46ee-81d8-ebaae427f30a None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:42:52.794924 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ee688-e51f-4843-8cec-27fca453a2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:42:52.795536 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ee688-e51f-4843-8cec-27fca453a2fc admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:52.795808 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ee688-e51f-4843-8cec-27fca453a2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:52.796086 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ee688-e51f-4843-8cec-27fca453a2fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:52.796871 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139ee688-e51f-4843-8cec-27fca453a2fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:42:52.798802 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139ee688-e51f-4843-8cec-27fca453a2fc admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:42:52.891679 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1183/2363] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:42:52 2022] POST /identity/v3/projects => generated 375 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:42:52.895937 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096a2c0-8434-48bd-abfd-1de7150100f2 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:42:52.906437 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096a2c0-8434-48bd-abfd-1de7150100f2 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:42:52.961179 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c05f12-b39f-4476-a8ba-581c7e45d463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:42:52.961838 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c05f12-b39f-4476-a8ba-581c7e45d463 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:52.962117 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c05f12-b39f-4476-a8ba-581c7e45d463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:52.962388 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c05f12-b39f-4476-a8ba-581c7e45d463 admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:52.963078 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c05f12-b39f-4476-a8ba-581c7e45d463 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:42:52.965074 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c05f12-b39f-4476-a8ba-581c7e45d463 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:42:52.971948 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:42:53.093698 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1181/2364] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:42:52 2022] POST /identity/v3/users => generated 288 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:42:53.095251 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ee688-e51f-4843-8cec-27fca453a2fc admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:42:53.107024 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ee688-e51f-4843-8cec-27fca453a2fc admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:42:53.112411 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef035d8a-cdac-4dab-838c-84ed57889f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:42:53.113083 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef035d8a-cdac-4dab-838c-84ed57889f81 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:53.115156 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef035d8a-cdac-4dab-838c-84ed57889f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:53.115453 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef035d8a-cdac-4dab-838c-84ed57889f81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:53.116227 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef035d8a-cdac-4dab-838c-84ed57889f81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:42:53.117996 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef035d8a-cdac-4dab-838c-84ed57889f81 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:42:53.133401 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1184/2365] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:42:53.134963 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c05f12-b39f-4476-a8ba-581c7e45d463 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:42:53.145272 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c05f12-b39f-4476-a8ba-581c7e45d463 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:42:53.150552 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21bd3a-a771-4157-a9fb-45765896adb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:42:53.151244 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21bd3a-a771-4157-a9fb-45765896adb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:53.151530 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21bd3a-a771-4157-a9fb-45765896adb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:53.151831 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21bd3a-a771-4157-a9fb-45765896adb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:53.152587 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe21bd3a-a771-4157-a9fb-45765896adb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:42:53.154175 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe21bd3a-a771-4157-a9fb-45765896adb0 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:42:53.165688 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1182/2366] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:42:53.170040 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef035d8a-cdac-4dab-838c-84ed57889f81 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:42:53.180520 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef035d8a-cdac-4dab-838c-84ed57889f81 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:42:53.185705 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32baa6f7-2104-4044-a6ad-622820841664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:42:53.186580 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32baa6f7-2104-4044-a6ad-622820841664 admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:53.186865 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32baa6f7-2104-4044-a6ad-622820841664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:53.187154 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32baa6f7-2104-4044-a6ad-622820841664 admin admin] PATH_INFO: `/v3/projects/103ebc0a312f46a896dd72dbd70195e7/users/d5a05c275b3c4ba48416ffebab999319/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:53.202671 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32baa6f7-2104-4044-a6ad-622820841664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=103ebc0a312f46a896dd72dbd70195e7, user_id=d5a05c275b3c4ba48416ffebab999319, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:42:53.205707 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32baa6f7-2104-4044-a6ad-622820841664 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:42:53.284272 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1185/2367] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:42:53 2022] PUT /identity/v3/projects/103ebc0a312f46a896dd72dbd70195e7/users/d5a05c275b3c4ba48416ffebab999319/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:42:53.295478 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7b858-f92a-40cf-9ffa-8ffedc85589f None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:53.295764 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7b858-f92a-40cf-9ffa-8ffedc85589f None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:53.296085 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7b858-f92a-40cf-9ffa-8ffedc85589f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:53.323146 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-9eb7b858-f92a-40cf-9ffa-8ffedc85589f None None] MFA Rules not processed for user `d5a05c275b3c4ba48416ffebab999319`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:42:53.324616 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-9eb7b858-f92a-40cf-9ffa-8ffedc85589f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:42:53.390914 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1183/2368] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:42:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:42:53.403088 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32baa6f7-2104-4044-a6ad-622820841664 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:42:53.407093 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-32baa6f7-2104-4044-a6ad-622820841664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:42:53.481902 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32baa6f7-2104-4044-a6ad-622820841664 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:42:53.487512 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541cdd3d-9551-45ed-a387-990a6efa2685 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:42:53.488161 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541cdd3d-9551-45ed-a387-990a6efa2685 service nova] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:53.488477 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541cdd3d-9551-45ed-a387-990a6efa2685 service nova] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:53.488751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541cdd3d-9551-45ed-a387-990a6efa2685 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:53.496919 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541cdd3d-9551-45ed-a387-990a6efa2685 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:42:53.499946 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541cdd3d-9551-45ed-a387-990a6efa2685 service nova] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:42:53.516266 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1186/2369] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:42:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:42:53.768481 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7b858-f92a-40cf-9ffa-8ffedc85589f None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:42:53.826700 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7b858-f92a-40cf-9ffa-8ffedc85589f None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:42:53.831131 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45467878-2f2f-491f-9343-04b24e98b911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:42:53.832000 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45467878-2f2f-491f-9343-04b24e98b911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:53.832317 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45467878-2f2f-491f-9343-04b24e98b911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:53.832597 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45467878-2f2f-491f-9343-04b24e98b911 admin admin] PATH_INFO: `/v3/users/d5a05c275b3c4ba48416ffebab999319` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:53.834393 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45467878-2f2f-491f-9343-04b24e98b911 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5a05c275b3c4ba48416ffebab999319)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:42:53.836365 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45467878-2f2f-491f-9343-04b24e98b911 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:42:54.051692 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-45467878-2f2f-491f-9343-04b24e98b911 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5a05c275b3c4ba48416ffebab999319'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:42:54.059109 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-45467878-2f2f-491f-9343-04b24e98b911 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5a05c275b3c4ba48416ffebab999319'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:42:54.134727 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-45467878-2f2f-491f-9343-04b24e98b911 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5a05c275b3c4ba48416ffebab999319'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:42:54.135334 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-45467878-2f2f-491f-9343-04b24e98b911 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5a05c275b3c4ba48416ffebab999319'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:42:54.141363 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:42:54.148090 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-45467878-2f2f-491f-9343-04b24e98b911 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5a05c275b3c4ba48416ffebab999319'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:42:54.153999 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1184/2370] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:42:53 2022] DELETE /identity/v3/users/d5a05c275b3c4ba48416ffebab999319 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:42:54.162270 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca620570-6742-47d9-9cd6-ffe375a8328f None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:54.162556 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca620570-6742-47d9-9cd6-ffe375a8328f None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:54.162830 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca620570-6742-47d9-9cd6-ffe375a8328f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:54.181569 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-ca620570-6742-47d9-9cd6-ffe375a8328f None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:42:54.182825 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-ca620570-6742-47d9-9cd6-ffe375a8328f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:42:54.241382 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1187/2371] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:42:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:42:54.251742 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45467878-2f2f-491f-9343-04b24e98b911 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:42:54.253149 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-45467878-2f2f-491f-9343-04b24e98b911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:42:54.309656 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45467878-2f2f-491f-9343-04b24e98b911 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:42:54.313312 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc59997-17df-45a8-976f-1874b1afd9d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:42:54.313955 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc59997-17df-45a8-976f-1874b1afd9d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:54.314240 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc59997-17df-45a8-976f-1874b1afd9d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:54.314518 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc59997-17df-45a8-976f-1874b1afd9d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:54.325316 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc59997-17df-45a8-976f-1874b1afd9d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:42:54.326818 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc59997-17df-45a8-976f-1874b1afd9d3 service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:42:54.336390 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1185/2372] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:42:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:42:54.794606 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca620570-6742-47d9-9cd6-ffe375a8328f None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:42:54.796150 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-ca620570-6742-47d9-9cd6-ffe375a8328f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:42:54.805152 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:42:54.811895 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca620570-6742-47d9-9cd6-ffe375a8328f None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:42:54.816876 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a177212-acb1-42ae-ae02-468339b33073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:42:54.818515 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a177212-acb1-42ae-ae02-468339b33073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:54.819450 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a177212-acb1-42ae-ae02-468339b33073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:54.819705 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a177212-acb1-42ae-ae02-468339b33073 admin admin] PATH_INFO: `/v3/projects/103ebc0a312f46a896dd72dbd70195e7` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:54.821174 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a177212-acb1-42ae-ae02-468339b33073 admin admin] RBAC: Authorizing `identity:delete_project(project_id=103ebc0a312f46a896dd72dbd70195e7)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:42:54.823112 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a177212-acb1-42ae-ae02-468339b33073 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:42:54.982643 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-9a177212-acb1-42ae-ae02-468339b33073 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '103ebc0a312f46a896dd72dbd70195e7', 'request_id': 'req-9a177212-acb1-42ae-ae02-468339b33073'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:42:55.238294 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-9a177212-acb1-42ae-ae02-468339b33073 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '103ebc0a312f46a896dd72dbd70195e7', 'request_id': 'req-9a177212-acb1-42ae-ae02-468339b33073'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:42:55.244663 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-9a177212-acb1-42ae-ae02-468339b33073 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '103ebc0a312f46a896dd72dbd70195e7', 'request_id': 'req-9a177212-acb1-42ae-ae02-468339b33073'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:42:55.257899 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-9a177212-acb1-42ae-ae02-468339b33073 admin admin] The token cache is being invalidate because project 103ebc0a312f46a896dd72dbd70195e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:42:55.258202 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-9a177212-acb1-42ae-ae02-468339b33073 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:42:55.258834 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-9a177212-acb1-42ae-ae02-468339b33073 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:42:55.260448 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1188/2373] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:42:54 2022] DELETE /identity/v3/projects/103ebc0a312f46a896dd72dbd70195e7 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:42:55.265474 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fa5e9-d92a-4a0e-b42c-92c5b22abe90 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:55.265991 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fa5e9-d92a-4a0e-b42c-92c5b22abe90 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:55.266101 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fa5e9-d92a-4a0e-b42c-92c5b22abe90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:55.285207 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-336fa5e9-d92a-4a0e-b42c-92c5b22abe90 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:42:55.286447 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-336fa5e9-d92a-4a0e-b42c-92c5b22abe90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:42:55.358774 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1186/2374] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:42:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 09:42:55.366995 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2454be-5a1e-4139-9744-a8ed65edc03d None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:55.367284 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2454be-5a1e-4139-9744-a8ed65edc03d None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:55.367559 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2454be-5a1e-4139-9744-a8ed65edc03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:55.386255 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-9e2454be-5a1e-4139-9744-a8ed65edc03d None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:42:55.391787 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-9e2454be-5a1e-4139-9744-a8ed65edc03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:42:55.395199 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1189/2375] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:42:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:42:55.400123 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336fa5e9-d92a-4a0e-b42c-92c5b22abe90 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:42:55.409889 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336fa5e9-d92a-4a0e-b42c-92c5b22abe90 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:42:55.414481 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d803d8b-f3a5-41c2-a226-a65b41b94cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:42:55.415151 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d803d8b-f3a5-41c2-a226-a65b41b94cdf admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:55.415431 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d803d8b-f3a5-41c2-a226-a65b41b94cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:55.415699 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d803d8b-f3a5-41c2-a226-a65b41b94cdf admin admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:55.416443 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d803d8b-f3a5-41c2-a226-a65b41b94cdf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:42:55.416756 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d803d8b-f3a5-41c2-a226-a65b41b94cdf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:42:55.418382 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d803d8b-f3a5-41c2-a226-a65b41b94cdf admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:42:55.431297 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1187/2376] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:42:55.435900 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2454be-5a1e-4139-9744-a8ed65edc03d None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:42:55.446044 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2454be-5a1e-4139-9744-a8ed65edc03d None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:42:55.450741 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833be3e-4acf-4745-837f-a694121e1025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:42:55.451396 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833be3e-4acf-4745-837f-a694121e1025 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:55.451679 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833be3e-4acf-4745-837f-a694121e1025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:55.451955 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833be3e-4acf-4745-837f-a694121e1025 admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:55.452689 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b833be3e-4acf-4745-837f-a694121e1025 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:42:55.454653 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b833be3e-4acf-4745-837f-a694121e1025 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:42:55.554702 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1190/2377] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:42:55 2022] POST /identity/v3/projects => generated 367 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:42:55.559017 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d803d8b-f3a5-41c2-a226-a65b41b94cdf admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:42:55.569661 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d803d8b-f3a5-41c2-a226-a65b41b94cdf admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:42:55.626144 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b5ed4-badb-441f-a72a-e955d24b9c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:42:55.626794 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b5ed4-badb-441f-a72a-e955d24b9c4b admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:55.627107 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b5ed4-badb-441f-a72a-e955d24b9c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:55.627377 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b5ed4-badb-441f-a72a-e955d24b9c4b admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:55.628063 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17b5ed4-badb-441f-a72a-e955d24b9c4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:42:55.630010 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17b5ed4-badb-441f-a72a-e955d24b9c4b admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:42:55.718543 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1188/2378] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:42:55 2022] POST /identity/v3/users => generated 284 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:42:55.722592 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833be3e-4acf-4745-837f-a694121e1025 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:42:55.733241 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833be3e-4acf-4745-837f-a694121e1025 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:42:55.738029 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f61e14-b038-42cf-b6f0-d50523a76f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:42:55.738681 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f61e14-b038-42cf-b6f0-d50523a76f4a admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:55.738962 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f61e14-b038-42cf-b6f0-d50523a76f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:55.739241 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f61e14-b038-42cf-b6f0-d50523a76f4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:55.740591 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f61e14-b038-42cf-b6f0-d50523a76f4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:42:55.744859 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f61e14-b038-42cf-b6f0-d50523a76f4a admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:42:55.752711 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1191/2379] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:42:55.757741 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b5ed4-badb-441f-a72a-e955d24b9c4b admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:42:55.767566 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b5ed4-badb-441f-a72a-e955d24b9c4b admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:42:55.772749 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a676af7-63e8-42ac-aae8-16f159316863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:42:55.773534 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a676af7-63e8-42ac-aae8-16f159316863 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:55.773726 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a676af7-63e8-42ac-aae8-16f159316863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:55.774014 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a676af7-63e8-42ac-aae8-16f159316863 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:55.774752 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a676af7-63e8-42ac-aae8-16f159316863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:42:55.776343 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a676af7-63e8-42ac-aae8-16f159316863 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:42:55.777629 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:42:55.787969 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1189/2380] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:42:55.792271 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f61e14-b038-42cf-b6f0-d50523a76f4a admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:42:55.802266 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f61e14-b038-42cf-b6f0-d50523a76f4a admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:42:55.807023 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb21c6b-60fc-46b5-8f3a-808fda242470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:42:55.807904 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb21c6b-60fc-46b5-8f3a-808fda242470 admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:55.808205 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb21c6b-60fc-46b5-8f3a-808fda242470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:55.808499 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb21c6b-60fc-46b5-8f3a-808fda242470 admin admin] PATH_INFO: `/v3/projects/bf20a56e7e884fbba9760a750cb66590/users/e68ffa4ee74041948cdcc46884ccb658/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:55.823823 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb21c6b-60fc-46b5-8f3a-808fda242470 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf20a56e7e884fbba9760a750cb66590, user_id=e68ffa4ee74041948cdcc46884ccb658, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:42:55.826621 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb21c6b-60fc-46b5-8f3a-808fda242470 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:42:55.907733 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1192/2381] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:42:55 2022] PUT /identity/v3/projects/bf20a56e7e884fbba9760a750cb66590/users/e68ffa4ee74041948cdcc46884ccb658/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:42:55.918243 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d722f-5504-413e-b96f-3df585432b13 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:55.918554 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d722f-5504-413e-b96f-3df585432b13 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:55.918825 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d722f-5504-413e-b96f-3df585432b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:55.945724 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-7e8d722f-5504-413e-b96f-3df585432b13 None None] MFA Rules not processed for user `e68ffa4ee74041948cdcc46884ccb658`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:42:55.946924 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-7e8d722f-5504-413e-b96f-3df585432b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:42:56.013292 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1190/2382] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:42:55 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 09:42:56.017765 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb21c6b-60fc-46b5-8f3a-808fda242470 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:42:56.081990 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb21c6b-60fc-46b5-8f3a-808fda242470 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:42:56.087388 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119852f8-da18-4f54-abfe-7eaf4bac0560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:42:56.088083 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119852f8-da18-4f54-abfe-7eaf4bac0560 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:56.088390 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119852f8-da18-4f54-abfe-7eaf4bac0560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:56.088666 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119852f8-da18-4f54-abfe-7eaf4bac0560 admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:56.089368 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119852f8-da18-4f54-abfe-7eaf4bac0560 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:42:56.091273 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119852f8-da18-4f54-abfe-7eaf4bac0560 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:42:56.175994 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1193/2383] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:42:56 2022] POST /identity/v3/projects => generated 369 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:42:56.180558 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d722f-5504-413e-b96f-3df585432b13 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:42:56.191268 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d722f-5504-413e-b96f-3df585432b13 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:42:56.248727 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1eded8-fdf1-4b52-8ead-c2c57e3cdbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:42:56.249402 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1eded8-fdf1-4b52-8ead-c2c57e3cdbc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:56.249685 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1eded8-fdf1-4b52-8ead-c2c57e3cdbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:56.249964 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1eded8-fdf1-4b52-8ead-c2c57e3cdbc9 admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:56.250658 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1eded8-fdf1-4b52-8ead-c2c57e3cdbc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:42:56.252618 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1eded8-fdf1-4b52-8ead-c2c57e3cdbc9 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:42:56.372364 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1191/2384] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:42:56 2022] POST /identity/v3/users => generated 291 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:42:56.376350 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119852f8-da18-4f54-abfe-7eaf4bac0560 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:42:56.387274 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119852f8-da18-4f54-abfe-7eaf4bac0560 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:42:56.392209 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6cf21-f99c-4aac-9e8d-e7161246ad98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:42:56.392886 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6cf21-f99c-4aac-9e8d-e7161246ad98 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:56.393178 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6cf21-f99c-4aac-9e8d-e7161246ad98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:56.393454 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6cf21-f99c-4aac-9e8d-e7161246ad98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:56.394183 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd6cf21-f99c-4aac-9e8d-e7161246ad98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:42:56.395774 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd6cf21-f99c-4aac-9e8d-e7161246ad98 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:42:56.397806 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:42:56.413768 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1194/2385] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:42:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 09:42:56.416714 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1eded8-fdf1-4b52-8ead-c2c57e3cdbc9 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:42:56.427239 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1eded8-fdf1-4b52-8ead-c2c57e3cdbc9 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:42:56.432295 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a34024-a02a-40d1-baa3-22285596b895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:42:56.433192 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a34024-a02a-40d1-baa3-22285596b895 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:56.433478 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a34024-a02a-40d1-baa3-22285596b895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:56.433757 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a34024-a02a-40d1-baa3-22285596b895 admin admin] PATH_INFO: `/v3/projects/58b957fdae1a46219fdde097d5c36ec8/users/019182085fda4e92a817481cc1042df5/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:56.451060 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a34024-a02a-40d1-baa3-22285596b895 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58b957fdae1a46219fdde097d5c36ec8, user_id=019182085fda4e92a817481cc1042df5, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:42:56.453835 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a34024-a02a-40d1-baa3-22285596b895 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:42:56.552486 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1192/2386] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:42:56 2022] PUT /identity/v3/projects/58b957fdae1a46219fdde097d5c36ec8/users/019182085fda4e92a817481cc1042df5/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:42:56.556483 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6cf21-f99c-4aac-9e8d-e7161246ad98 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:42:56.566381 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6cf21-f99c-4aac-9e8d-e7161246ad98 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:42:56.623138 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37e7c2-1d5d-4267-80f4-26dc1f670d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:42:56.623807 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37e7c2-1d5d-4267-80f4-26dc1f670d8c admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:56.624105 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37e7c2-1d5d-4267-80f4-26dc1f670d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:56.624429 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37e7c2-1d5d-4267-80f4-26dc1f670d8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:56.625151 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e37e7c2-1d5d-4267-80f4-26dc1f670d8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:42:56.626738 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e37e7c2-1d5d-4267-80f4-26dc1f670d8c admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:42:56.637055 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1195/2387] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:42:56 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:42:56.641269 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a34024-a02a-40d1-baa3-22285596b895 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:42:56.653048 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a34024-a02a-40d1-baa3-22285596b895 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:42:56.657708 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b996cb-1bcb-4a42-8237-4ea06446c95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:42:56.658624 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b996cb-1bcb-4a42-8237-4ea06446c95a admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:56.658909 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b996cb-1bcb-4a42-8237-4ea06446c95a admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:56.659184 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b996cb-1bcb-4a42-8237-4ea06446c95a admin admin] PATH_INFO: `/v3/projects/58b957fdae1a46219fdde097d5c36ec8/users/019182085fda4e92a817481cc1042df5/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:56.661212 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b996cb-1bcb-4a42-8237-4ea06446c95a admin admin] RBAC: Authorizing `identity:create_grant(project_id=58b957fdae1a46219fdde097d5c36ec8, user_id=019182085fda4e92a817481cc1042df5, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:42:56.663843 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b996cb-1bcb-4a42-8237-4ea06446c95a admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:42:56.674598 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1193/2388] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:42:56 2022] PUT /identity/v3/projects/58b957fdae1a46219fdde097d5c36ec8/users/019182085fda4e92a817481cc1042df5/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:42:56.686354 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c1ae80-115b-4a1c-bec1-45130f2fb552 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:56.686647 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c1ae80-115b-4a1c-bec1-45130f2fb552 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:56.687015 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c1ae80-115b-4a1c-bec1-45130f2fb552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:56.714350 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-65c1ae80-115b-4a1c-bec1-45130f2fb552 None None] MFA Rules not processed for user `019182085fda4e92a817481cc1042df5`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:42:56.715576 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-65c1ae80-115b-4a1c-bec1-45130f2fb552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:42:56.785648 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1196/2389] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:42:56 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:42:56.796490 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b996cb-1bcb-4a42-8237-4ea06446c95a admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:42:56.798253 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-b6b996cb-1bcb-4a42-8237-4ea06446c95a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:42:56.841507 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:42:56.856940 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b996cb-1bcb-4a42-8237-4ea06446c95a admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:42:56.860875 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699de83-a378-49ad-a042-fa13a437a049 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:42:56.861513 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699de83-a378-49ad-a042-fa13a437a049 service cinder] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:42:56.861795 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699de83-a378-49ad-a042-fa13a437a049 service cinder] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:42:56.862068 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699de83-a378-49ad-a042-fa13a437a049 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:42:56.871246 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a699de83-a378-49ad-a042-fa13a437a049 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:42:56.872706 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a699de83-a378-49ad-a042-fa13a437a049 service cinder] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:42:56.882774 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1194/2390] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:42:56 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 09:43:00.010706 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c1ae80-115b-4a1c-bec1-45130f2fb552 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:00.082989 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c1ae80-115b-4a1c-bec1-45130f2fb552 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:00.087873 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eee5f6-6c11-4bd7-bcd3-2894c414b313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:00.088617 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eee5f6-6c11-4bd7-bcd3-2894c414b313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:00.088900 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eee5f6-6c11-4bd7-bcd3-2894c414b313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:00.089175 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eee5f6-6c11-4bd7-bcd3-2894c414b313 admin admin] PATH_INFO: `/v3/users/e68ffa4ee74041948cdcc46884ccb658` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:00.090372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eee5f6-6c11-4bd7-bcd3-2894c414b313 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e68ffa4ee74041948cdcc46884ccb658)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:00.092353 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eee5f6-6c11-4bd7-bcd3-2894c414b313 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:00.114654 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:43:00.279842 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-04eee5f6-6c11-4bd7-bcd3-2894c414b313 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e68ffa4ee74041948cdcc46884ccb658'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:00.280625 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-04eee5f6-6c11-4bd7-bcd3-2894c414b313 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e68ffa4ee74041948cdcc46884ccb658'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:00.345849 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-04eee5f6-6c11-4bd7-bcd3-2894c414b313 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e68ffa4ee74041948cdcc46884ccb658'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:00.346494 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-04eee5f6-6c11-4bd7-bcd3-2894c414b313 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e68ffa4ee74041948cdcc46884ccb658'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:00.355121 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-04eee5f6-6c11-4bd7-bcd3-2894c414b313 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e68ffa4ee74041948cdcc46884ccb658'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:00.390090 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1197/2391] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:43:00 2022] DELETE /identity/v3/users/e68ffa4ee74041948cdcc46884ccb658 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:43:00.390234 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90455a-5c0b-48d2-976f-884560e3c8ae None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:00.390234 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90455a-5c0b-48d2-976f-884560e3c8ae None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:00.390234 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90455a-5c0b-48d2-976f-884560e3c8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:00.395606 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-0e90455a-5c0b-48d2-976f-884560e3c8ae None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:43:00.396847 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-0e90455a-5c0b-48d2-976f-884560e3c8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:00.456759 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1195/2392] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:43:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:43:00.466475 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eee5f6-6c11-4bd7-bcd3-2894c414b313 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:00.467969 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-04eee5f6-6c11-4bd7-bcd3-2894c414b313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:00.526164 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eee5f6-6c11-4bd7-bcd3-2894c414b313 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:00.530036 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541aa17e-32dd-4b57-a3ee-e0079650ae6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:00.530857 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541aa17e-32dd-4b57-a3ee-e0079650ae6a service neutron] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:00.531001 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541aa17e-32dd-4b57-a3ee-e0079650ae6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:00.531256 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541aa17e-32dd-4b57-a3ee-e0079650ae6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:00.541091 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541aa17e-32dd-4b57-a3ee-e0079650ae6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:00.542633 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541aa17e-32dd-4b57-a3ee-e0079650ae6a service neutron] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:00.552649 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1198/2393] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:43:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:43:00.936103 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90455a-5c0b-48d2-976f-884560e3c8ae None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:00.937671 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-0e90455a-5c0b-48d2-976f-884560e3c8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:00.952767 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90455a-5c0b-48d2-976f-884560e3c8ae None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:00.957895 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e8455-8ab3-4f84-873b-dbad9c514d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:00.958762 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e8455-8ab3-4f84-873b-dbad9c514d77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:00.959045 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e8455-8ab3-4f84-873b-dbad9c514d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:00.959322 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e8455-8ab3-4f84-873b-dbad9c514d77 admin admin] PATH_INFO: `/v3/projects/bf20a56e7e884fbba9760a750cb66590` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:00.961854 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501e8455-8ab3-4f84-873b-dbad9c514d77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf20a56e7e884fbba9760a750cb66590)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:00.964140 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501e8455-8ab3-4f84-873b-dbad9c514d77 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:01.078626 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-501e8455-8ab3-4f84-873b-dbad9c514d77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf20a56e7e884fbba9760a750cb66590', 'request_id': 'req-501e8455-8ab3-4f84-873b-dbad9c514d77'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:01.157795 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-501e8455-8ab3-4f84-873b-dbad9c514d77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf20a56e7e884fbba9760a750cb66590', 'request_id': 'req-501e8455-8ab3-4f84-873b-dbad9c514d77'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:01.163840 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-501e8455-8ab3-4f84-873b-dbad9c514d77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf20a56e7e884fbba9760a750cb66590', 'request_id': 'req-501e8455-8ab3-4f84-873b-dbad9c514d77'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:01.174842 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-501e8455-8ab3-4f84-873b-dbad9c514d77 admin admin] The token cache is being invalidate because project bf20a56e7e884fbba9760a750cb66590 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:43:01.175148 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-501e8455-8ab3-4f84-873b-dbad9c514d77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:01.175772 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-501e8455-8ab3-4f84-873b-dbad9c514d77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:01.177407 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1196/2394] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:43:00 2022] DELETE /identity/v3/projects/bf20a56e7e884fbba9760a750cb66590 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:43:01.181409 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541aa17e-32dd-4b57-a3ee-e0079650ae6a service neutron] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:01.191029 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541aa17e-32dd-4b57-a3ee-e0079650ae6a service neutron] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:01.247346 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ff044-9838-457d-a139-66835abb9788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:01.248218 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ff044-9838-457d-a139-66835abb9788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:01.248519 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ff044-9838-457d-a139-66835abb9788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:01.248791 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ff044-9838-457d-a139-66835abb9788 admin admin] PATH_INFO: `/v3/users/019182085fda4e92a817481cc1042df5` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:01.249979 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ff044-9838-457d-a139-66835abb9788 admin admin] RBAC: Authorizing `identity:delete_user(user_id=019182085fda4e92a817481cc1042df5)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:01.251894 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ff044-9838-457d-a139-66835abb9788 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:01.410146 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:43:01.416079 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-4d4ff044-9838-457d-a139-66835abb9788 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '019182085fda4e92a817481cc1042df5'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:01.416808 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-4d4ff044-9838-457d-a139-66835abb9788 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '019182085fda4e92a817481cc1042df5'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:01.477309 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-4d4ff044-9838-457d-a139-66835abb9788 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '019182085fda4e92a817481cc1042df5'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:01.477967 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-4d4ff044-9838-457d-a139-66835abb9788 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '019182085fda4e92a817481cc1042df5'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:01.486087 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-4d4ff044-9838-457d-a139-66835abb9788 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '019182085fda4e92a817481cc1042df5'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:01.504213 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1199/2395] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:43:01 2022] DELETE /identity/v3/users/019182085fda4e92a817481cc1042df5 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:43:01.952628 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e8455-8ab3-4f84-873b-dbad9c514d77 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:01.954137 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-501e8455-8ab3-4f84-873b-dbad9c514d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:01.967063 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e8455-8ab3-4f84-873b-dbad9c514d77 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:02.027103 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9216e0-ed71-43ff-800e-dcdfe384e1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:02.027949 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9216e0-ed71-43ff-800e-dcdfe384e1cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:02.028261 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9216e0-ed71-43ff-800e-dcdfe384e1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:02.028539 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9216e0-ed71-43ff-800e-dcdfe384e1cb admin admin] PATH_INFO: `/v3/projects/58b957fdae1a46219fdde097d5c36ec8` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:02.029724 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9216e0-ed71-43ff-800e-dcdfe384e1cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=58b957fdae1a46219fdde097d5c36ec8)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:02.031674 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9216e0-ed71-43ff-800e-dcdfe384e1cb admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:02.037936 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:43:02.165945 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-bf9216e0-ed71-43ff-800e-dcdfe384e1cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58b957fdae1a46219fdde097d5c36ec8', 'request_id': 'req-bf9216e0-ed71-43ff-800e-dcdfe384e1cb'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:02.250076 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-bf9216e0-ed71-43ff-800e-dcdfe384e1cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58b957fdae1a46219fdde097d5c36ec8', 'request_id': 'req-bf9216e0-ed71-43ff-800e-dcdfe384e1cb'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:02.256095 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-bf9216e0-ed71-43ff-800e-dcdfe384e1cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58b957fdae1a46219fdde097d5c36ec8', 'request_id': 'req-bf9216e0-ed71-43ff-800e-dcdfe384e1cb'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:02.267760 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-bf9216e0-ed71-43ff-800e-dcdfe384e1cb admin admin] The token cache is being invalidate because project 58b957fdae1a46219fdde097d5c36ec8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:43:02.268046 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-bf9216e0-ed71-43ff-800e-dcdfe384e1cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:02.268736 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-bf9216e0-ed71-43ff-800e-dcdfe384e1cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:02.270299 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1197/2396] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:43:01 2022] DELETE /identity/v3/projects/58b957fdae1a46219fdde097d5c36ec8 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:43:02.275803 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302fc28-b124-42f7-85e4-46dee5d5fe1d None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:02.276288 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302fc28-b124-42f7-85e4-46dee5d5fe1d None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:02.276468 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302fc28-b124-42f7-85e4-46dee5d5fe1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:02.295716 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-d302fc28-b124-42f7-85e4-46dee5d5fe1d None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:43:02.296997 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-d302fc28-b124-42f7-85e4-46dee5d5fe1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:02.355858 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1200/2397] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:43:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:43:02.364133 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4e68e-af23-4cee-a803-9ccfe0e83371 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:02.364450 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4e68e-af23-4cee-a803-9ccfe0e83371 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:02.364727 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4e68e-af23-4cee-a803-9ccfe0e83371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:02.383265 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-23e4e68e-af23-4cee-a803-9ccfe0e83371 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:43:02.384492 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-23e4e68e-af23-4cee-a803-9ccfe0e83371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:02.392326 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1198/2398] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:43:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:43:02.396801 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302fc28-b124-42f7-85e4-46dee5d5fe1d None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:02.407352 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302fc28-b124-42f7-85e4-46dee5d5fe1d None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:02.412142 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc7090-9fff-4417-8c1d-983bbf307589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:02.412840 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc7090-9fff-4417-8c1d-983bbf307589 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:02.413126 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc7090-9fff-4417-8c1d-983bbf307589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:02.413407 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc7090-9fff-4417-8c1d-983bbf307589 admin admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:02.414775 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dc7090-9fff-4417-8c1d-983bbf307589 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:43:02.415084 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dc7090-9fff-4417-8c1d-983bbf307589 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:02.416724 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dc7090-9fff-4417-8c1d-983bbf307589 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:02.428948 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1201/2399] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:43:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:43:02.433486 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e4e68e-af23-4cee-a803-9ccfe0e83371 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:02.442693 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e4e68e-af23-4cee-a803-9ccfe0e83371 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:02.447339 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b067a-dbf6-4356-a2fd-4f193edbacde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:02.447982 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b067a-dbf6-4356-a2fd-4f193edbacde admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:02.448293 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b067a-dbf6-4356-a2fd-4f193edbacde admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:02.448563 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b067a-dbf6-4356-a2fd-4f193edbacde admin admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:02.449260 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b067a-dbf6-4356-a2fd-4f193edbacde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:02.451145 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b067a-dbf6-4356-a2fd-4f193edbacde admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:02.593462 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1199/2400] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:43:02 2022] POST /identity/v3/projects => generated 375 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:43:02.597559 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc7090-9fff-4417-8c1d-983bbf307589 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:02.607859 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc7090-9fff-4417-8c1d-983bbf307589 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:02.668016 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0787c1-e497-4fdb-8cad-d6f7102c79a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:02.668733 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0787c1-e497-4fdb-8cad-d6f7102c79a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:02.669017 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0787c1-e497-4fdb-8cad-d6f7102c79a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:02.669304 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0787c1-e497-4fdb-8cad-d6f7102c79a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:02.670018 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0787c1-e497-4fdb-8cad-d6f7102c79a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:02.671955 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0787c1-e497-4fdb-8cad-d6f7102c79a5 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:02.795895 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1202/2401] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:43:02 2022] POST /identity/v3/users => generated 288 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:43:02.797472 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b067a-dbf6-4356-a2fd-4f193edbacde admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:02.808111 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b067a-dbf6-4356-a2fd-4f193edbacde admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:02.813353 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203fbc8a-f5ba-41fb-a6e3-55138f2bc431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:02.813939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203fbc8a-f5ba-41fb-a6e3-55138f2bc431 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:02.818281 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203fbc8a-f5ba-41fb-a6e3-55138f2bc431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:02.818281 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203fbc8a-f5ba-41fb-a6e3-55138f2bc431 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:02.818281 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203fbc8a-f5ba-41fb-a6e3-55138f2bc431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:02.818281 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203fbc8a-f5ba-41fb-a6e3-55138f2bc431 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:02.828444 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1200/2402] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:43:02.832682 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0787c1-e497-4fdb-8cad-d6f7102c79a5 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:02.843370 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0787c1-e497-4fdb-8cad-d6f7102c79a5 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:02.848109 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb2633-ded1-4369-863a-bc5f7e4ccb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:02.848722 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb2633-ded1-4369-863a-bc5f7e4ccb28 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:02.849010 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb2633-ded1-4369-863a-bc5f7e4ccb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:02.849287 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb2633-ded1-4369-863a-bc5f7e4ccb28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:02.850017 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecb2633-ded1-4369-863a-bc5f7e4ccb28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:02.851609 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecb2633-ded1-4369-863a-bc5f7e4ccb28 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:02.861872 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1203/2403] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:43:02.869996 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203fbc8a-f5ba-41fb-a6e3-55138f2bc431 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:02.879940 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203fbc8a-f5ba-41fb-a6e3-55138f2bc431 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:02.885433 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe16a70-9ce9-4f14-82b9-102e2e5ad680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:02.886018 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe16a70-9ce9-4f14-82b9-102e2e5ad680 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:02.886299 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe16a70-9ce9-4f14-82b9-102e2e5ad680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:02.886575 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe16a70-9ce9-4f14-82b9-102e2e5ad680 admin admin] PATH_INFO: `/v3/projects/7a8feb2091364b11a0b7ce3c5b987e73/users/1a2ed4cf77414eb5bf9d2eb155bd6040/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:02.902723 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe16a70-9ce9-4f14-82b9-102e2e5ad680 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a8feb2091364b11a0b7ce3c5b987e73, user_id=1a2ed4cf77414eb5bf9d2eb155bd6040, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:02.905445 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe16a70-9ce9-4f14-82b9-102e2e5ad680 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:03.010517 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1201/2404] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:43:02 2022] PUT /identity/v3/projects/7a8feb2091364b11a0b7ce3c5b987e73/users/1a2ed4cf77414eb5bf9d2eb155bd6040/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:43:03.029713 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466896f8-9f54-407f-b8cc-7a0cd96e33f7 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:03.030062 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466896f8-9f54-407f-b8cc-7a0cd96e33f7 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:03.033303 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466896f8-9f54-407f-b8cc-7a0cd96e33f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:03.067464 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-466896f8-9f54-407f-b8cc-7a0cd96e33f7 None None] MFA Rules not processed for user `1a2ed4cf77414eb5bf9d2eb155bd6040`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:43:03.068730 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-466896f8-9f54-407f-b8cc-7a0cd96e33f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:03.081840 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:43:03.142245 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1204/2405] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:43:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:43:03.147207 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe16a70-9ce9-4f14-82b9-102e2e5ad680 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:03.177352 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466896f8-9f54-407f-b8cc-7a0cd96e33f7 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:03.179135 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-466896f8-9f54-407f-b8cc-7a0cd96e33f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:03.217606 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe16a70-9ce9-4f14-82b9-102e2e5ad680 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:03.223483 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d915e49-6fe2-415c-83cc-2f3b4159bf58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:03.224171 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d915e49-6fe2-415c-83cc-2f3b4159bf58 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:03.224468 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d915e49-6fe2-415c-83cc-2f3b4159bf58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:03.224746 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d915e49-6fe2-415c-83cc-2f3b4159bf58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:03.225574 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d915e49-6fe2-415c-83cc-2f3b4159bf58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:03.228123 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d915e49-6fe2-415c-83cc-2f3b4159bf58 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:03.258298 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466896f8-9f54-407f-b8cc-7a0cd96e33f7 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:03.263413 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3714ee12-c1c6-448c-b59c-13b0da19a2cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbaf738138b40b2a06bb63934f6608c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:03.264065 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714ee12-c1c6-448c-b59c-13b0da19a2cc service placement] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:03.264379 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714ee12-c1c6-448c-b59c-13b0da19a2cc service placement] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:03.264656 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714ee12-c1c6-448c-b59c-13b0da19a2cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:03.266463 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-3714ee12-c1c6-448c-b59c-13b0da19a2cc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:03.278538 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3714ee12-c1c6-448c-b59c-13b0da19a2cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:03.280140 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3714ee12-c1c6-448c-b59c-13b0da19a2cc service placement] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:03.290379 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1205/2406] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:43:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 09:43:03.349613 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1202/2407] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:43:03 2022] POST /identity/v3/projects => generated 377 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:43:03.354065 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3714ee12-c1c6-448c-b59c-13b0da19a2cc service placement] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:03.365145 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3714ee12-c1c6-448c-b59c-13b0da19a2cc service placement] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:03.440237 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471014c-106a-4ad4-bdb4-e54d9d52a872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:03.441541 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471014c-106a-4ad4-bdb4-e54d9d52a872 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:03.441832 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471014c-106a-4ad4-bdb4-e54d9d52a872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:03.442105 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471014c-106a-4ad4-bdb4-e54d9d52a872 admin admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:03.442802 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2471014c-106a-4ad4-bdb4-e54d9d52a872 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:03.444773 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2471014c-106a-4ad4-bdb4-e54d9d52a872 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:03.541445 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1206/2408] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:43:03 2022] POST /identity/v3/users => generated 295 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 09:43:03.544145 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d915e49-6fe2-415c-83cc-2f3b4159bf58 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:03.555396 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d915e49-6fe2-415c-83cc-2f3b4159bf58 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:03.561012 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b346926-e585-4f37-8822-ab2de47f2f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:03.561682 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b346926-e585-4f37-8822-ab2de47f2f6c admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:03.562001 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b346926-e585-4f37-8822-ab2de47f2f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:03.562281 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b346926-e585-4f37-8822-ab2de47f2f6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:03.563013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b346926-e585-4f37-8822-ab2de47f2f6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:03.564694 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b346926-e585-4f37-8822-ab2de47f2f6c admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:03.576437 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1203/2409] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:43:03.581502 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471014c-106a-4ad4-bdb4-e54d9d52a872 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:03.593677 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471014c-106a-4ad4-bdb4-e54d9d52a872 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:03.598686 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e53a91-d001-4a7c-8ee0-4b2ea1967608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:03.599636 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e53a91-d001-4a7c-8ee0-4b2ea1967608 admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:03.599911 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e53a91-d001-4a7c-8ee0-4b2ea1967608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:03.600184 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e53a91-d001-4a7c-8ee0-4b2ea1967608 admin admin] PATH_INFO: `/v3/projects/abf4281f5a0f4ab7a1ad1391b79bca86/users/1008a54bf41d4e049bad7bd0fc7ce03e/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:03.617493 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e53a91-d001-4a7c-8ee0-4b2ea1967608 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abf4281f5a0f4ab7a1ad1391b79bca86, user_id=1008a54bf41d4e049bad7bd0fc7ce03e, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:03.620071 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e53a91-d001-4a7c-8ee0-4b2ea1967608 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:03.696306 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1207/2410] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:43:03 2022] PUT /identity/v3/projects/abf4281f5a0f4ab7a1ad1391b79bca86/users/1008a54bf41d4e049bad7bd0fc7ce03e/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:43:03.700497 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b346926-e585-4f37-8822-ab2de47f2f6c admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:03.707399 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:43:03.712136 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b346926-e585-4f37-8822-ab2de47f2f6c admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:03.773165 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3f1db-9f14-4ed5-ab51-ae2957b13931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:03.774680 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3f1db-9f14-4ed5-ab51-ae2957b13931 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:03.774957 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3f1db-9f14-4ed5-ab51-ae2957b13931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:03.775225 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3f1db-9f14-4ed5-ab51-ae2957b13931 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:03.775948 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c3f1db-9f14-4ed5-ab51-ae2957b13931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:03.777576 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c3f1db-9f14-4ed5-ab51-ae2957b13931 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:03.793775 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1204/2411] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 09:43:03.795172 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e53a91-d001-4a7c-8ee0-4b2ea1967608 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:03.806025 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e53a91-d001-4a7c-8ee0-4b2ea1967608 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:03.811251 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca76dff1-40d8-45ee-bce2-e339955e33ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:03.812260 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76dff1-40d8-45ee-bce2-e339955e33ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:03.813179 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76dff1-40d8-45ee-bce2-e339955e33ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:03.813474 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76dff1-40d8-45ee-bce2-e339955e33ba admin admin] PATH_INFO: `/v3/projects/abf4281f5a0f4ab7a1ad1391b79bca86/users/1008a54bf41d4e049bad7bd0fc7ce03e/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:03.815748 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca76dff1-40d8-45ee-bce2-e339955e33ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=abf4281f5a0f4ab7a1ad1391b79bca86, user_id=1008a54bf41d4e049bad7bd0fc7ce03e, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:03.818408 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca76dff1-40d8-45ee-bce2-e339955e33ba admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:03.821819 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:43:03.830320 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1208/2412] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:43:03 2022] PUT /identity/v3/projects/abf4281f5a0f4ab7a1ad1391b79bca86/users/1008a54bf41d4e049bad7bd0fc7ce03e/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:43:03.841113 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ff6d7-3bb2-4977-9102-be41099f3638 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:03.841404 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ff6d7-3bb2-4977-9102-be41099f3638 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:03.841682 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ff6d7-3bb2-4977-9102-be41099f3638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:03.869312 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-909ff6d7-3bb2-4977-9102-be41099f3638 None None] MFA Rules not processed for user `1008a54bf41d4e049bad7bd0fc7ce03e`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:43:03.870501 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-909ff6d7-3bb2-4977-9102-be41099f3638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:03.940760 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1205/2413] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:43:03 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:43:03.954029 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca76dff1-40d8-45ee-bce2-e339955e33ba admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:03.955722 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-ca76dff1-40d8-45ee-bce2-e339955e33ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:04.017035 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca76dff1-40d8-45ee-bce2-e339955e33ba admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:04.020699 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205128ff-4771-4ff4-a982-27bc7b7edea3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:04.021342 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205128ff-4771-4ff4-a982-27bc7b7edea3 service cinder] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:04.021621 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205128ff-4771-4ff4-a982-27bc7b7edea3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:04.021895 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205128ff-4771-4ff4-a982-27bc7b7edea3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:04.081259 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205128ff-4771-4ff4-a982-27bc7b7edea3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:04.081259 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205128ff-4771-4ff4-a982-27bc7b7edea3 service cinder] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:04.083959 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ff6d7-3bb2-4977-9102-be41099f3638 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:04.086875 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-909ff6d7-3bb2-4977-9102-be41099f3638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:04.091987 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1209/2414] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:43:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:43:04.168261 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ff6d7-3bb2-4977-9102-be41099f3638 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:04.173827 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011673a6-9019-4630-9900-bff711e4a2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:04.174695 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011673a6-9019-4630-9900-bff711e4a2b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:04.174969 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011673a6-9019-4630-9900-bff711e4a2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:04.175239 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011673a6-9019-4630-9900-bff711e4a2b5 admin admin] PATH_INFO: `/v3/users/66d47247e72c41e89de8e56f78fc9b1f` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:04.176461 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011673a6-9019-4630-9900-bff711e4a2b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66d47247e72c41e89de8e56f78fc9b1f)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:04.178385 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011673a6-9019-4630-9900-bff711e4a2b5 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:04.407143 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-011673a6-9019-4630-9900-bff711e4a2b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66d47247e72c41e89de8e56f78fc9b1f'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:04.414442 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-011673a6-9019-4630-9900-bff711e4a2b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66d47247e72c41e89de8e56f78fc9b1f'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:04.460892 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-011673a6-9019-4630-9900-bff711e4a2b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66d47247e72c41e89de8e56f78fc9b1f'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:04.461542 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-011673a6-9019-4630-9900-bff711e4a2b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66d47247e72c41e89de8e56f78fc9b1f'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:04.474147 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-011673a6-9019-4630-9900-bff711e4a2b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66d47247e72c41e89de8e56f78fc9b1f'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:04.480304 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1206/2415] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:43:04 2022] DELETE /identity/v3/users/66d47247e72c41e89de8e56f78fc9b1f => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:43:04.655442 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:43:04.833822 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205128ff-4771-4ff4-a982-27bc7b7edea3 service cinder] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:04.844687 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205128ff-4771-4ff4-a982-27bc7b7edea3 service cinder] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:04.906128 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919dd17-0c8a-49f7-bfad-7c15afc7bb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:04.908413 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919dd17-0c8a-49f7-bfad-7c15afc7bb1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:04.908413 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919dd17-0c8a-49f7-bfad-7c15afc7bb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:04.908413 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919dd17-0c8a-49f7-bfad-7c15afc7bb1e admin admin] PATH_INFO: `/v3/projects/ee868d940c61441c9eb2ea07b9c87f29` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:04.909708 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9919dd17-0c8a-49f7-bfad-7c15afc7bb1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee868d940c61441c9eb2ea07b9c87f29)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:04.913228 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9919dd17-0c8a-49f7-bfad-7c15afc7bb1e admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:05.049512 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-9919dd17-0c8a-49f7-bfad-7c15afc7bb1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee868d940c61441c9eb2ea07b9c87f29', 'request_id': 'req-9919dd17-0c8a-49f7-bfad-7c15afc7bb1e'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:05.052370 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:43:05.139669 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-9919dd17-0c8a-49f7-bfad-7c15afc7bb1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee868d940c61441c9eb2ea07b9c87f29', 'request_id': 'req-9919dd17-0c8a-49f7-bfad-7c15afc7bb1e'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:05.146097 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-9919dd17-0c8a-49f7-bfad-7c15afc7bb1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee868d940c61441c9eb2ea07b9c87f29', 'request_id': 'req-9919dd17-0c8a-49f7-bfad-7c15afc7bb1e'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:05.157719 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-9919dd17-0c8a-49f7-bfad-7c15afc7bb1e admin admin] The token cache is being invalidate because project ee868d940c61441c9eb2ea07b9c87f29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:43:05.158006 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-9919dd17-0c8a-49f7-bfad-7c15afc7bb1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:05.158638 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-9919dd17-0c8a-49f7-bfad-7c15afc7bb1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:05.160542 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1210/2416] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:43:04 2022] DELETE /identity/v3/projects/ee868d940c61441c9eb2ea07b9c87f29 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:43:05.164922 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011673a6-9019-4630-9900-bff711e4a2b5 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:05.166352 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-011673a6-9019-4630-9900-bff711e4a2b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:05.179193 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011673a6-9019-4630-9900-bff711e4a2b5 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:05.240925 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe07f41-b8de-4797-b4a4-9212ed2f5379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:05.241780 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe07f41-b8de-4797-b4a4-9212ed2f5379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:05.242104 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe07f41-b8de-4797-b4a4-9212ed2f5379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:05.242430 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe07f41-b8de-4797-b4a4-9212ed2f5379 admin admin] PATH_INFO: `/v3/users/dec9f3c087a64132b900f18135a8a831` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:05.243629 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe07f41-b8de-4797-b4a4-9212ed2f5379 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dec9f3c087a64132b900f18135a8a831)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:05.245579 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe07f41-b8de-4797-b4a4-9212ed2f5379 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:05.443042 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-6fe07f41-b8de-4797-b4a4-9212ed2f5379 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dec9f3c087a64132b900f18135a8a831'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:05.453814 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-6fe07f41-b8de-4797-b4a4-9212ed2f5379 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dec9f3c087a64132b900f18135a8a831'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:05.517726 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-6fe07f41-b8de-4797-b4a4-9212ed2f5379 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dec9f3c087a64132b900f18135a8a831'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:05.518358 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-6fe07f41-b8de-4797-b4a4-9212ed2f5379 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dec9f3c087a64132b900f18135a8a831'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:05.532063 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-6fe07f41-b8de-4797-b4a4-9212ed2f5379 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dec9f3c087a64132b900f18135a8a831'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:05.538010 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1207/2417] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:43:05 2022] DELETE /identity/v3/users/dec9f3c087a64132b900f18135a8a831 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:43:05.793901 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919dd17-0c8a-49f7-bfad-7c15afc7bb1e admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:05.797131 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-9919dd17-0c8a-49f7-bfad-7c15afc7bb1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:05.815030 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919dd17-0c8a-49f7-bfad-7c15afc7bb1e admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:05.885155 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a9889-3b1d-49db-8e21-aec0b216e511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:05.886641 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a9889-3b1d-49db-8e21-aec0b216e511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:05.886926 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a9889-3b1d-49db-8e21-aec0b216e511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:05.887204 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a9889-3b1d-49db-8e21-aec0b216e511 admin admin] PATH_INFO: `/v3/projects/9be6d17e3c624bc3b5052b542ac4bdf4` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:05.888672 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0a9889-3b1d-49db-8e21-aec0b216e511 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9be6d17e3c624bc3b5052b542ac4bdf4)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:05.891063 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0a9889-3b1d-49db-8e21-aec0b216e511 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:06.037108 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-fe0a9889-3b1d-49db-8e21-aec0b216e511 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9be6d17e3c624bc3b5052b542ac4bdf4', 'request_id': 'req-fe0a9889-3b1d-49db-8e21-aec0b216e511'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:06.112282 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-fe0a9889-3b1d-49db-8e21-aec0b216e511 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9be6d17e3c624bc3b5052b542ac4bdf4', 'request_id': 'req-fe0a9889-3b1d-49db-8e21-aec0b216e511'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:06.119263 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-fe0a9889-3b1d-49db-8e21-aec0b216e511 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9be6d17e3c624bc3b5052b542ac4bdf4', 'request_id': 'req-fe0a9889-3b1d-49db-8e21-aec0b216e511'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:06.130705 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-fe0a9889-3b1d-49db-8e21-aec0b216e511 admin admin] The token cache is being invalidate because project 9be6d17e3c624bc3b5052b542ac4bdf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:43:06.130987 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-fe0a9889-3b1d-49db-8e21-aec0b216e511 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:06.131641 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-fe0a9889-3b1d-49db-8e21-aec0b216e511 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:06.133822 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1211/2418] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:43:05 2022] DELETE /identity/v3/projects/9be6d17e3c624bc3b5052b542ac4bdf4 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:43:06.138952 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5cefe-57dc-4370-b346-f1b07c3511b5 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:06.139231 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5cefe-57dc-4370-b346-f1b07c3511b5 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:06.139502 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5cefe-57dc-4370-b346-f1b07c3511b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:06.157620 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-b2e5cefe-57dc-4370-b346-f1b07c3511b5 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:43:06.158815 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-b2e5cefe-57dc-4370-b346-f1b07c3511b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:06.177179 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:43:06.220680 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1208/2419] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:43:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:43:06.229537 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5c351-6783-48a2-8ca4-d87a043f1d7e None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:06.229823 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5c351-6783-48a2-8ca4-d87a043f1d7e None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:06.230100 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5c351-6783-48a2-8ca4-d87a043f1d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:06.249200 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-94b5c351-6783-48a2-8ca4-d87a043f1d7e None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:43:06.250434 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-94b5c351-6783-48a2-8ca4-d87a043f1d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:06.259262 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1212/2420] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:43:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:43:06.263557 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e5cefe-57dc-4370-b346-f1b07c3511b5 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:06.273231 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e5cefe-57dc-4370-b346-f1b07c3511b5 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:06.278741 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbe249-2413-407a-955f-0d3d551cce34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:06.279327 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbe249-2413-407a-955f-0d3d551cce34 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:06.280492 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbe249-2413-407a-955f-0d3d551cce34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:06.280492 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbe249-2413-407a-955f-0d3d551cce34 admin admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:06.285553 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dbe249-2413-407a-955f-0d3d551cce34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:43:06.285553 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dbe249-2413-407a-955f-0d3d551cce34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:06.285553 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dbe249-2413-407a-955f-0d3d551cce34 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:06.295865 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1209/2421] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:43:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:43:06.300464 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5c351-6783-48a2-8ca4-d87a043f1d7e None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:06.310474 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5c351-6783-48a2-8ca4-d87a043f1d7e None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:06.315533 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eaa422-2e5f-4a47-bacc-16738eeeec66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:06.316241 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eaa422-2e5f-4a47-bacc-16738eeeec66 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:06.316533 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eaa422-2e5f-4a47-bacc-16738eeeec66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:06.316811 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eaa422-2e5f-4a47-bacc-16738eeeec66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:06.317518 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eaa422-2e5f-4a47-bacc-16738eeeec66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:06.319420 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eaa422-2e5f-4a47-bacc-16738eeeec66 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:06.432779 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1213/2422] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:43:06 2022] POST /identity/v3/projects => generated 383 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:43:06.437200 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbe249-2413-407a-955f-0d3d551cce34 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:06.447907 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbe249-2413-407a-955f-0d3d551cce34 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:06.505752 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412b616-3867-4be4-b5c8-9b196b6e76a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:06.506419 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412b616-3867-4be4-b5c8-9b196b6e76a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:06.506702 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412b616-3867-4be4-b5c8-9b196b6e76a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:06.506978 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412b616-3867-4be4-b5c8-9b196b6e76a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:06.507676 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4412b616-3867-4be4-b5c8-9b196b6e76a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:06.509639 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4412b616-3867-4be4-b5c8-9b196b6e76a3 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:06.610402 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1210/2423] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:43:06 2022] POST /identity/v3/users => generated 292 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:43:06.614528 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eaa422-2e5f-4a47-bacc-16738eeeec66 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:06.625737 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eaa422-2e5f-4a47-bacc-16738eeeec66 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:06.630446 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b17fb-6038-4123-8b64-f0038b72a2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:06.631102 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b17fb-6038-4123-8b64-f0038b72a2fe admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:06.631387 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b17fb-6038-4123-8b64-f0038b72a2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:06.631664 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b17fb-6038-4123-8b64-f0038b72a2fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:06.632433 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446b17fb-6038-4123-8b64-f0038b72a2fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:06.634024 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446b17fb-6038-4123-8b64-f0038b72a2fe admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:06.644448 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1214/2424] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:43:06.648976 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412b616-3867-4be4-b5c8-9b196b6e76a3 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:06.659059 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412b616-3867-4be4-b5c8-9b196b6e76a3 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:06.663579 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94c95b-08b6-4438-8c96-18b217fc9bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:06.664875 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94c95b-08b6-4438-8c96-18b217fc9bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:06.665156 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94c95b-08b6-4438-8c96-18b217fc9bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:06.665424 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94c95b-08b6-4438-8c96-18b217fc9bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:06.666133 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db94c95b-08b6-4438-8c96-18b217fc9bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:06.667777 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db94c95b-08b6-4438-8c96-18b217fc9bc5 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:06.677930 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1211/2425] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:43:06.681842 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b17fb-6038-4123-8b64-f0038b72a2fe admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:06.692651 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b17fb-6038-4123-8b64-f0038b72a2fe admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:06.698387 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101176f4-0996-48a3-9516-4326ac6769f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:06.699291 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101176f4-0996-48a3-9516-4326ac6769f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:06.699577 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101176f4-0996-48a3-9516-4326ac6769f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:06.699853 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101176f4-0996-48a3-9516-4326ac6769f5 admin admin] PATH_INFO: `/v3/projects/fe914f21f9bd4a7aa6b393b1dd9e0b35/users/56ddad541101405fbc1514c4ade3f6ef/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:06.716557 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101176f4-0996-48a3-9516-4326ac6769f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe914f21f9bd4a7aa6b393b1dd9e0b35, user_id=56ddad541101405fbc1514c4ade3f6ef, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:06.720953 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101176f4-0996-48a3-9516-4326ac6769f5 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:06.826255 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1215/2426] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:43:06 2022] PUT /identity/v3/projects/fe914f21f9bd4a7aa6b393b1dd9e0b35/users/56ddad541101405fbc1514c4ade3f6ef/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:43:06.842047 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82cc37f-44e1-441b-bcf0-902caa0ee23f None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:06.842395 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82cc37f-44e1-441b-bcf0-902caa0ee23f None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:06.842608 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82cc37f-44e1-441b-bcf0-902caa0ee23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:06.870282 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-b82cc37f-44e1-441b-bcf0-902caa0ee23f None None] MFA Rules not processed for user `56ddad541101405fbc1514c4ade3f6ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:43:06.871467 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-b82cc37f-44e1-441b-bcf0-902caa0ee23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:06.935313 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1212/2427] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:43:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 09:43:06.946843 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101176f4-0996-48a3-9516-4326ac6769f5 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:06.948607 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-101176f4-0996-48a3-9516-4326ac6769f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:06.958593 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:43:07.007447 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101176f4-0996-48a3-9516-4326ac6769f5 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:07.012578 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380e73a-0551-442d-9214-9d03e7ed2e89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:07.013270 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380e73a-0551-442d-9214-9d03e7ed2e89 service cinder] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:07.013556 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380e73a-0551-442d-9214-9d03e7ed2e89 service cinder] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:07.013892 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380e73a-0551-442d-9214-9d03e7ed2e89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:07.023891 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a380e73a-0551-442d-9214-9d03e7ed2e89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:07.025477 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a380e73a-0551-442d-9214-9d03e7ed2e89 service cinder] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:07.038079 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1216/2428] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:43:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:43:07.062414 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82cc37f-44e1-441b-bcf0-902caa0ee23f None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:07.085896 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:43:07.134682 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82cc37f-44e1-441b-bcf0-902caa0ee23f None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:07.139278 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc20db-e761-4bee-bb58-412637bbefb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:07.140244 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc20db-e761-4bee-bb58-412637bbefb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:07.142211 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc20db-e761-4bee-bb58-412637bbefb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:07.142211 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc20db-e761-4bee-bb58-412637bbefb8 admin admin] PATH_INFO: `/v3/users/56ddad541101405fbc1514c4ade3f6ef` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:07.142211 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfc20db-e761-4bee-bb58-412637bbefb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56ddad541101405fbc1514c4ade3f6ef)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:07.143981 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfc20db-e761-4bee-bb58-412637bbefb8 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:07.301466 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-4cfc20db-e761-4bee-bb58-412637bbefb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56ddad541101405fbc1514c4ade3f6ef'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:07.308877 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-4cfc20db-e761-4bee-bb58-412637bbefb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56ddad541101405fbc1514c4ade3f6ef'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:07.381565 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-4cfc20db-e761-4bee-bb58-412637bbefb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56ddad541101405fbc1514c4ade3f6ef'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:07.383301 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-4cfc20db-e761-4bee-bb58-412637bbefb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56ddad541101405fbc1514c4ade3f6ef'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:07.397882 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-4cfc20db-e761-4bee-bb58-412637bbefb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56ddad541101405fbc1514c4ade3f6ef'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:07.405732 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1213/2429] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:43:07 2022] DELETE /identity/v3/users/56ddad541101405fbc1514c4ade3f6ef => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:43:07.411292 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d723da2-a9eb-4d92-b1b7-cfd49897833a None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:07.411718 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d723da2-a9eb-4d92-b1b7-cfd49897833a None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:07.412041 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d723da2-a9eb-4d92-b1b7-cfd49897833a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:07.424310 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc20db-e761-4bee-bb58-412637bbefb8 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:07.426579 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-4cfc20db-e761-4bee-bb58-412637bbefb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:07.439510 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-9d723da2-a9eb-4d92-b1b7-cfd49897833a None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:43:07.441479 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-9d723da2-a9eb-4d92-b1b7-cfd49897833a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:07.505350 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc20db-e761-4bee-bb58-412637bbefb8 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:07.506343 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1217/2430] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:43:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:43:07.511731 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26338c05-75b8-4962-81ce-f862e3ad7707 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:07.512430 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26338c05-75b8-4962-81ce-f862e3ad7707 service cinder] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:07.512712 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26338c05-75b8-4962-81ce-f862e3ad7707 service cinder] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:07.512981 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26338c05-75b8-4962-81ce-f862e3ad7707 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:07.514890 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-26338c05-75b8-4962-81ce-f862e3ad7707 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:07.516687 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d723da2-a9eb-4d92-b1b7-cfd49897833a None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:07.518005 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-9d723da2-a9eb-4d92-b1b7-cfd49897833a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:07.568006 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:43:07.575619 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d723da2-a9eb-4d92-b1b7-cfd49897833a None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:07.579542 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4795d15-634d-4250-8559-48ac68e88e21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:07.580188 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4795d15-634d-4250-8559-48ac68e88e21 service neutron] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:07.580499 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4795d15-634d-4250-8559-48ac68e88e21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:07.580778 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4795d15-634d-4250-8559-48ac68e88e21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:07.581722 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26338c05-75b8-4962-81ce-f862e3ad7707 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:07.583267 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26338c05-75b8-4962-81ce-f862e3ad7707 service cinder] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:07.590277 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4795d15-634d-4250-8559-48ac68e88e21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:07.591694 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4795d15-634d-4250-8559-48ac68e88e21 service neutron] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:07.593061 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1214/2431] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:43:07 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:43:07.602084 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1218/2432] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:43:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 09:43:08.045962 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26338c05-75b8-4962-81ce-f862e3ad7707 service cinder] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:08.047510 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-26338c05-75b8-4962-81ce-f862e3ad7707 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:08.062497 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26338c05-75b8-4962-81ce-f862e3ad7707 service cinder] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:08.071097 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92383557-a2c2-48ec-8b4a-28cb8170e71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:08.071097 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92383557-a2c2-48ec-8b4a-28cb8170e71e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:08.071097 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92383557-a2c2-48ec-8b4a-28cb8170e71e admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:08.071097 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92383557-a2c2-48ec-8b4a-28cb8170e71e admin admin] PATH_INFO: `/v3/projects/fe914f21f9bd4a7aa6b393b1dd9e0b35` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:08.071449 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92383557-a2c2-48ec-8b4a-28cb8170e71e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe914f21f9bd4a7aa6b393b1dd9e0b35)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:08.073033 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92383557-a2c2-48ec-8b4a-28cb8170e71e admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:08.214992 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-92383557-a2c2-48ec-8b4a-28cb8170e71e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe914f21f9bd4a7aa6b393b1dd9e0b35', 'request_id': 'req-92383557-a2c2-48ec-8b4a-28cb8170e71e'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:08.307175 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-92383557-a2c2-48ec-8b4a-28cb8170e71e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe914f21f9bd4a7aa6b393b1dd9e0b35', 'request_id': 'req-92383557-a2c2-48ec-8b4a-28cb8170e71e'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:08.319173 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-92383557-a2c2-48ec-8b4a-28cb8170e71e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe914f21f9bd4a7aa6b393b1dd9e0b35', 'request_id': 'req-92383557-a2c2-48ec-8b4a-28cb8170e71e'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:08.342904 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-92383557-a2c2-48ec-8b4a-28cb8170e71e admin admin] The token cache is being invalidate because project fe914f21f9bd4a7aa6b393b1dd9e0b35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:43:08.342904 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-92383557-a2c2-48ec-8b4a-28cb8170e71e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:08.342904 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-92383557-a2c2-48ec-8b4a-28cb8170e71e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:08.345651 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1215/2433] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:43:08 2022] DELETE /identity/v3/projects/fe914f21f9bd4a7aa6b393b1dd9e0b35 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:43:08.350622 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89974233-9953-4cd5-9eca-ae0a264e386d None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:08.351052 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89974233-9953-4cd5-9eca-ae0a264e386d None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:08.351158 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89974233-9953-4cd5-9eca-ae0a264e386d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:08.370053 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-89974233-9953-4cd5-9eca-ae0a264e386d None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:43:08.371241 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-89974233-9953-4cd5-9eca-ae0a264e386d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:08.424793 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:43:08.437340 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1219/2434] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:43:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:43:08.445418 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf81d8-3327-4f06-a45a-857a79589401 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:08.445705 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf81d8-3327-4f06-a45a-857a79589401 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:08.445982 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf81d8-3327-4f06-a45a-857a79589401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:08.464438 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-f7cf81d8-3327-4f06-a45a-857a79589401 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:43:08.467693 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-f7cf81d8-3327-4f06-a45a-857a79589401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:08.473562 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1216/2435] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:43:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:43:08.478632 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89974233-9953-4cd5-9eca-ae0a264e386d None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:08.488381 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89974233-9953-4cd5-9eca-ae0a264e386d None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:08.492907 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee793ec-5ca9-4841-86a5-6144ba88bbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:08.493558 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee793ec-5ca9-4841-86a5-6144ba88bbe7 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:08.493836 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee793ec-5ca9-4841-86a5-6144ba88bbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:08.494109 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee793ec-5ca9-4841-86a5-6144ba88bbe7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:08.494857 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee793ec-5ca9-4841-86a5-6144ba88bbe7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:43:08.495164 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee793ec-5ca9-4841-86a5-6144ba88bbe7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:08.496796 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee793ec-5ca9-4841-86a5-6144ba88bbe7 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:08.509422 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1220/2436] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:43:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:43:08.513700 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf81d8-3327-4f06-a45a-857a79589401 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:08.524019 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf81d8-3327-4f06-a45a-857a79589401 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:08.534336 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25e1ebe-3406-40ea-8ecf-2918f5e4eb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:08.535008 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e1ebe-3406-40ea-8ecf-2918f5e4eb10 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:08.535286 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e1ebe-3406-40ea-8ecf-2918f5e4eb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:08.535554 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e1ebe-3406-40ea-8ecf-2918f5e4eb10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:08.536290 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25e1ebe-3406-40ea-8ecf-2918f5e4eb10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:08.538244 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25e1ebe-3406-40ea-8ecf-2918f5e4eb10 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:08.628013 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1217/2437] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:43:08 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:43:08.632061 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee793ec-5ca9-4841-86a5-6144ba88bbe7 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:08.642845 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee793ec-5ca9-4841-86a5-6144ba88bbe7 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:08.699758 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d23adc-92cb-41a5-9b7b-a88b49a774f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:08.700453 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d23adc-92cb-41a5-9b7b-a88b49a774f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:08.700743 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d23adc-92cb-41a5-9b7b-a88b49a774f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:08.701036 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d23adc-92cb-41a5-9b7b-a88b49a774f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:08.701700 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d23adc-92cb-41a5-9b7b-a88b49a774f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:08.703609 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d23adc-92cb-41a5-9b7b-a88b49a774f4 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:08.769318 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1221/2438] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:43:08 2022] POST /identity/v3/users => generated 287 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:43:08.773187 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25e1ebe-3406-40ea-8ecf-2918f5e4eb10 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:08.784106 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25e1ebe-3406-40ea-8ecf-2918f5e4eb10 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:08.788753 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc003c10-195f-41e8-8805-6a47f4c6b4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:08.789444 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc003c10-195f-41e8-8805-6a47f4c6b4fe admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:08.789727 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc003c10-195f-41e8-8805-6a47f4c6b4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:08.790004 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc003c10-195f-41e8-8805-6a47f4c6b4fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:08.790818 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc003c10-195f-41e8-8805-6a47f4c6b4fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:08.792517 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc003c10-195f-41e8-8805-6a47f4c6b4fe admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:08.802807 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1218/2439] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:43:08.806712 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d23adc-92cb-41a5-9b7b-a88b49a774f4 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:08.816759 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d23adc-92cb-41a5-9b7b-a88b49a774f4 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:08.822138 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09370b36-f920-4b22-86bb-a8721dd8cce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:08.822786 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09370b36-f920-4b22-86bb-a8721dd8cce5 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:08.823066 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09370b36-f920-4b22-86bb-a8721dd8cce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:08.823339 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09370b36-f920-4b22-86bb-a8721dd8cce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:08.824056 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09370b36-f920-4b22-86bb-a8721dd8cce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:08.825666 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09370b36-f920-4b22-86bb-a8721dd8cce5 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:08.836382 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1222/2440] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:43:08.840502 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc003c10-195f-41e8-8805-6a47f4c6b4fe admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:08.850527 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc003c10-195f-41e8-8805-6a47f4c6b4fe admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:08.855403 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f649eb3-6a01-4316-9445-485c0fa12942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:08.856306 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f649eb3-6a01-4316-9445-485c0fa12942 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:08.856587 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f649eb3-6a01-4316-9445-485c0fa12942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:08.856861 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f649eb3-6a01-4316-9445-485c0fa12942 admin admin] PATH_INFO: `/v3/projects/bd91f62dff1f4fa09c8d3e9d0804fde4/users/5ddd287a77654996af073508827b955d/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:08.871742 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f649eb3-6a01-4316-9445-485c0fa12942 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd91f62dff1f4fa09c8d3e9d0804fde4, user_id=5ddd287a77654996af073508827b955d, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:08.874419 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f649eb3-6a01-4316-9445-485c0fa12942 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:08.969508 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1219/2441] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:43:08 2022] PUT /identity/v3/projects/bd91f62dff1f4fa09c8d3e9d0804fde4/users/5ddd287a77654996af073508827b955d/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:43:09.034065 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe6dd1-7fad-446a-836f-7737516deb86 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:09.034353 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe6dd1-7fad-446a-836f-7737516deb86 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:09.034633 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe6dd1-7fad-446a-836f-7737516deb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:09.061465 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-9bfe6dd1-7fad-446a-836f-7737516deb86 None None] MFA Rules not processed for user `5ddd287a77654996af073508827b955d`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:43:09.062707 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-9bfe6dd1-7fad-446a-836f-7737516deb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:09.133670 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1223/2442] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:43:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:43:09.145226 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f649eb3-6a01-4316-9445-485c0fa12942 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:09.146930 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-2f649eb3-6a01-4316-9445-485c0fa12942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:09.203772 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f649eb3-6a01-4316-9445-485c0fa12942 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:09.207434 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afdd050-0042-4126-9fba-25de39795c7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:09.208078 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdd050-0042-4126-9fba-25de39795c7c service cinder] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:09.208389 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdd050-0042-4126-9fba-25de39795c7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:09.208664 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdd050-0042-4126-9fba-25de39795c7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:09.218022 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afdd050-0042-4126-9fba-25de39795c7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:09.219452 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afdd050-0042-4126-9fba-25de39795c7c service cinder] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:09.229101 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1220/2443] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:43:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:43:09.248056 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe6dd1-7fad-446a-836f-7737516deb86 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:09.301495 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:43:09.315637 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe6dd1-7fad-446a-836f-7737516deb86 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:09.321123 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8ccc7-5c04-478e-a7de-667ea4227a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:09.322038 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8ccc7-5c04-478e-a7de-667ea4227a3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:09.322323 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8ccc7-5c04-478e-a7de-667ea4227a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:09.322599 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8ccc7-5c04-478e-a7de-667ea4227a3f admin admin] PATH_INFO: `/v3/users/5ddd287a77654996af073508827b955d` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:09.323844 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8ccc7-5c04-478e-a7de-667ea4227a3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ddd287a77654996af073508827b955d)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:09.325818 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8ccc7-5c04-478e-a7de-667ea4227a3f admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:09.509296 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-0ec8ccc7-5c04-478e-a7de-667ea4227a3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ddd287a77654996af073508827b955d'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:09.509960 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-0ec8ccc7-5c04-478e-a7de-667ea4227a3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ddd287a77654996af073508827b955d'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:09.597889 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-0ec8ccc7-5c04-478e-a7de-667ea4227a3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ddd287a77654996af073508827b955d'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:09.598549 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-0ec8ccc7-5c04-478e-a7de-667ea4227a3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ddd287a77654996af073508827b955d'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:09.606605 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-0ec8ccc7-5c04-478e-a7de-667ea4227a3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ddd287a77654996af073508827b955d'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:09.624107 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1224/2444] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:43:09 2022] DELETE /identity/v3/users/5ddd287a77654996af073508827b955d => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:43:09.629566 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa899c-5255-4b23-a075-b8c1ad44786a None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:09.630056 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa899c-5255-4b23-a075-b8c1ad44786a None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:09.630163 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa899c-5255-4b23-a075-b8c1ad44786a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:09.647414 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-6eaa899c-5255-4b23-a075-b8c1ad44786a None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:43:09.649221 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-6eaa899c-5255-4b23-a075-b8c1ad44786a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:09.654165 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:43:09.712430 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1221/2445] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:43:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:43:09.722284 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8ccc7-5c04-478e-a7de-667ea4227a3f admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:09.726026 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-0ec8ccc7-5c04-478e-a7de-667ea4227a3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:09.783971 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8ccc7-5c04-478e-a7de-667ea4227a3f admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:09.787535 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a885a-8ffc-40d9-9a05-9c705929c258 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:09.788178 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a885a-8ffc-40d9-9a05-9c705929c258 service neutron] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:09.788498 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a885a-8ffc-40d9-9a05-9c705929c258 service neutron] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:09.788810 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a885a-8ffc-40d9-9a05-9c705929c258 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:09.798197 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6a885a-8ffc-40d9-9a05-9c705929c258 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:09.799613 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6a885a-8ffc-40d9-9a05-9c705929c258 service neutron] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:09.808996 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1225/2446] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:43:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:43:10.280446 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa899c-5255-4b23-a075-b8c1ad44786a None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:10.282149 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-6eaa899c-5255-4b23-a075-b8c1ad44786a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:10.316043 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa899c-5255-4b23-a075-b8c1ad44786a None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:10.316043 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627150b0-4fef-4214-86f4-159a44627a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:10.316043 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627150b0-4fef-4214-86f4-159a44627a11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:10.316043 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627150b0-4fef-4214-86f4-159a44627a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:10.316626 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627150b0-4fef-4214-86f4-159a44627a11 admin admin] PATH_INFO: `/v3/projects/bd91f62dff1f4fa09c8d3e9d0804fde4` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:10.316626 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627150b0-4fef-4214-86f4-159a44627a11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd91f62dff1f4fa09c8d3e9d0804fde4)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:10.318608 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627150b0-4fef-4214-86f4-159a44627a11 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:10.457379 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-627150b0-4fef-4214-86f4-159a44627a11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd91f62dff1f4fa09c8d3e9d0804fde4', 'request_id': 'req-627150b0-4fef-4214-86f4-159a44627a11'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:10.523312 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-627150b0-4fef-4214-86f4-159a44627a11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd91f62dff1f4fa09c8d3e9d0804fde4', 'request_id': 'req-627150b0-4fef-4214-86f4-159a44627a11'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:10.529968 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-627150b0-4fef-4214-86f4-159a44627a11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd91f62dff1f4fa09c8d3e9d0804fde4', 'request_id': 'req-627150b0-4fef-4214-86f4-159a44627a11'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:10.541258 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-627150b0-4fef-4214-86f4-159a44627a11 admin admin] The token cache is being invalidate because project bd91f62dff1f4fa09c8d3e9d0804fde4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:43:10.541545 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-627150b0-4fef-4214-86f4-159a44627a11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:10.542185 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-627150b0-4fef-4214-86f4-159a44627a11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:10.543856 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1222/2447] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:43:10 2022] DELETE /identity/v3/projects/bd91f62dff1f4fa09c8d3e9d0804fde4 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:43:10.554256 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b5382-175d-4c58-b0bd-53590bb7b634 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:10.555316 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b5382-175d-4c58-b0bd-53590bb7b634 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:10.555497 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b5382-175d-4c58-b0bd-53590bb7b634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:10.574709 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-f10b5382-175d-4c58-b0bd-53590bb7b634 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:43:10.575878 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-f10b5382-175d-4c58-b0bd-53590bb7b634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:10.662702 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1226/2448] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:43:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:43:10.670485 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b929e-914a-4ec4-b94d-a2eae436ebb2 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:10.670943 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b929e-914a-4ec4-b94d-a2eae436ebb2 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:10.671042 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b929e-914a-4ec4-b94d-a2eae436ebb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:10.689641 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-dc6b929e-914a-4ec4-b94d-a2eae436ebb2 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:43:10.690842 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-dc6b929e-914a-4ec4-b94d-a2eae436ebb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:10.699518 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1223/2449] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:43:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:43:10.709776 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b5382-175d-4c58-b0bd-53590bb7b634 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:10.719694 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b5382-175d-4c58-b0bd-53590bb7b634 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:10.724714 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff0d31-324f-4566-8802-910a1947b552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:10.725471 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff0d31-324f-4566-8802-910a1947b552 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:10.725648 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff0d31-324f-4566-8802-910a1947b552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:10.725924 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff0d31-324f-4566-8802-910a1947b552 admin admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:10.726693 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff0d31-324f-4566-8802-910a1947b552 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:43:10.727004 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff0d31-324f-4566-8802-910a1947b552 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:10.728953 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff0d31-324f-4566-8802-910a1947b552 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:10.736235 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:43:10.742899 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1227/2450] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:43:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:43:10.747103 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b929e-914a-4ec4-b94d-a2eae436ebb2 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:10.757086 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b929e-914a-4ec4-b94d-a2eae436ebb2 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:10.762476 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478517d-f3bc-4f56-b4de-82e7c71acae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:10.763122 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478517d-f3bc-4f56-b4de-82e7c71acae8 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:10.763406 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478517d-f3bc-4f56-b4de-82e7c71acae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:10.763680 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478517d-f3bc-4f56-b4de-82e7c71acae8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:10.764401 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e478517d-f3bc-4f56-b4de-82e7c71acae8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:10.766304 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e478517d-f3bc-4f56-b4de-82e7c71acae8 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:10.865967 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1224/2451] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:43:10 2022] POST /identity/v3/projects => generated 359 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:43:10.867977 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff0d31-324f-4566-8802-910a1947b552 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:10.881623 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff0d31-324f-4566-8802-910a1947b552 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:10.942338 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd28513-ec89-4863-a58d-ead79ab042ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:10.943004 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd28513-ec89-4863-a58d-ead79ab042ee admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:10.943411 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd28513-ec89-4863-a58d-ead79ab042ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:10.943687 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd28513-ec89-4863-a58d-ead79ab042ee admin admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:10.944413 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd28513-ec89-4863-a58d-ead79ab042ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:10.946325 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd28513-ec89-4863-a58d-ead79ab042ee admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:11.061840 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1228/2452] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:43:10 2022] POST /identity/v3/users => generated 280 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 09:43:11.065932 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478517d-f3bc-4f56-b4de-82e7c71acae8 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:11.076377 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478517d-f3bc-4f56-b4de-82e7c71acae8 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:11.080982 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d443f1f-f6a7-4ebd-ac08-47add92c6ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:11.081633 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d443f1f-f6a7-4ebd-ac08-47add92c6ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:11.081950 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d443f1f-f6a7-4ebd-ac08-47add92c6ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:11.082225 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d443f1f-f6a7-4ebd-ac08-47add92c6ef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:11.082952 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d443f1f-f6a7-4ebd-ac08-47add92c6ef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:11.084584 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d443f1f-f6a7-4ebd-ac08-47add92c6ef7 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:11.096625 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1225/2453] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:43:11.100614 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd28513-ec89-4863-a58d-ead79ab042ee admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:11.112054 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd28513-ec89-4863-a58d-ead79ab042ee admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:11.117534 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5e7df-3c9b-414f-8a1a-086ceba0d0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:11.118227 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5e7df-3c9b-414f-8a1a-086ceba0d0af admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:11.123948 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5e7df-3c9b-414f-8a1a-086ceba0d0af admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:11.123948 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5e7df-3c9b-414f-8a1a-086ceba0d0af admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:11.123948 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a5e7df-3c9b-414f-8a1a-086ceba0d0af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:11.123948 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a5e7df-3c9b-414f-8a1a-086ceba0d0af admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:11.131978 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1229/2454] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:43:11.136182 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d443f1f-f6a7-4ebd-ac08-47add92c6ef7 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:11.146605 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d443f1f-f6a7-4ebd-ac08-47add92c6ef7 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:11.151939 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa3689-85d6-4727-87d6-de58b89a153a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:11.152852 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa3689-85d6-4727-87d6-de58b89a153a admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:11.153134 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa3689-85d6-4727-87d6-de58b89a153a admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:11.153412 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa3689-85d6-4727-87d6-de58b89a153a admin admin] PATH_INFO: `/v3/projects/384f069021994fd2a5b6de6c542b9a36/users/b94e95deba904e7aa74ca2fac276de1d/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:11.169096 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa3689-85d6-4727-87d6-de58b89a153a admin admin] RBAC: Authorizing `identity:create_grant(project_id=384f069021994fd2a5b6de6c542b9a36, user_id=b94e95deba904e7aa74ca2fac276de1d, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:11.171784 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa3689-85d6-4727-87d6-de58b89a153a admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:11.290542 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1226/2455] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:43:11 2022] PUT /identity/v3/projects/384f069021994fd2a5b6de6c542b9a36/users/b94e95deba904e7aa74ca2fac276de1d/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:43:11.303268 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6351a-5394-46ab-aa1f-7a14d6aafd2e None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:11.303581 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6351a-5394-46ab-aa1f-7a14d6aafd2e None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:11.303860 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6351a-5394-46ab-aa1f-7a14d6aafd2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:11.330444 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-0db6351a-5394-46ab-aa1f-7a14d6aafd2e None None] MFA Rules not processed for user `b94e95deba904e7aa74ca2fac276de1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:43:11.331679 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-0db6351a-5394-46ab-aa1f-7a14d6aafd2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:11.396981 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1230/2456] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:43:11 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:43:11.430423 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa3689-85d6-4727-87d6-de58b89a153a admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:11.432184 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-b8fa3689-85d6-4727-87d6-de58b89a153a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:11.469209 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:43:11.493893 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa3689-85d6-4727-87d6-de58b89a153a admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:11.497862 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d33ad51-0a38-41e2-a5a0-314024294a15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:11.498502 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33ad51-0a38-41e2-a5a0-314024294a15 service cinder] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:11.498801 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33ad51-0a38-41e2-a5a0-314024294a15 service cinder] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:11.499057 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33ad51-0a38-41e2-a5a0-314024294a15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:11.507348 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d33ad51-0a38-41e2-a5a0-314024294a15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:11.509333 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d33ad51-0a38-41e2-a5a0-314024294a15 service cinder] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:11.518925 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1227/2457] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:43:11 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:43:11.533933 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db6351a-5394-46ab-aa1f-7a14d6aafd2e None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:11.595277 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db6351a-5394-46ab-aa1f-7a14d6aafd2e None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:11.599750 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934cfd7-d2a0-46a7-8851-116287308055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:11.600623 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934cfd7-d2a0-46a7-8851-116287308055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:11.600901 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934cfd7-d2a0-46a7-8851-116287308055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:11.601193 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934cfd7-d2a0-46a7-8851-116287308055 admin admin] PATH_INFO: `/v3/users/b94e95deba904e7aa74ca2fac276de1d` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:11.602375 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934cfd7-d2a0-46a7-8851-116287308055 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b94e95deba904e7aa74ca2fac276de1d)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:11.604627 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934cfd7-d2a0-46a7-8851-116287308055 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:11.609918 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:43:11.789721 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-1934cfd7-d2a0-46a7-8851-116287308055 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b94e95deba904e7aa74ca2fac276de1d'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:11.790668 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-1934cfd7-d2a0-46a7-8851-116287308055 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b94e95deba904e7aa74ca2fac276de1d'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:11.860443 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-1934cfd7-d2a0-46a7-8851-116287308055 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b94e95deba904e7aa74ca2fac276de1d'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:11.861078 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-1934cfd7-d2a0-46a7-8851-116287308055 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b94e95deba904e7aa74ca2fac276de1d'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:11.868576 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-1934cfd7-d2a0-46a7-8851-116287308055 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b94e95deba904e7aa74ca2fac276de1d'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:11.886532 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1231/2458] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:43:11 2022] DELETE /identity/v3/users/b94e95deba904e7aa74ca2fac276de1d => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:43:11.891162 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6793b2-a99a-49be-a2e4-239c8d6e55a7 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:11.891652 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6793b2-a99a-49be-a2e4-239c8d6e55a7 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:11.891750 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6793b2-a99a-49be-a2e4-239c8d6e55a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:11.909687 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-fc6793b2-a99a-49be-a2e4-239c8d6e55a7 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:43:11.910943 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-fc6793b2-a99a-49be-a2e4-239c8d6e55a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:11.969169 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1228/2459] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:43:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:43:11.978929 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934cfd7-d2a0-46a7-8851-116287308055 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:11.980335 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-1934cfd7-d2a0-46a7-8851-116287308055 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:12.038209 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934cfd7-d2a0-46a7-8851-116287308055 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:12.042084 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f599d74b-0b74-480e-92f7-9204fb9740be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:12.048419 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599d74b-0b74-480e-92f7-9204fb9740be service neutron] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:12.048419 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599d74b-0b74-480e-92f7-9204fb9740be service neutron] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:12.048419 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599d74b-0b74-480e-92f7-9204fb9740be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:12.052749 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f599d74b-0b74-480e-92f7-9204fb9740be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:12.054168 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f599d74b-0b74-480e-92f7-9204fb9740be service neutron] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:12.064470 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1232/2460] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:43:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:43:12.538010 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6793b2-a99a-49be-a2e4-239c8d6e55a7 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:12.539752 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-fc6793b2-a99a-49be-a2e4-239c8d6e55a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:12.551798 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6793b2-a99a-49be-a2e4-239c8d6e55a7 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:12.556521 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851640a4-eb3d-4743-80c9-64b3b0173ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:12.557368 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851640a4-eb3d-4743-80c9-64b3b0173ba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:12.557647 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851640a4-eb3d-4743-80c9-64b3b0173ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:12.557918 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851640a4-eb3d-4743-80c9-64b3b0173ba9 admin admin] PATH_INFO: `/v3/projects/384f069021994fd2a5b6de6c542b9a36` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:12.559099 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851640a4-eb3d-4743-80c9-64b3b0173ba9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=384f069021994fd2a5b6de6c542b9a36)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:12.561056 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851640a4-eb3d-4743-80c9-64b3b0173ba9 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:12.764133 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-851640a4-eb3d-4743-80c9-64b3b0173ba9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '384f069021994fd2a5b6de6c542b9a36', 'request_id': 'req-851640a4-eb3d-4743-80c9-64b3b0173ba9'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:12.855009 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-851640a4-eb3d-4743-80c9-64b3b0173ba9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '384f069021994fd2a5b6de6c542b9a36', 'request_id': 'req-851640a4-eb3d-4743-80c9-64b3b0173ba9'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:12.862413 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-851640a4-eb3d-4743-80c9-64b3b0173ba9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '384f069021994fd2a5b6de6c542b9a36', 'request_id': 'req-851640a4-eb3d-4743-80c9-64b3b0173ba9'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:12.874634 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-851640a4-eb3d-4743-80c9-64b3b0173ba9 admin admin] The token cache is being invalidate because project 384f069021994fd2a5b6de6c542b9a36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:43:12.874923 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-851640a4-eb3d-4743-80c9-64b3b0173ba9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:12.875582 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-851640a4-eb3d-4743-80c9-64b3b0173ba9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:12.877279 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1229/2461] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:43:12 2022] DELETE /identity/v3/projects/384f069021994fd2a5b6de6c542b9a36 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:43:12.882263 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e857e-7cfb-434e-a58c-2c3cde7cace0 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:12.882741 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e857e-7cfb-434e-a58c-2c3cde7cace0 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:12.882860 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e857e-7cfb-434e-a58c-2c3cde7cace0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:12.901685 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-cf6e857e-7cfb-434e-a58c-2c3cde7cace0 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:43:12.902896 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-cf6e857e-7cfb-434e-a58c-2c3cde7cace0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:12.963714 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1233/2462] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:43:12.972428 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df4994-4cd4-4004-8873-08274ab1ade7 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:12.973070 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df4994-4cd4-4004-8873-08274ab1ade7 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:12.973070 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df4994-4cd4-4004-8873-08274ab1ade7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:12.992367 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-93df4994-4cd4-4004-8873-08274ab1ade7 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:43:12.993605 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-93df4994-4cd4-4004-8873-08274ab1ade7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:13.001650 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1230/2463] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:43:13.006134 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e857e-7cfb-434e-a58c-2c3cde7cace0 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:13.016633 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e857e-7cfb-434e-a58c-2c3cde7cace0 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:13.021416 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001f15c-c4cb-476d-a493-020a420c1945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:13.022076 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001f15c-c4cb-476d-a493-020a420c1945 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:13.022360 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001f15c-c4cb-476d-a493-020a420c1945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:13.024063 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001f15c-c4cb-476d-a493-020a420c1945 admin admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:13.024063 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5001f15c-c4cb-476d-a493-020a420c1945 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:43:13.024467 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5001f15c-c4cb-476d-a493-020a420c1945 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:13.025908 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5001f15c-c4cb-476d-a493-020a420c1945 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:13.038416 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1234/2464] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:43:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:43:13.042183 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df4994-4cd4-4004-8873-08274ab1ade7 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:13.051477 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df4994-4cd4-4004-8873-08274ab1ade7 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:13.056220 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa1129-0b18-458e-be24-2ccd26bc4ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:13.056874 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa1129-0b18-458e-be24-2ccd26bc4ce1 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:13.057156 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa1129-0b18-458e-be24-2ccd26bc4ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:13.057432 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa1129-0b18-458e-be24-2ccd26bc4ce1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:13.058120 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa1129-0b18-458e-be24-2ccd26bc4ce1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:13.060063 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa1129-0b18-458e-be24-2ccd26bc4ce1 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:13.171160 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1231/2465] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:43:13 2022] POST /identity/v3/projects => generated 375 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:43:13.175354 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001f15c-c4cb-476d-a493-020a420c1945 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:13.186425 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001f15c-c4cb-476d-a493-020a420c1945 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:13.198277 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:43:13.243701 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e5b38-9283-4b18-9e33-f06dfc531589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:13.244394 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e5b38-9283-4b18-9e33-f06dfc531589 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:13.244678 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e5b38-9283-4b18-9e33-f06dfc531589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:13.244951 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e5b38-9283-4b18-9e33-f06dfc531589 admin admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:13.245631 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e5b38-9283-4b18-9e33-f06dfc531589 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:13.247536 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e5b38-9283-4b18-9e33-f06dfc531589 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:13.369380 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1235/2466] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:43:13 2022] POST /identity/v3/users => generated 288 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:43:13.373648 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa1129-0b18-458e-be24-2ccd26bc4ce1 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:13.385005 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa1129-0b18-458e-be24-2ccd26bc4ce1 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:13.389946 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b253c1-6836-4ba6-a604-5121de4fa894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:13.390665 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b253c1-6836-4ba6-a604-5121de4fa894 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:13.390945 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b253c1-6836-4ba6-a604-5121de4fa894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:13.391222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b253c1-6836-4ba6-a604-5121de4fa894 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:13.391955 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b253c1-6836-4ba6-a604-5121de4fa894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:13.393596 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b253c1-6836-4ba6-a604-5121de4fa894 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:13.405330 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1232/2467] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:43:13.409721 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e5b38-9283-4b18-9e33-f06dfc531589 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:13.421339 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e5b38-9283-4b18-9e33-f06dfc531589 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:13.426260 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639363c3-4f44-4a3d-8d0f-fe41283e85fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:13.431389 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639363c3-4f44-4a3d-8d0f-fe41283e85fc admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:13.431389 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639363c3-4f44-4a3d-8d0f-fe41283e85fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:13.431389 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639363c3-4f44-4a3d-8d0f-fe41283e85fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:13.431389 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639363c3-4f44-4a3d-8d0f-fe41283e85fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:13.431389 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639363c3-4f44-4a3d-8d0f-fe41283e85fc admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:13.441253 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1236/2468] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:43:13.446232 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b253c1-6836-4ba6-a604-5121de4fa894 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:13.456585 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b253c1-6836-4ba6-a604-5121de4fa894 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:13.461124 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59e7616-07e7-42c8-8caf-63e266f78394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:13.462025 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e7616-07e7-42c8-8caf-63e266f78394 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:13.462310 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e7616-07e7-42c8-8caf-63e266f78394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:13.462566 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e7616-07e7-42c8-8caf-63e266f78394 admin admin] PATH_INFO: `/v3/projects/db54d43f6aa948dfb4c86df1abe3fad6/users/bb5964b3380a45daa51962b0b2b87fd9/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:13.480387 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59e7616-07e7-42c8-8caf-63e266f78394 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db54d43f6aa948dfb4c86df1abe3fad6, user_id=bb5964b3380a45daa51962b0b2b87fd9, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:13.485221 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59e7616-07e7-42c8-8caf-63e266f78394 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:13.487846 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:43:13.579916 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1233/2469] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:43:13 2022] PUT /identity/v3/projects/db54d43f6aa948dfb4c86df1abe3fad6/users/bb5964b3380a45daa51962b0b2b87fd9/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:43:13.590261 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9e681-9e93-426a-9a67-4b207d6caaac None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:13.590548 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9e681-9e93-426a-9a67-4b207d6caaac None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:13.590829 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9e681-9e93-426a-9a67-4b207d6caaac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:13.621906 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-89d9e681-9e93-426a-9a67-4b207d6caaac None None] MFA Rules not processed for user `bb5964b3380a45daa51962b0b2b87fd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:43:13.623150 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-89d9e681-9e93-426a-9a67-4b207d6caaac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:13.692652 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1237/2470] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:43:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:43:13.704222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59e7616-07e7-42c8-8caf-63e266f78394 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:13.705925 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-e59e7616-07e7-42c8-8caf-63e266f78394 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:13.765140 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59e7616-07e7-42c8-8caf-63e266f78394 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:13.769015 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37dea75-10e3-41b8-ba4c-fa5aa11594f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:13.769721 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37dea75-10e3-41b8-ba4c-fa5aa11594f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:13.769983 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37dea75-10e3-41b8-ba4c-fa5aa11594f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:13.770256 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37dea75-10e3-41b8-ba4c-fa5aa11594f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:13.780673 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37dea75-10e3-41b8-ba4c-fa5aa11594f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:13.782182 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37dea75-10e3-41b8-ba4c-fa5aa11594f9 service cinder] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:13.792167 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1234/2471] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:43:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:43:16.894022 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911da1e-abcf-4545-8e16-899ff2e6fc62 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:16.894502 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911da1e-abcf-4545-8e16-899ff2e6fc62 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:16.894593 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911da1e-abcf-4545-8e16-899ff2e6fc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:16.913287 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-2911da1e-abcf-4545-8e16-899ff2e6fc62 None None] MFA Rules not processed for user `8f5d1f2327914f9fb070c6212582b6dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:43:16.915044 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-2911da1e-abcf-4545-8e16-899ff2e6fc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:16.972493 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1238/2472] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Jun 27 09:43:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 09:43:17.122776 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37dea75-10e3-41b8-ba4c-fa5aa11594f9 service cinder] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:17.124314 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-c37dea75-10e3-41b8-ba4c-fa5aa11594f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:17.194033 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37dea75-10e3-41b8-ba4c-fa5aa11594f9 service cinder] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:17.199417 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b9e64-2532-4e0b-96ef-8f3ca9169089 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5477b14dae24fd3a644c9cbd6ff85ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:17.200087 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b9e64-2532-4e0b-96ef-8f3ca9169089 service swift] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:17.200436 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b9e64-2532-4e0b-96ef-8f3ca9169089 service swift] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:17.200714 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b9e64-2532-4e0b-96ef-8f3ca9169089 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:17.209232 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6b9e64-2532-4e0b-96ef-8f3ca9169089 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:17.210848 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6b9e64-2532-4e0b-96ef-8f3ca9169089 service swift] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:17.219721 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1235/2473] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Jun 27 09:43:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 09:43:17.913396 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2911da1e-abcf-4545-8e16-899ff2e6fc62 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:17.950551 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:43:17.992355 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2911da1e-abcf-4545-8e16-899ff2e6fc62 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:17.998773 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d5b33-ad64-4250-b175-b430746b5f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:17.999783 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d5b33-ad64-4250-b175-b430746b5f8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:18.000142 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d5b33-ad64-4250-b175-b430746b5f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:18.000715 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d5b33-ad64-4250-b175-b430746b5f8a admin admin] PATH_INFO: `/v3/users/bb5964b3380a45daa51962b0b2b87fd9` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:18.002049 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d5b33-ad64-4250-b175-b430746b5f8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb5964b3380a45daa51962b0b2b87fd9)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:18.011172 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d5b33-ad64-4250-b175-b430746b5f8a admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:18.218030 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-341d5b33-ad64-4250-b175-b430746b5f8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb5964b3380a45daa51962b0b2b87fd9'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:18.218759 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-341d5b33-ad64-4250-b175-b430746b5f8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb5964b3380a45daa51962b0b2b87fd9'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:18.288579 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-341d5b33-ad64-4250-b175-b430746b5f8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb5964b3380a45daa51962b0b2b87fd9'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:18.289299 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-341d5b33-ad64-4250-b175-b430746b5f8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb5964b3380a45daa51962b0b2b87fd9'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:18.301188 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-341d5b33-ad64-4250-b175-b430746b5f8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb5964b3380a45daa51962b0b2b87fd9'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:18.325720 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1239/2474] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:43:17 2022] DELETE /identity/v3/users/bb5964b3380a45daa51962b0b2b87fd9 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:43:18.332701 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce010593-478a-4a93-b54e-43225fa002bf None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:18.334173 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce010593-478a-4a93-b54e-43225fa002bf None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:18.335224 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce010593-478a-4a93-b54e-43225fa002bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:18.375133 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-ce010593-478a-4a93-b54e-43225fa002bf None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:43:18.377075 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-ce010593-478a-4a93-b54e-43225fa002bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:18.480981 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1236/2475] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:43:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:43:18.496649 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d5b33-ad64-4250-b175-b430746b5f8a admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:18.498277 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-341d5b33-ad64-4250-b175-b430746b5f8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:18.577624 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d5b33-ad64-4250-b175-b430746b5f8a admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:18.581468 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c82307-158b-4e0c-a145-5dbf13aa10b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:18.582141 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c82307-158b-4e0c-a145-5dbf13aa10b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:18.582466 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c82307-158b-4e0c-a145-5dbf13aa10b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:18.582677 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c82307-158b-4e0c-a145-5dbf13aa10b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:18.593666 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c82307-158b-4e0c-a145-5dbf13aa10b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:18.595274 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c82307-158b-4e0c-a145-5dbf13aa10b0 service neutron] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:18.613781 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1240/2476] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:43:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:43:19.143623 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce010593-478a-4a93-b54e-43225fa002bf None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:19.145128 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-ce010593-478a-4a93-b54e-43225fa002bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:19.163366 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce010593-478a-4a93-b54e-43225fa002bf None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:19.170303 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4baaa94-66f9-4c30-93e5-a42dc984beb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:19.171182 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4baaa94-66f9-4c30-93e5-a42dc984beb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:19.171459 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4baaa94-66f9-4c30-93e5-a42dc984beb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:19.171726 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4baaa94-66f9-4c30-93e5-a42dc984beb1 admin admin] PATH_INFO: `/v3/projects/db54d43f6aa948dfb4c86df1abe3fad6` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:19.172946 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4baaa94-66f9-4c30-93e5-a42dc984beb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db54d43f6aa948dfb4c86df1abe3fad6)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:19.174868 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4baaa94-66f9-4c30-93e5-a42dc984beb1 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:19.201617 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:43:19.273122 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-a4baaa94-66f9-4c30-93e5-a42dc984beb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db54d43f6aa948dfb4c86df1abe3fad6', 'request_id': 'req-a4baaa94-66f9-4c30-93e5-a42dc984beb1'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:19.340660 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-a4baaa94-66f9-4c30-93e5-a42dc984beb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db54d43f6aa948dfb4c86df1abe3fad6', 'request_id': 'req-a4baaa94-66f9-4c30-93e5-a42dc984beb1'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:19.347366 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-a4baaa94-66f9-4c30-93e5-a42dc984beb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db54d43f6aa948dfb4c86df1abe3fad6', 'request_id': 'req-a4baaa94-66f9-4c30-93e5-a42dc984beb1'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:19.374057 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-a4baaa94-66f9-4c30-93e5-a42dc984beb1 admin admin] The token cache is being invalidate because project db54d43f6aa948dfb4c86df1abe3fad6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:43:19.374441 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-a4baaa94-66f9-4c30-93e5-a42dc984beb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:19.375117 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-a4baaa94-66f9-4c30-93e5-a42dc984beb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:19.376897 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1237/2477] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:43:19 2022] DELETE /identity/v3/projects/db54d43f6aa948dfb4c86df1abe3fad6 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:43:24.994565 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c82307-158b-4e0c-a145-5dbf13aa10b0 service neutron] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:24.996972 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-45c82307-158b-4e0c-a145-5dbf13aa10b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:25.013796 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c82307-158b-4e0c-a145-5dbf13aa10b0 service neutron] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:25.094933 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:43:25.106447 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a2630-8865-469f-a685-23fcff81c0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:25.107389 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a2630-8865-469f-a685-23fcff81c0e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:25.107648 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a2630-8865-469f-a685-23fcff81c0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:25.107927 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a2630-8865-469f-a685-23fcff81c0e8 admin admin] PATH_INFO: `/v3/users/1a2ed4cf77414eb5bf9d2eb155bd6040` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:25.112428 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a2630-8865-469f-a685-23fcff81c0e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a2ed4cf77414eb5bf9d2eb155bd6040)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:25.112428 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a2630-8865-469f-a685-23fcff81c0e8 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:25.286883 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-f17a2630-8865-469f-a685-23fcff81c0e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a2ed4cf77414eb5bf9d2eb155bd6040'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:25.287640 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-f17a2630-8865-469f-a685-23fcff81c0e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a2ed4cf77414eb5bf9d2eb155bd6040'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:25.369689 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-f17a2630-8865-469f-a685-23fcff81c0e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a2ed4cf77414eb5bf9d2eb155bd6040'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:25.370678 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-f17a2630-8865-469f-a685-23fcff81c0e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a2ed4cf77414eb5bf9d2eb155bd6040'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:25.392790 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-f17a2630-8865-469f-a685-23fcff81c0e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a2ed4cf77414eb5bf9d2eb155bd6040'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:25.417220 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1241/2478] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:43:24 2022] DELETE /identity/v3/users/1a2ed4cf77414eb5bf9d2eb155bd6040 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:43:25.421553 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889c55b-3668-44f2-80d6-abe43dde34ee None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:25.422453 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889c55b-3668-44f2-80d6-abe43dde34ee None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:25.422972 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889c55b-3668-44f2-80d6-abe43dde34ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:25.443907 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-a889c55b-3668-44f2-80d6-abe43dde34ee None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:43:25.445291 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-a889c55b-3668-44f2-80d6-abe43dde34ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:25.511725 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1238/2479] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:43:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 09:43:25.522068 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a2630-8865-469f-a685-23fcff81c0e8 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:25.525501 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-f17a2630-8865-469f-a685-23fcff81c0e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:25.595916 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a2630-8865-469f-a685-23fcff81c0e8 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:25.599911 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c0106-3926-41ea-bdb6-6004c2688512 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:25.600633 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c0106-3926-41ea-bdb6-6004c2688512 service neutron] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:25.600928 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c0106-3926-41ea-bdb6-6004c2688512 service neutron] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:25.601217 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c0106-3926-41ea-bdb6-6004c2688512 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:25.612448 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54c0106-3926-41ea-bdb6-6004c2688512 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:25.613923 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54c0106-3926-41ea-bdb6-6004c2688512 service neutron] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:25.624443 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1242/2480] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:43:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:43:26.197798 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889c55b-3668-44f2-80d6-abe43dde34ee None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:26.199167 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-a889c55b-3668-44f2-80d6-abe43dde34ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:26.213571 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889c55b-3668-44f2-80d6-abe43dde34ee None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:26.225374 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc5b15-157d-4352-8ce3-1a9c364f8568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:26.227523 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc5b15-157d-4352-8ce3-1a9c364f8568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:26.228491 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc5b15-157d-4352-8ce3-1a9c364f8568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:26.228943 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc5b15-157d-4352-8ce3-1a9c364f8568 admin admin] PATH_INFO: `/v3/projects/7a8feb2091364b11a0b7ce3c5b987e73` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:26.230415 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fc5b15-157d-4352-8ce3-1a9c364f8568 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a8feb2091364b11a0b7ce3c5b987e73)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:26.234178 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fc5b15-157d-4352-8ce3-1a9c364f8568 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:26.360508 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-40fc5b15-157d-4352-8ce3-1a9c364f8568 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a8feb2091364b11a0b7ce3c5b987e73', 'request_id': 'req-40fc5b15-157d-4352-8ce3-1a9c364f8568'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:26.426916 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-40fc5b15-157d-4352-8ce3-1a9c364f8568 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a8feb2091364b11a0b7ce3c5b987e73', 'request_id': 'req-40fc5b15-157d-4352-8ce3-1a9c364f8568'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:26.440538 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-40fc5b15-157d-4352-8ce3-1a9c364f8568 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a8feb2091364b11a0b7ce3c5b987e73', 'request_id': 'req-40fc5b15-157d-4352-8ce3-1a9c364f8568'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:26.457789 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-40fc5b15-157d-4352-8ce3-1a9c364f8568 admin admin] The token cache is being invalidate because project 7a8feb2091364b11a0b7ce3c5b987e73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:43:26.458068 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-40fc5b15-157d-4352-8ce3-1a9c364f8568 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:26.458755 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-40fc5b15-157d-4352-8ce3-1a9c364f8568 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:26.460610 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1239/2481] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:43:26 2022] DELETE /identity/v3/projects/7a8feb2091364b11a0b7ce3c5b987e73 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:43:26.464907 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c0106-3926-41ea-bdb6-6004c2688512 service neutron] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:26.480975 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c0106-3926-41ea-bdb6-6004c2688512 service neutron] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:26.549201 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b7d90-1ccf-4764-96ff-a401a61bf7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:26.555951 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b7d90-1ccf-4764-96ff-a401a61bf7a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:26.555951 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b7d90-1ccf-4764-96ff-a401a61bf7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:26.555951 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b7d90-1ccf-4764-96ff-a401a61bf7a5 admin admin] PATH_INFO: `/v3/users/1008a54bf41d4e049bad7bd0fc7ce03e` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:26.555951 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b7d90-1ccf-4764-96ff-a401a61bf7a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1008a54bf41d4e049bad7bd0fc7ce03e)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:26.555951 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b7d90-1ccf-4764-96ff-a401a61bf7a5 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:26.572402 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:43:26.734596 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-9b8b7d90-1ccf-4764-96ff-a401a61bf7a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1008a54bf41d4e049bad7bd0fc7ce03e'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:26.735505 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-9b8b7d90-1ccf-4764-96ff-a401a61bf7a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1008a54bf41d4e049bad7bd0fc7ce03e'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:26.821036 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-9b8b7d90-1ccf-4764-96ff-a401a61bf7a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1008a54bf41d4e049bad7bd0fc7ce03e'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:26.821971 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-9b8b7d90-1ccf-4764-96ff-a401a61bf7a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1008a54bf41d4e049bad7bd0fc7ce03e'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:26.831054 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-9b8b7d90-1ccf-4764-96ff-a401a61bf7a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1008a54bf41d4e049bad7bd0fc7ce03e'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:26.851198 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1243/2482] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:43:26 2022] DELETE /identity/v3/users/1008a54bf41d4e049bad7bd0fc7ce03e => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:43:27.370642 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc5b15-157d-4352-8ce3-1a9c364f8568 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:27.372832 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-40fc5b15-157d-4352-8ce3-1a9c364f8568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:27.388352 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc5b15-157d-4352-8ce3-1a9c364f8568 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:27.449915 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:43:27.488800 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e0853-12f6-4cdc-a2dc-c38c57cb10a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:27.489448 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e0853-12f6-4cdc-a2dc-c38c57cb10a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:27.489722 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e0853-12f6-4cdc-a2dc-c38c57cb10a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:27.490109 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e0853-12f6-4cdc-a2dc-c38c57cb10a4 admin admin] PATH_INFO: `/v3/projects/abf4281f5a0f4ab7a1ad1391b79bca86` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:27.491349 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892e0853-12f6-4cdc-a2dc-c38c57cb10a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abf4281f5a0f4ab7a1ad1391b79bca86)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:27.494381 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892e0853-12f6-4cdc-a2dc-c38c57cb10a4 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:27.676445 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-892e0853-12f6-4cdc-a2dc-c38c57cb10a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abf4281f5a0f4ab7a1ad1391b79bca86', 'request_id': 'req-892e0853-12f6-4cdc-a2dc-c38c57cb10a4'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:27.780832 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-892e0853-12f6-4cdc-a2dc-c38c57cb10a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abf4281f5a0f4ab7a1ad1391b79bca86', 'request_id': 'req-892e0853-12f6-4cdc-a2dc-c38c57cb10a4'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:27.787771 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-892e0853-12f6-4cdc-a2dc-c38c57cb10a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abf4281f5a0f4ab7a1ad1391b79bca86', 'request_id': 'req-892e0853-12f6-4cdc-a2dc-c38c57cb10a4'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:27.801947 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-892e0853-12f6-4cdc-a2dc-c38c57cb10a4 admin admin] The token cache is being invalidate because project abf4281f5a0f4ab7a1ad1391b79bca86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:43:27.802241 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-892e0853-12f6-4cdc-a2dc-c38c57cb10a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:27.802952 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-892e0853-12f6-4cdc-a2dc-c38c57cb10a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:27.804606 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1240/2483] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:43:27 2022] DELETE /identity/v3/projects/abf4281f5a0f4ab7a1ad1391b79bca86 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:43:27.809927 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e91292d-2d9a-4478-8ff5-b1d63b489c22 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:27.810547 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e91292d-2d9a-4478-8ff5-b1d63b489c22 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:27.810547 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e91292d-2d9a-4478-8ff5-b1d63b489c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:27.830853 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-1e91292d-2d9a-4478-8ff5-b1d63b489c22 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:43:27.832114 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-1e91292d-2d9a-4478-8ff5-b1d63b489c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:27.900045 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1244/2484] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:43:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:43:27.908346 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ad1a8-4eb8-44b9-97c6-d404e0b32b8f None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:27.908640 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ad1a8-4eb8-44b9-97c6-d404e0b32b8f None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:27.909523 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ad1a8-4eb8-44b9-97c6-d404e0b32b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:27.929114 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-748ad1a8-4eb8-44b9-97c6-d404e0b32b8f None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:43:27.931536 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-748ad1a8-4eb8-44b9-97c6-d404e0b32b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:27.940334 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1241/2485] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:43:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 09:43:27.944980 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e91292d-2d9a-4478-8ff5-b1d63b489c22 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:27.955636 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e91292d-2d9a-4478-8ff5-b1d63b489c22 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:27.960307 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a75f0-f53f-4a74-b5b8-202b26d25a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:27.961614 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a75f0-f53f-4a74-b5b8-202b26d25a60 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:27.961895 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a75f0-f53f-4a74-b5b8-202b26d25a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:27.962174 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a75f0-f53f-4a74-b5b8-202b26d25a60 admin admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:27.962965 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596a75f0-f53f-4a74-b5b8-202b26d25a60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:43:27.963276 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596a75f0-f53f-4a74-b5b8-202b26d25a60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:27.964950 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596a75f0-f53f-4a74-b5b8-202b26d25a60 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:27.989931 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1245/2486] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:43:27.993158 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ad1a8-4eb8-44b9-97c6-d404e0b32b8f None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:28.002432 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ad1a8-4eb8-44b9-97c6-d404e0b32b8f None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:28.007297 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eef29b-cef3-4bcd-91bc-804d069c3527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:28.008474 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eef29b-cef3-4bcd-91bc-804d069c3527 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:28.008759 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eef29b-cef3-4bcd-91bc-804d069c3527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:28.009038 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eef29b-cef3-4bcd-91bc-804d069c3527 admin admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:28.009725 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eef29b-cef3-4bcd-91bc-804d069c3527 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:28.011634 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eef29b-cef3-4bcd-91bc-804d069c3527 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:28.217232 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1242/2487] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:43:27 2022] POST /identity/v3/projects => generated 389 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:43:28.221270 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a75f0-f53f-4a74-b5b8-202b26d25a60 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:28.234529 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a75f0-f53f-4a74-b5b8-202b26d25a60 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:28.292619 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0b0e7-070f-470b-a908-938d73c71eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:28.293284 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0b0e7-070f-470b-a908-938d73c71eff admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:28.293567 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0b0e7-070f-470b-a908-938d73c71eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:28.293843 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0b0e7-070f-470b-a908-938d73c71eff admin admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:28.294537 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc0b0e7-070f-470b-a908-938d73c71eff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:28.296470 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc0b0e7-070f-470b-a908-938d73c71eff admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:28.524118 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1246/2488] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:43:28 2022] POST /identity/v3/users => generated 295 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:43:28.528130 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eef29b-cef3-4bcd-91bc-804d069c3527 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:28.539191 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eef29b-cef3-4bcd-91bc-804d069c3527 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:28.543936 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d3a79-d694-4f8e-a51e-1290755d094a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:28.551618 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d3a79-d694-4f8e-a51e-1290755d094a admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:28.551618 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d3a79-d694-4f8e-a51e-1290755d094a admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:28.551618 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d3a79-d694-4f8e-a51e-1290755d094a admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:28.551618 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901d3a79-d694-4f8e-a51e-1290755d094a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:28.551618 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901d3a79-d694-4f8e-a51e-1290755d094a admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:28.559000 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1243/2489] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:43:28.563168 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0b0e7-070f-470b-a908-938d73c71eff admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:28.574674 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0b0e7-070f-470b-a908-938d73c71eff admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:28.579320 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698fde2b-8493-4fd6-a3c2-25dc1c7dbd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:28.579980 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698fde2b-8493-4fd6-a3c2-25dc1c7dbd2f admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:28.584641 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698fde2b-8493-4fd6-a3c2-25dc1c7dbd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:28.584641 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698fde2b-8493-4fd6-a3c2-25dc1c7dbd2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:28.584641 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698fde2b-8493-4fd6-a3c2-25dc1c7dbd2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:28.584641 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698fde2b-8493-4fd6-a3c2-25dc1c7dbd2f admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:28.585335 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:43:28.594625 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1247/2490] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:43:28.598841 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d3a79-d694-4f8e-a51e-1290755d094a admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:28.609573 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d3a79-d694-4f8e-a51e-1290755d094a admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:28.614277 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756abce1-82e3-466d-ba8e-85097de20c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:28.615178 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756abce1-82e3-466d-ba8e-85097de20c82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:28.615461 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756abce1-82e3-466d-ba8e-85097de20c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:28.615734 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756abce1-82e3-466d-ba8e-85097de20c82 admin admin] PATH_INFO: `/v3/projects/a6225850f9694acfb6254f504aa938d1/users/ae8c80b3f525430c8e540e77dfdbc19e/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:28.634828 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756abce1-82e3-466d-ba8e-85097de20c82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6225850f9694acfb6254f504aa938d1, user_id=ae8c80b3f525430c8e540e77dfdbc19e, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:28.637779 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756abce1-82e3-466d-ba8e-85097de20c82 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:28.728718 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1244/2491] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:43:28 2022] PUT /identity/v3/projects/a6225850f9694acfb6254f504aa938d1/users/ae8c80b3f525430c8e540e77dfdbc19e/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:43:28.739962 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5694426-b014-41a5-8901-da7c7abb9d3e None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:28.740275 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5694426-b014-41a5-8901-da7c7abb9d3e None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:28.740555 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5694426-b014-41a5-8901-da7c7abb9d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:28.774102 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-d5694426-b014-41a5-8901-da7c7abb9d3e None None] MFA Rules not processed for user `ae8c80b3f525430c8e540e77dfdbc19e`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:43:28.777284 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-d5694426-b014-41a5-8901-da7c7abb9d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:28.848899 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1248/2492] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:43:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:43:28.854537 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756abce1-82e3-466d-ba8e-85097de20c82 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:28.924337 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756abce1-82e3-466d-ba8e-85097de20c82 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:28.929218 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0170683-7525-497e-b924-8c4cbdf19f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:28.930108 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0170683-7525-497e-b924-8c4cbdf19f59 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:28.930274 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0170683-7525-497e-b924-8c4cbdf19f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:28.930620 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0170683-7525-497e-b924-8c4cbdf19f59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:28.931819 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0170683-7525-497e-b924-8c4cbdf19f59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:28.933816 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0170683-7525-497e-b924-8c4cbdf19f59 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:28.937608 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:43:29.022932 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1245/2493] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:43:28 2022] POST /identity/v3/projects => generated 393 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 09:43:29.026510 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5694426-b014-41a5-8901-da7c7abb9d3e None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:29.041107 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5694426-b014-41a5-8901-da7c7abb9d3e None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:29.120376 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a639212-d70f-44ea-8008-0ec4643efc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:29.121104 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a639212-d70f-44ea-8008-0ec4643efc77 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:29.121398 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a639212-d70f-44ea-8008-0ec4643efc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:29.121676 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a639212-d70f-44ea-8008-0ec4643efc77 admin admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:29.122372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a639212-d70f-44ea-8008-0ec4643efc77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:29.124329 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a639212-d70f-44ea-8008-0ec4643efc77 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:29.210831 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1249/2494] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:43:29 2022] POST /identity/v3/users => generated 303 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 09:43:29.215083 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0170683-7525-497e-b924-8c4cbdf19f59 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:29.227259 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0170683-7525-497e-b924-8c4cbdf19f59 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:29.232854 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd391f56-3d25-4a6f-85d4-29bd492dd782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:29.233872 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd391f56-3d25-4a6f-85d4-29bd492dd782 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:29.234154 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd391f56-3d25-4a6f-85d4-29bd492dd782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:29.234447 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd391f56-3d25-4a6f-85d4-29bd492dd782 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:29.235167 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd391f56-3d25-4a6f-85d4-29bd492dd782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:29.236917 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd391f56-3d25-4a6f-85d4-29bd492dd782 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:29.252497 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1246/2495] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:43:29.253947 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a639212-d70f-44ea-8008-0ec4643efc77 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:29.264909 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a639212-d70f-44ea-8008-0ec4643efc77 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:29.270782 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e39dc-476f-4764-9352-ce270b6bb271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:29.271811 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e39dc-476f-4764-9352-ce270b6bb271 admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:29.272224 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e39dc-476f-4764-9352-ce270b6bb271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:29.272630 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e39dc-476f-4764-9352-ce270b6bb271 admin admin] PATH_INFO: `/v3/projects/b3cd41d2cadd410ea9726047132a6b87/users/d27debb2c90443f1a3f35973027a8bca/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:29.290400 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e39dc-476f-4764-9352-ce270b6bb271 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3cd41d2cadd410ea9726047132a6b87, user_id=d27debb2c90443f1a3f35973027a8bca, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:29.293425 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e39dc-476f-4764-9352-ce270b6bb271 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:29.461638 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1250/2496] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:43:29 2022] PUT /identity/v3/projects/b3cd41d2cadd410ea9726047132a6b87/users/d27debb2c90443f1a3f35973027a8bca/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:43:29.465778 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd391f56-3d25-4a6f-85d4-29bd492dd782 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:29.475883 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd391f56-3d25-4a6f-85d4-29bd492dd782 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:29.535440 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a13d17-d9a7-4b15-a258-ab465320c72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:29.537808 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a13d17-d9a7-4b15-a258-ab465320c72b admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:29.537808 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a13d17-d9a7-4b15-a258-ab465320c72b admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:29.537808 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a13d17-d9a7-4b15-a258-ab465320c72b admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:29.537808 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a13d17-d9a7-4b15-a258-ab465320c72b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:29.539426 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a13d17-d9a7-4b15-a258-ab465320c72b admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:29.549798 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1247/2497] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:43:29.554101 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e39dc-476f-4764-9352-ce270b6bb271 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:29.565607 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e39dc-476f-4764-9352-ce270b6bb271 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:29.572128 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18395836-599c-4bce-90bf-01e6141df518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:29.572128 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18395836-599c-4bce-90bf-01e6141df518 admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:29.572128 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18395836-599c-4bce-90bf-01e6141df518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:29.572486 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18395836-599c-4bce-90bf-01e6141df518 admin admin] PATH_INFO: `/v3/projects/b3cd41d2cadd410ea9726047132a6b87/users/d27debb2c90443f1a3f35973027a8bca/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:29.574225 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18395836-599c-4bce-90bf-01e6141df518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3cd41d2cadd410ea9726047132a6b87, user_id=d27debb2c90443f1a3f35973027a8bca, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:29.576891 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18395836-599c-4bce-90bf-01e6141df518 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:29.588452 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1251/2498] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:43:29 2022] PUT /identity/v3/projects/b3cd41d2cadd410ea9726047132a6b87/users/d27debb2c90443f1a3f35973027a8bca/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:43:29.605827 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6720e-04ba-4129-9e69-3ba7d3b8ac25 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:29.605827 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6720e-04ba-4129-9e69-3ba7d3b8ac25 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:29.606762 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6720e-04ba-4129-9e69-3ba7d3b8ac25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:29.636977 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-c7a6720e-04ba-4129-9e69-3ba7d3b8ac25 None None] MFA Rules not processed for user `d27debb2c90443f1a3f35973027a8bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:43:29.638264 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-c7a6720e-04ba-4129-9e69-3ba7d3b8ac25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:29.718769 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1248/2499] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:43:29 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:43:29.729721 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18395836-599c-4bce-90bf-01e6141df518 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:29.731519 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-18395836-599c-4bce-90bf-01e6141df518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:29.788574 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:43:29.803453 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18395836-599c-4bce-90bf-01e6141df518 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:29.807215 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2991e-0137-47ab-9fd0-91256c40aaaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:29.807860 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2991e-0137-47ab-9fd0-91256c40aaaa service cinder] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:29.808411 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2991e-0137-47ab-9fd0-91256c40aaaa service cinder] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:29.808411 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2991e-0137-47ab-9fd0-91256c40aaaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:29.817619 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c2991e-0137-47ab-9fd0-91256c40aaaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:29.819052 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c2991e-0137-47ab-9fd0-91256c40aaaa service cinder] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:29.829658 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1252/2500] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:43:29 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:43:29.881364 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a6720e-04ba-4129-9e69-3ba7d3b8ac25 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:29.883435 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-c7a6720e-04ba-4129-9e69-3ba7d3b8ac25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:29.897005 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a6720e-04ba-4129-9e69-3ba7d3b8ac25 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:29.901152 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5937c232-f58f-47d4-9ce0-2791efcb6e41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:29.901812 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937c232-f58f-47d4-9ce0-2791efcb6e41 service cinder] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:29.902098 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937c232-f58f-47d4-9ce0-2791efcb6e41 service cinder] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:29.902377 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937c232-f58f-47d4-9ce0-2791efcb6e41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:29.959214 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:43:29.964269 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5937c232-f58f-47d4-9ce0-2791efcb6e41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:29.964431 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5937c232-f58f-47d4-9ce0-2791efcb6e41 service cinder] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:29.973474 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1249/2501] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:43:29 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:43:35.651330 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1517ab-4b50-421f-9e01-b5de54bbc81f None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:35.651945 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1517ab-4b50-421f-9e01-b5de54bbc81f None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:35.652280 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1517ab-4b50-421f-9e01-b5de54bbc81f None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:35.654018 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1253/2502] 10.222.0.62 () {54 vars in 921 bytes} [Mon Jun 27 09:43:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:43:35.661719 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d7317-c784-401a-9494-0d663848ed58 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:35.661719 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d7317-c784-401a-9494-0d663848ed58 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:35.661719 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d7317-c784-401a-9494-0d663848ed58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:35.680851 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-816d7317-c784-401a-9494-0d663848ed58 None None] MFA Rules not processed for user `2c1434a85b30411c9c59cc50c3980cd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:43:35.682693 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-816d7317-c784-401a-9494-0d663848ed58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:35.754920 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1250/2503] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Jun 27 09:43:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:43:35.766706 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1517ab-4b50-421f-9e01-b5de54bbc81f None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:35.768428 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-6d1517ab-4b50-421f-9e01-b5de54bbc81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:35.828946 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1517ab-4b50-421f-9e01-b5de54bbc81f None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:35.832928 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef8e51-8d51-4c55-b7cc-064209964466 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6f97b803a28453c8b78fd8380ac64ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:35.833962 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef8e51-8d51-4c55-b7cc-064209964466 service glance] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:35.834485 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef8e51-8d51-4c55-b7cc-064209964466 service glance] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:35.834825 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef8e51-8d51-4c55-b7cc-064209964466 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:35.846721 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef8e51-8d51-4c55-b7cc-064209964466 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:35.848163 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef8e51-8d51-4c55-b7cc-064209964466 service glance] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:35.860079 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1254/2504] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:43:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:43:35.871840 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d7317-c784-401a-9494-0d663848ed58 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:35.948848 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d7317-c784-401a-9494-0d663848ed58 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:35.955283 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207f040-2a49-4e97-b3c0-60477b1e28a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:35.956286 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207f040-2a49-4e97-b3c0-60477b1e28a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:35.956569 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207f040-2a49-4e97-b3c0-60477b1e28a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:35.956846 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207f040-2a49-4e97-b3c0-60477b1e28a6 admin admin] PATH_INFO: `/v3/users/ae8c80b3f525430c8e540e77dfdbc19e` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:35.958051 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c207f040-2a49-4e97-b3c0-60477b1e28a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae8c80b3f525430c8e540e77dfdbc19e)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:35.959993 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c207f040-2a49-4e97-b3c0-60477b1e28a6 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:36.072796 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d69a87-b139-49e2-bf0e-d24d1f2b1372 None None] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:36.073089 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d69a87-b139-49e2-bf0e-d24d1f2b1372 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:36.073374 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d69a87-b139-49e2-bf0e-d24d1f2b1372 None None] PATH_INFO: `/` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:36.074767 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1255/2505] 10.222.0.62 () {54 vars in 921 bytes} [Mon Jun 27 09:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 09:43:36.079443 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf5fca-ee6e-4a26-ac37-cfe98053b83d None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:36.079735 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf5fca-ee6e-4a26-ac37-cfe98053b83d None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:36.080012 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf5fca-ee6e-4a26-ac37-cfe98053b83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:36.100153 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-9adf5fca-ee6e-4a26-ac37-cfe98053b83d None None] MFA Rules not processed for user `097b991d67164cda94cc5aa24397f414`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:43:36.101432 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-9adf5fca-ee6e-4a26-ac37-cfe98053b83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:36.156072 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1256/2506] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Jun 27 09:43:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 09:43:36.167635 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf5fca-ee6e-4a26-ac37-cfe98053b83d None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:36.169029 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-9adf5fca-ee6e-4a26-ac37-cfe98053b83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:36.179262 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf5fca-ee6e-4a26-ac37-cfe98053b83d None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:36.183386 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b141e-f979-4930-81a4-cf711ede9070 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:36.187905 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b141e-f979-4930-81a4-cf711ede9070 service neutron] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:36.187905 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b141e-f979-4930-81a4-cf711ede9070 service neutron] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:36.187905 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b141e-f979-4930-81a4-cf711ede9070 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:36.191845 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b141e-f979-4930-81a4-cf711ede9070 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:36.193311 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b141e-f979-4930-81a4-cf711ede9070 service neutron] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:36.193464 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-c207f040-2a49-4e97-b3c0-60477b1e28a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae8c80b3f525430c8e540e77dfdbc19e'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:36.201322 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-c207f040-2a49-4e97-b3c0-60477b1e28a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae8c80b3f525430c8e540e77dfdbc19e'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:36.202260 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1257/2507] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:43:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 09:43:36.268293 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-c207f040-2a49-4e97-b3c0-60477b1e28a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae8c80b3f525430c8e540e77dfdbc19e'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:36.268293 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-c207f040-2a49-4e97-b3c0-60477b1e28a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae8c80b3f525430c8e540e77dfdbc19e'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:36.281463 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-c207f040-2a49-4e97-b3c0-60477b1e28a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae8c80b3f525430c8e540e77dfdbc19e'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:36.288284 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1251/2508] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:43:35 2022] DELETE /identity/v3/users/ae8c80b3f525430c8e540e77dfdbc19e => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:43:36.296964 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb3ddc-aa0b-42a2-870e-42966e6be979 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:36.297107 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a4661-c7e7-466a-8991-d1642ff0c5db None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:36.297220 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb3ddc-aa0b-42a2-870e-42966e6be979 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:36.297304 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a4661-c7e7-466a-8991-d1642ff0c5db None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:36.297381 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb3ddc-aa0b-42a2-870e-42966e6be979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:36.297474 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a4661-c7e7-466a-8991-d1642ff0c5db None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:36.297474 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1252/2509] 10.222.0.62 () {54 vars in 921 bytes} [Mon Jun 27 09:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 09:43:36.301266 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594bcd72-f51c-4938-97e8-f2ac3cd755f0 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:36.301584 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594bcd72-f51c-4938-97e8-f2ac3cd755f0 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:36.301999 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594bcd72-f51c-4938-97e8-f2ac3cd755f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:36.309744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:43:36.313477 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-a1cb3ddc-aa0b-42a2-870e-42966e6be979 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:43:36.314742 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-a1cb3ddc-aa0b-42a2-870e-42966e6be979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:36.322127 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-594bcd72-f51c-4938-97e8-f2ac3cd755f0 None None] MFA Rules not processed for user `2c1434a85b30411c9c59cc50c3980cd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:43:36.323324 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-594bcd72-f51c-4938-97e8-f2ac3cd755f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:36.377851 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1258/2510] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:43:36.388733 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb3ddc-aa0b-42a2-870e-42966e6be979 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:36.390117 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-a1cb3ddc-aa0b-42a2-870e-42966e6be979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:36.391898 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1253/2511] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Jun 27 09:43:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:43:36.403811 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594bcd72-f51c-4938-97e8-f2ac3cd755f0 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:36.405248 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-594bcd72-f51c-4938-97e8-f2ac3cd755f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:36.420239 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:43:36.452799 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb3ddc-aa0b-42a2-870e-42966e6be979 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:36.457166 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c9a18-9d55-43de-8618-7d52f57a1f97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:36.457816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c9a18-9d55-43de-8618-7d52f57a1f97 service neutron] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:36.458091 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c9a18-9d55-43de-8618-7d52f57a1f97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:36.458365 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c9a18-9d55-43de-8618-7d52f57a1f97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:36.464009 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594bcd72-f51c-4938-97e8-f2ac3cd755f0 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:36.468388 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd57ff-46ee-465c-9aef-7f72afa4417c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:36.468588 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1c9a18-9d55-43de-8618-7d52f57a1f97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:36.469082 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd57ff-46ee-465c-9aef-7f72afa4417c service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:36.469365 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd57ff-46ee-465c-9aef-7f72afa4417c service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:36.469644 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd57ff-46ee-465c-9aef-7f72afa4417c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:36.470023 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1c9a18-9d55-43de-8618-7d52f57a1f97 service neutron] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:36.479914 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1259/2512] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:43:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 09:43:36.482562 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dd57ff-46ee-465c-9aef-7f72afa4417c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:36.484172 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dd57ff-46ee-465c-9aef-7f72afa4417c service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:36.495460 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1254/2513] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:43:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 09:43:36.869143 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c9a18-9d55-43de-8618-7d52f57a1f97 service neutron] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:36.870779 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-7d1c9a18-9d55-43de-8618-7d52f57a1f97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:36.890351 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c9a18-9d55-43de-8618-7d52f57a1f97 service neutron] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:36.896306 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fad15a-2c72-4a5a-8edd-2121c7e8975e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:36.899306 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fad15a-2c72-4a5a-8edd-2121c7e8975e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:36.899796 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fad15a-2c72-4a5a-8edd-2121c7e8975e admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:36.900667 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fad15a-2c72-4a5a-8edd-2121c7e8975e admin admin] PATH_INFO: `/v3/projects/a6225850f9694acfb6254f504aa938d1` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:36.902917 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fad15a-2c72-4a5a-8edd-2121c7e8975e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6225850f9694acfb6254f504aa938d1)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:36.905713 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fad15a-2c72-4a5a-8edd-2121c7e8975e admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:37.078497 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-e6fad15a-2c72-4a5a-8edd-2121c7e8975e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6225850f9694acfb6254f504aa938d1', 'request_id': 'req-e6fad15a-2c72-4a5a-8edd-2121c7e8975e'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:37.167173 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-e6fad15a-2c72-4a5a-8edd-2121c7e8975e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6225850f9694acfb6254f504aa938d1', 'request_id': 'req-e6fad15a-2c72-4a5a-8edd-2121c7e8975e'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:37.173801 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-e6fad15a-2c72-4a5a-8edd-2121c7e8975e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6225850f9694acfb6254f504aa938d1', 'request_id': 'req-e6fad15a-2c72-4a5a-8edd-2121c7e8975e'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:37.185691 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-e6fad15a-2c72-4a5a-8edd-2121c7e8975e admin admin] The token cache is being invalidate because project a6225850f9694acfb6254f504aa938d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:43:37.185981 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-e6fad15a-2c72-4a5a-8edd-2121c7e8975e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:37.187192 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-e6fad15a-2c72-4a5a-8edd-2121c7e8975e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:37.188822 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1260/2514] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:43:36 2022] DELETE /identity/v3/projects/a6225850f9694acfb6254f504aa938d1 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:43:37.193546 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd57ff-46ee-465c-9aef-7f72afa4417c service neutron] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:37.205200 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd57ff-46ee-465c-9aef-7f72afa4417c service neutron] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:37.261487 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be69cfe-a218-4a57-8ba4-d26ee08c3ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:37.262344 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be69cfe-a218-4a57-8ba4-d26ee08c3ea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:37.262620 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be69cfe-a218-4a57-8ba4-d26ee08c3ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:37.262927 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be69cfe-a218-4a57-8ba4-d26ee08c3ea6 admin admin] PATH_INFO: `/v3/users/d27debb2c90443f1a3f35973027a8bca` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:37.264101 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be69cfe-a218-4a57-8ba4-d26ee08c3ea6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d27debb2c90443f1a3f35973027a8bca)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:37.267336 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be69cfe-a218-4a57-8ba4-d26ee08c3ea6 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:37.493407 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:43:37.498676 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-8be69cfe-a218-4a57-8ba4-d26ee08c3ea6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd27debb2c90443f1a3f35973027a8bca'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:37.505647 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-8be69cfe-a218-4a57-8ba4-d26ee08c3ea6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd27debb2c90443f1a3f35973027a8bca'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:37.618562 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-8be69cfe-a218-4a57-8ba4-d26ee08c3ea6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd27debb2c90443f1a3f35973027a8bca'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:37.619298 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-8be69cfe-a218-4a57-8ba4-d26ee08c3ea6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd27debb2c90443f1a3f35973027a8bca'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:37.633625 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-8be69cfe-a218-4a57-8ba4-d26ee08c3ea6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd27debb2c90443f1a3f35973027a8bca'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:37.640560 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1255/2515] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:43:37 2022] DELETE /identity/v3/users/d27debb2c90443f1a3f35973027a8bca => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:43:38.387930 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fad15a-2c72-4a5a-8edd-2121c7e8975e admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:38.388560 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-e6fad15a-2c72-4a5a-8edd-2121c7e8975e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:38.409235 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fad15a-2c72-4a5a-8edd-2121c7e8975e admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:38.486358 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d9a6ba-081c-4c0e-ba20-5ccf9c90ffd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:38.487383 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9a6ba-081c-4c0e-ba20-5ccf9c90ffd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:38.487743 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9a6ba-081c-4c0e-ba20-5ccf9c90ffd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:38.488092 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9a6ba-081c-4c0e-ba20-5ccf9c90ffd8 admin admin] PATH_INFO: `/v3/projects/b3cd41d2cadd410ea9726047132a6b87` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:38.489461 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d9a6ba-081c-4c0e-ba20-5ccf9c90ffd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3cd41d2cadd410ea9726047132a6b87)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:38.491449 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d9a6ba-081c-4c0e-ba20-5ccf9c90ffd8 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:38.597392 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-b2d9a6ba-081c-4c0e-ba20-5ccf9c90ffd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3cd41d2cadd410ea9726047132a6b87', 'request_id': 'req-b2d9a6ba-081c-4c0e-ba20-5ccf9c90ffd8'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:38.599205 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:43:38.689290 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-b2d9a6ba-081c-4c0e-ba20-5ccf9c90ffd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3cd41d2cadd410ea9726047132a6b87', 'request_id': 'req-b2d9a6ba-081c-4c0e-ba20-5ccf9c90ffd8'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:38.697283 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-b2d9a6ba-081c-4c0e-ba20-5ccf9c90ffd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3cd41d2cadd410ea9726047132a6b87', 'request_id': 'req-b2d9a6ba-081c-4c0e-ba20-5ccf9c90ffd8'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:38.708693 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-b2d9a6ba-081c-4c0e-ba20-5ccf9c90ffd8 admin admin] The token cache is being invalidate because project b3cd41d2cadd410ea9726047132a6b87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:43:38.709042 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-b2d9a6ba-081c-4c0e-ba20-5ccf9c90ffd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:38.709689 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-b2d9a6ba-081c-4c0e-ba20-5ccf9c90ffd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:38.711390 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1261/2516] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:43:38 2022] DELETE /identity/v3/projects/b3cd41d2cadd410ea9726047132a6b87 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:43:38.716074 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dcb86c-0c0b-45f5-97b7-37de79cad366 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:38.716587 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dcb86c-0c0b-45f5-97b7-37de79cad366 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:38.716685 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dcb86c-0c0b-45f5-97b7-37de79cad366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:38.735445 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-53dcb86c-0c0b-45f5-97b7-37de79cad366 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:43:38.736595 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-53dcb86c-0c0b-45f5-97b7-37de79cad366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:38.795325 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1256/2517] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:43:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:43:38.805046 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6acc3-5876-44ab-a460-b54361815c83 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:38.805389 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6acc3-5876-44ab-a460-b54361815c83 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:38.805651 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6acc3-5876-44ab-a460-b54361815c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:38.824522 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-94b6acc3-5876-44ab-a460-b54361815c83 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:43:38.825733 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-94b6acc3-5876-44ab-a460-b54361815c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:38.833585 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1262/2518] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:43:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:43:38.838390 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dcb86c-0c0b-45f5-97b7-37de79cad366 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:38.847815 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dcb86c-0c0b-45f5-97b7-37de79cad366 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:38.853319 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949309e-0852-44b0-927b-ea872a9cda2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:38.853963 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949309e-0852-44b0-927b-ea872a9cda2f admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:38.856129 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949309e-0852-44b0-927b-ea872a9cda2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:38.856129 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949309e-0852-44b0-927b-ea872a9cda2f admin admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:38.856129 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949309e-0852-44b0-927b-ea872a9cda2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:43:38.856129 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949309e-0852-44b0-927b-ea872a9cda2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:38.857165 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949309e-0852-44b0-927b-ea872a9cda2f admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:38.867748 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814ac77-6675-4556-909b-17ab276452f0 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:38.868042 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814ac77-6675-4556-909b-17ab276452f0 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:38.868364 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814ac77-6675-4556-909b-17ab276452f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:38.873999 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1257/2519] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:43:38.874978 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949309e-0852-44b0-927b-ea872a9cda2f admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:38.885094 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949309e-0852-44b0-927b-ea872a9cda2f admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:38.886661 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-e814ac77-6675-4556-909b-17ab276452f0 None None] MFA Rules not processed for user `8f5d1f2327914f9fb070c6212582b6dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:43:38.887878 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-e814ac77-6675-4556-909b-17ab276452f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:38.890083 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60522bf-a1f3-49fa-b7de-7086c8d7ebef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:38.890761 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60522bf-a1f3-49fa-b7de-7086c8d7ebef admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:38.891087 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60522bf-a1f3-49fa-b7de-7086c8d7ebef admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:38.891390 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60522bf-a1f3-49fa-b7de-7086c8d7ebef admin admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:38.892091 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60522bf-a1f3-49fa-b7de-7086c8d7ebef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:38.894057 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60522bf-a1f3-49fa-b7de-7086c8d7ebef admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:38.945174 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1263/2520] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Jun 27 09:43:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 09:43:38.956993 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814ac77-6675-4556-909b-17ab276452f0 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:38.958350 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-e814ac77-6675-4556-909b-17ab276452f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:38.983034 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1258/2521] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:43:38 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 09:43:38.987355 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60522bf-a1f3-49fa-b7de-7086c8d7ebef admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:39.030629 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814ac77-6675-4556-909b-17ab276452f0 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:39.049664 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60522bf-a1f3-49fa-b7de-7086c8d7ebef admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:39.054690 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af774373-fef8-4c15-b464-814dcd975d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:39.055364 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af774373-fef8-4c15-b464-814dcd975d05 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:39.055645 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af774373-fef8-4c15-b464-814dcd975d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:39.055920 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af774373-fef8-4c15-b464-814dcd975d05 admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:39.056943 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af774373-fef8-4c15-b464-814dcd975d05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:39.058791 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af774373-fef8-4c15-b464-814dcd975d05 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:39.090742 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619a58f-f67b-4188-b3ec-b9a16aaf8184 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5477b14dae24fd3a644c9cbd6ff85ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:39.091469 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619a58f-f67b-4188-b3ec-b9a16aaf8184 service swift] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:39.091681 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619a58f-f67b-4188-b3ec-b9a16aaf8184 service swift] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:39.091957 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619a58f-f67b-4188-b3ec-b9a16aaf8184 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:39.111020 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:43:39.140531 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1259/2522] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:43:38 2022] POST /identity/v3/users => generated 290 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 09:43:39.147418 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af774373-fef8-4c15-b464-814dcd975d05 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:39.151649 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f619a58f-f67b-4188-b3ec-b9a16aaf8184 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:39.153297 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f619a58f-f67b-4188-b3ec-b9a16aaf8184 service swift] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:39.157842 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af774373-fef8-4c15-b464-814dcd975d05 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:39.161560 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1264/2523] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Jun 27 09:43:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 27 09:43:39.163226 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb9ad89-4048-4ba6-b148-0c34b92dcf25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:39.163570 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9ad89-4048-4ba6-b148-0c34b92dcf25 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:39.164499 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9ad89-4048-4ba6-b148-0c34b92dcf25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:39.164803 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9ad89-4048-4ba6-b148-0c34b92dcf25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:39.165488 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb9ad89-4048-4ba6-b148-0c34b92dcf25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:39.167068 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb9ad89-4048-4ba6-b148-0c34b92dcf25 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:39.179118 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1260/2524] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 09:43:39.181786 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619a58f-f67b-4188-b3ec-b9a16aaf8184 service swift] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:39.192192 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619a58f-f67b-4188-b3ec-b9a16aaf8184 service swift] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:39.196803 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f6a0f7-81e5-4269-8f6d-f3ed98bf4858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:39.197444 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6a0f7-81e5-4269-8f6d-f3ed98bf4858 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:39.197717 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6a0f7-81e5-4269-8f6d-f3ed98bf4858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:39.197986 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6a0f7-81e5-4269-8f6d-f3ed98bf4858 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:39.198714 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f6a0f7-81e5-4269-8f6d-f3ed98bf4858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:39.200348 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f6a0f7-81e5-4269-8f6d-f3ed98bf4858 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:39.209944 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1265/2525] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:43:39.214911 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb9ad89-4048-4ba6-b148-0c34b92dcf25 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:39.219987 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:43:39.225245 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb9ad89-4048-4ba6-b148-0c34b92dcf25 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:39.230882 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e97f2b-3fb6-490c-baf2-17a8ab6c0c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:39.235970 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e97f2b-3fb6-490c-baf2-17a8ab6c0c6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:39.235970 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e97f2b-3fb6-490c-baf2-17a8ab6c0c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:39.235970 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e97f2b-3fb6-490c-baf2-17a8ab6c0c6a admin admin] PATH_INFO: `/v3/projects/a4fcfe7b88da48abb5cc587c14e5ee9f/users/e8b273754ba441bb8e8545b240b574a9/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:39.246833 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e97f2b-3fb6-490c-baf2-17a8ab6c0c6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4fcfe7b88da48abb5cc587c14e5ee9f, user_id=e8b273754ba441bb8e8545b240b574a9, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:39.249437 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e97f2b-3fb6-490c-baf2-17a8ab6c0c6a admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:39.326851 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1261/2526] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:43:39 2022] PUT /identity/v3/projects/a4fcfe7b88da48abb5cc587c14e5ee9f/users/e8b273754ba441bb8e8545b240b574a9/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:43:39.337845 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6022f4-4d85-4ae0-b946-40c52d64e432 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:39.338146 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6022f4-4d85-4ae0-b946-40c52d64e432 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:39.338540 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6022f4-4d85-4ae0-b946-40c52d64e432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:39.401690 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-0d6022f4-4d85-4ae0-b946-40c52d64e432 None None] MFA Rules not processed for user `e8b273754ba441bb8e8545b240b574a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:43:39.405397 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-0d6022f4-4d85-4ae0-b946-40c52d64e432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:39.519689 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1266/2527] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:43:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:43:39.524111 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e97f2b-3fb6-490c-baf2-17a8ab6c0c6a admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:39.625797 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e97f2b-3fb6-490c-baf2-17a8ab6c0c6a admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:39.635066 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991a980-0925-4d58-a68c-9e78e77b8a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:39.635902 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991a980-0925-4d58-a68c-9e78e77b8a6e admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:39.636323 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991a980-0925-4d58-a68c-9e78e77b8a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:39.636709 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991a980-0925-4d58-a68c-9e78e77b8a6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:39.637510 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9991a980-0925-4d58-a68c-9e78e77b8a6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:39.639592 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9991a980-0925-4d58-a68c-9e78e77b8a6e admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:39.780239 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1262/2528] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:43:39 2022] POST /identity/v3/projects => generated 379 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:43:39.781140 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6022f4-4d85-4ae0-b946-40c52d64e432 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:39.792961 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6022f4-4d85-4ae0-b946-40c52d64e432 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:39.856074 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4bbf2-6a48-4ae4-82d6-d8a49c6268bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:39.856893 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4bbf2-6a48-4ae4-82d6-d8a49c6268bc admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:39.857178 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4bbf2-6a48-4ae4-82d6-d8a49c6268bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:39.857449 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4bbf2-6a48-4ae4-82d6-d8a49c6268bc admin admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:39.858129 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b4bbf2-6a48-4ae4-82d6-d8a49c6268bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:39.860266 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b4bbf2-6a48-4ae4-82d6-d8a49c6268bc admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:39.988003 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1267/2529] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:43:39 2022] POST /identity/v3/users => generated 296 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:43:39.992512 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991a980-0925-4d58-a68c-9e78e77b8a6e admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:40.003292 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991a980-0925-4d58-a68c-9e78e77b8a6e admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:40.008737 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a4824-173a-418b-9a5c-f5c232736ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:40.009429 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a4824-173a-418b-9a5c-f5c232736ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:40.009701 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a4824-173a-418b-9a5c-f5c232736ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:40.010052 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a4824-173a-418b-9a5c-f5c232736ba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:40.010785 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4a4824-173a-418b-9a5c-f5c232736ba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:40.012757 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4a4824-173a-418b-9a5c-f5c232736ba1 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:40.026153 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1263/2530] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:43:40.030901 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4bbf2-6a48-4ae4-82d6-d8a49c6268bc admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:40.041961 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4bbf2-6a48-4ae4-82d6-d8a49c6268bc admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:40.046701 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b679c4db-cba1-4b72-9e19-1b500d355dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:40.047619 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679c4db-cba1-4b72-9e19-1b500d355dd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:40.047899 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679c4db-cba1-4b72-9e19-1b500d355dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:40.048175 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679c4db-cba1-4b72-9e19-1b500d355dd6 admin admin] PATH_INFO: `/v3/projects/8caf7b5e90c14f7b807e751a48eaedec/users/a14116ab282640a48a8ca5a67e4fb940/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:40.064595 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b679c4db-cba1-4b72-9e19-1b500d355dd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8caf7b5e90c14f7b807e751a48eaedec, user_id=a14116ab282640a48a8ca5a67e4fb940, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:40.067272 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b679c4db-cba1-4b72-9e19-1b500d355dd6 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:40.136957 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1268/2531] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:43:40 2022] PUT /identity/v3/projects/8caf7b5e90c14f7b807e751a48eaedec/users/a14116ab282640a48a8ca5a67e4fb940/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:43:40.140898 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a4824-173a-418b-9a5c-f5c232736ba1 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:40.152843 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a4824-173a-418b-9a5c-f5c232736ba1 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:40.225480 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba49819-6104-4805-969d-90a6eea9ac72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:40.226223 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba49819-6104-4805-969d-90a6eea9ac72 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:40.226613 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba49819-6104-4805-969d-90a6eea9ac72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:40.226944 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba49819-6104-4805-969d-90a6eea9ac72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:40.228076 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba49819-6104-4805-969d-90a6eea9ac72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:40.230160 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba49819-6104-4805-969d-90a6eea9ac72 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:40.244580 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1264/2532] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:43:40.245841 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b679c4db-cba1-4b72-9e19-1b500d355dd6 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:40.253640 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:43:40.259139 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b679c4db-cba1-4b72-9e19-1b500d355dd6 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:40.264397 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a8d4a4-6507-4fce-9c8f-65e27142fdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:40.269181 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8d4a4-6507-4fce-9c8f-65e27142fdad admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:40.269181 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8d4a4-6507-4fce-9c8f-65e27142fdad admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:40.269181 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8d4a4-6507-4fce-9c8f-65e27142fdad admin admin] PATH_INFO: `/v3/projects/8caf7b5e90c14f7b807e751a48eaedec/users/a14116ab282640a48a8ca5a67e4fb940/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:40.269181 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a8d4a4-6507-4fce-9c8f-65e27142fdad admin admin] RBAC: Authorizing `identity:create_grant(project_id=8caf7b5e90c14f7b807e751a48eaedec, user_id=a14116ab282640a48a8ca5a67e4fb940, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:40.270767 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a8d4a4-6507-4fce-9c8f-65e27142fdad admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:40.282416 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1269/2533] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:43:40 2022] PUT /identity/v3/projects/8caf7b5e90c14f7b807e751a48eaedec/users/a14116ab282640a48a8ca5a67e4fb940/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:43:40.294203 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0c15c-a017-44ae-aea5-990de57091d0 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:40.298071 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0c15c-a017-44ae-aea5-990de57091d0 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:40.298071 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0c15c-a017-44ae-aea5-990de57091d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:40.324036 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-8ee0c15c-a017-44ae-aea5-990de57091d0 None None] MFA Rules not processed for user `a14116ab282640a48a8ca5a67e4fb940`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:43:40.325457 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-8ee0c15c-a017-44ae-aea5-990de57091d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:40.367524 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:43:40.403044 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1265/2534] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:43:40 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:43:40.410698 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a8d4a4-6507-4fce-9c8f-65e27142fdad admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:40.413231 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-93a8d4a4-6507-4fce-9c8f-65e27142fdad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:40.489859 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a8d4a4-6507-4fce-9c8f-65e27142fdad admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:40.494035 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85397496-5a21-4aa1-baa8-dcdaa3710025 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:40.494676 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85397496-5a21-4aa1-baa8-dcdaa3710025 service cinder] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:40.494956 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85397496-5a21-4aa1-baa8-dcdaa3710025 service cinder] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:40.495232 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85397496-5a21-4aa1-baa8-dcdaa3710025 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:40.504777 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85397496-5a21-4aa1-baa8-dcdaa3710025 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:40.506292 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85397496-5a21-4aa1-baa8-dcdaa3710025 service cinder] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:40.516934 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1270/2535] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:43:40 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:43:41.059959 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee0c15c-a017-44ae-aea5-990de57091d0 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:41.135178 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee0c15c-a017-44ae-aea5-990de57091d0 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:41.139928 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c905e-c780-45e6-919d-8e902ef8e1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:41.140832 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c905e-c780-45e6-919d-8e902ef8e1a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:41.141115 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c905e-c780-45e6-919d-8e902ef8e1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:41.141389 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c905e-c780-45e6-919d-8e902ef8e1a5 admin admin] PATH_INFO: `/v3/users/e8b273754ba441bb8e8545b240b574a9` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:41.142660 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c905e-c780-45e6-919d-8e902ef8e1a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8b273754ba441bb8e8545b240b574a9)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:41.144722 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c905e-c780-45e6-919d-8e902ef8e1a5 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:41.340308 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-b73c905e-c780-45e6-919d-8e902ef8e1a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8b273754ba441bb8e8545b240b574a9'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:41.348553 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-b73c905e-c780-45e6-919d-8e902ef8e1a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8b273754ba441bb8e8545b240b574a9'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:41.427635 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-b73c905e-c780-45e6-919d-8e902ef8e1a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8b273754ba441bb8e8545b240b574a9'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:41.428295 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-b73c905e-c780-45e6-919d-8e902ef8e1a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8b273754ba441bb8e8545b240b574a9'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:41.442796 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-b73c905e-c780-45e6-919d-8e902ef8e1a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8b273754ba441bb8e8545b240b574a9'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:41.449419 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1266/2536] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:43:41 2022] DELETE /identity/v3/users/e8b273754ba441bb8e8545b240b574a9 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:43:41.453770 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc4ac1-2fad-442a-9971-38a772ec918f None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:41.454263 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc4ac1-2fad-442a-9971-38a772ec918f None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:41.454448 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc4ac1-2fad-442a-9971-38a772ec918f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:41.473876 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-f5bc4ac1-2fad-442a-9971-38a772ec918f None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:43:41.475222 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-f5bc4ac1-2fad-442a-9971-38a772ec918f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:41.549586 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1271/2537] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:43:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:43:41.560512 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c905e-c780-45e6-919d-8e902ef8e1a5 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:41.561945 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-b73c905e-c780-45e6-919d-8e902ef8e1a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:41.624310 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c905e-c780-45e6-919d-8e902ef8e1a5 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:41.627946 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49375683-39a0-4166-a44a-6e16b5ae6f88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:41.629056 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49375683-39a0-4166-a44a-6e16b5ae6f88 service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:41.629343 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49375683-39a0-4166-a44a-6e16b5ae6f88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:41.629622 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49375683-39a0-4166-a44a-6e16b5ae6f88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:41.638441 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:43:41.641032 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49375683-39a0-4166-a44a-6e16b5ae6f88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:41.642562 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49375683-39a0-4166-a44a-6e16b5ae6f88 service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:41.659923 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1267/2538] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:43:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:43:42.187623 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc4ac1-2fad-442a-9971-38a772ec918f None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:42.189894 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-f5bc4ac1-2fad-442a-9971-38a772ec918f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:42.204849 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc4ac1-2fad-442a-9971-38a772ec918f None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:42.210853 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fabd22-60fa-4726-8e40-d563588d732d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:42.211808 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fabd22-60fa-4726-8e40-d563588d732d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:42.212280 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fabd22-60fa-4726-8e40-d563588d732d admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:42.212558 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fabd22-60fa-4726-8e40-d563588d732d admin admin] PATH_INFO: `/v3/projects/a4fcfe7b88da48abb5cc587c14e5ee9f` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:42.213878 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fabd22-60fa-4726-8e40-d563588d732d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4fcfe7b88da48abb5cc587c14e5ee9f)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:42.215824 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fabd22-60fa-4726-8e40-d563588d732d admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:42.344774 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-c3fabd22-60fa-4726-8e40-d563588d732d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4fcfe7b88da48abb5cc587c14e5ee9f', 'request_id': 'req-c3fabd22-60fa-4726-8e40-d563588d732d'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:42.420513 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-c3fabd22-60fa-4726-8e40-d563588d732d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4fcfe7b88da48abb5cc587c14e5ee9f', 'request_id': 'req-c3fabd22-60fa-4726-8e40-d563588d732d'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:42.428135 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-c3fabd22-60fa-4726-8e40-d563588d732d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4fcfe7b88da48abb5cc587c14e5ee9f', 'request_id': 'req-c3fabd22-60fa-4726-8e40-d563588d732d'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:42.445884 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-c3fabd22-60fa-4726-8e40-d563588d732d admin admin] The token cache is being invalidate because project a4fcfe7b88da48abb5cc587c14e5ee9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:43:42.445884 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-c3fabd22-60fa-4726-8e40-d563588d732d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:42.445884 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-c3fabd22-60fa-4726-8e40-d563588d732d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:42.445884 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1272/2539] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:43:42 2022] DELETE /identity/v3/projects/a4fcfe7b88da48abb5cc587c14e5ee9f => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:43:42.450125 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49375683-39a0-4166-a44a-6e16b5ae6f88 service neutron] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:42.460768 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49375683-39a0-4166-a44a-6e16b5ae6f88 service neutron] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:42.523788 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85f854-7c16-4379-b017-6bd1ed0ad0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:42.525672 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85f854-7c16-4379-b017-6bd1ed0ad0bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:42.525957 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85f854-7c16-4379-b017-6bd1ed0ad0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:42.526230 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85f854-7c16-4379-b017-6bd1ed0ad0bc admin admin] PATH_INFO: `/v3/users/a14116ab282640a48a8ca5a67e4fb940` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:42.527501 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d85f854-7c16-4379-b017-6bd1ed0ad0bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a14116ab282640a48a8ca5a67e4fb940)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:42.529472 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d85f854-7c16-4379-b017-6bd1ed0ad0bc admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:42.748113 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-9d85f854-7c16-4379-b017-6bd1ed0ad0bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a14116ab282640a48a8ca5a67e4fb940'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:42.755935 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-9d85f854-7c16-4379-b017-6bd1ed0ad0bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a14116ab282640a48a8ca5a67e4fb940'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:42.847462 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-9d85f854-7c16-4379-b017-6bd1ed0ad0bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a14116ab282640a48a8ca5a67e4fb940'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:42.848559 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-9d85f854-7c16-4379-b017-6bd1ed0ad0bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a14116ab282640a48a8ca5a67e4fb940'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:42.866184 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-9d85f854-7c16-4379-b017-6bd1ed0ad0bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a14116ab282640a48a8ca5a67e4fb940'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:42.872672 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1268/2540] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:43:42 2022] DELETE /identity/v3/users/a14116ab282640a48a8ca5a67e4fb940 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:43:43.423798 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fabd22-60fa-4726-8e40-d563588d732d admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:43.428933 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-c3fabd22-60fa-4726-8e40-d563588d732d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:43.459139 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fabd22-60fa-4726-8e40-d563588d732d admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:43.480697 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:43:43.530096 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5f748-edb0-4ef3-9742-3c7b705dc963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:43.530973 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5f748-edb0-4ef3-9742-3c7b705dc963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:43.531255 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5f748-edb0-4ef3-9742-3c7b705dc963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:43.531531 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5f748-edb0-4ef3-9742-3c7b705dc963 admin admin] PATH_INFO: `/v3/projects/8caf7b5e90c14f7b807e751a48eaedec` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:43.532801 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b5f748-edb0-4ef3-9742-3c7b705dc963 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8caf7b5e90c14f7b807e751a48eaedec)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:43.534727 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b5f748-edb0-4ef3-9742-3c7b705dc963 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:43.653520 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-71b5f748-edb0-4ef3-9742-3c7b705dc963 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8caf7b5e90c14f7b807e751a48eaedec', 'request_id': 'req-71b5f748-edb0-4ef3-9742-3c7b705dc963'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:43.721300 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-71b5f748-edb0-4ef3-9742-3c7b705dc963 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8caf7b5e90c14f7b807e751a48eaedec', 'request_id': 'req-71b5f748-edb0-4ef3-9742-3c7b705dc963'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:43.727378 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-71b5f748-edb0-4ef3-9742-3c7b705dc963 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8caf7b5e90c14f7b807e751a48eaedec', 'request_id': 'req-71b5f748-edb0-4ef3-9742-3c7b705dc963'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:43.740845 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-71b5f748-edb0-4ef3-9742-3c7b705dc963 admin admin] The token cache is being invalidate because project 8caf7b5e90c14f7b807e751a48eaedec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:43:43.741132 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-71b5f748-edb0-4ef3-9742-3c7b705dc963 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:43.742323 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-71b5f748-edb0-4ef3-9742-3c7b705dc963 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:43:43.743875 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1273/2541] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:43:43 2022] DELETE /identity/v3/projects/8caf7b5e90c14f7b807e751a48eaedec => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:43:43.748901 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6f002-407d-4eca-bf27-13fa65b2609f None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:43.749434 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6f002-407d-4eca-bf27-13fa65b2609f None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:43.749538 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6f002-407d-4eca-bf27-13fa65b2609f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:43.768605 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-6fd6f002-407d-4eca-bf27-13fa65b2609f None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:43:43.769886 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-6fd6f002-407d-4eca-bf27-13fa65b2609f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:43.837241 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1269/2542] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:43:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:43:43.844958 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e244a2-e60d-45e6-a0b8-f9dfdf41251b None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:43.845291 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e244a2-e60d-45e6-a0b8-f9dfdf41251b None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:43.845531 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e244a2-e60d-45e6-a0b8-f9dfdf41251b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:43.865655 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-d7e244a2-e60d-45e6-a0b8-f9dfdf41251b None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:43:43.867578 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-d7e244a2-e60d-45e6-a0b8-f9dfdf41251b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:43.875619 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1274/2543] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:43:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:43:43.880040 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd6f002-407d-4eca-bf27-13fa65b2609f None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:43.890358 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd6f002-407d-4eca-bf27-13fa65b2609f None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:43.896258 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d4b30-2f33-4930-b040-6ca8a4515490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:43.897004 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d4b30-2f33-4930-b040-6ca8a4515490 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:43.897383 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d4b30-2f33-4930-b040-6ca8a4515490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:43.898614 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d4b30-2f33-4930-b040-6ca8a4515490 admin admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:43.899366 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620d4b30-2f33-4930-b040-6ca8a4515490 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:43:43.899677 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620d4b30-2f33-4930-b040-6ca8a4515490 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:43.901345 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620d4b30-2f33-4930-b040-6ca8a4515490 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:43.917325 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1270/2544] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:43:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:43:43.920954 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e244a2-e60d-45e6-a0b8-f9dfdf41251b None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:43.931569 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e244a2-e60d-45e6-a0b8-f9dfdf41251b None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:43.936884 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad1e1e-7137-4a77-a5eb-7f53e579539d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:43.937647 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad1e1e-7137-4a77-a5eb-7f53e579539d admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:43.937993 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad1e1e-7137-4a77-a5eb-7f53e579539d admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:43.938333 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad1e1e-7137-4a77-a5eb-7f53e579539d admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:43.939140 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad1e1e-7137-4a77-a5eb-7f53e579539d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:43.941186 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad1e1e-7137-4a77-a5eb-7f53e579539d admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:44.039247 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1275/2545] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:43:43 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:43:44.043145 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d4b30-2f33-4930-b040-6ca8a4515490 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:44.049119 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:43:44.056660 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d4b30-2f33-4930-b040-6ca8a4515490 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:44.138112 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b58f765-36a1-415c-ab70-d763a598acdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:44.138809 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58f765-36a1-415c-ab70-d763a598acdd admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:44.139092 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58f765-36a1-415c-ab70-d763a598acdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:44.139370 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58f765-36a1-415c-ab70-d763a598acdd admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:44.140077 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b58f765-36a1-415c-ab70-d763a598acdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:44.142125 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b58f765-36a1-415c-ab70-d763a598acdd admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:44.236425 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1271/2546] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:43:44 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:43:44.240918 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad1e1e-7137-4a77-a5eb-7f53e579539d admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:44.254177 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad1e1e-7137-4a77-a5eb-7f53e579539d admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:44.259665 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd3beb1-1fb5-4d01-af47-d322e92ce31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:44.260513 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3beb1-1fb5-4d01-af47-d322e92ce31a admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:44.260895 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3beb1-1fb5-4d01-af47-d322e92ce31a admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:44.261441 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3beb1-1fb5-4d01-af47-d322e92ce31a admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:44.262289 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd3beb1-1fb5-4d01-af47-d322e92ce31a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:44.264097 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd3beb1-1fb5-4d01-af47-d322e92ce31a admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:44.279082 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1276/2547] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 09:43:44.281075 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b58f765-36a1-415c-ab70-d763a598acdd admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:44.293557 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b58f765-36a1-415c-ab70-d763a598acdd admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:44.298606 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad6df84-ada9-4389-afa4-54b9d0304ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:44.299670 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6df84-ada9-4389-afa4-54b9d0304ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:44.300062 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6df84-ada9-4389-afa4-54b9d0304ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:44.300480 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6df84-ada9-4389-afa4-54b9d0304ae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:44.301324 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad6df84-ada9-4389-afa4-54b9d0304ae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:44.303041 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad6df84-ada9-4389-afa4-54b9d0304ae9 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:44.316473 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1272/2548] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:43:44.320327 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd3beb1-1fb5-4d01-af47-d322e92ce31a admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:44.331240 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd3beb1-1fb5-4d01-af47-d322e92ce31a admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:44.336650 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d043c-ea34-47c7-8be0-3d6f27f7b01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:44.337633 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d043c-ea34-47c7-8be0-3d6f27f7b01c admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:44.337984 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d043c-ea34-47c7-8be0-3d6f27f7b01c admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:44.338328 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d043c-ea34-47c7-8be0-3d6f27f7b01c admin admin] PATH_INFO: `/v3/projects/1bc30323d54342f88af59641d603634f/users/40083225fc7f459d8827086eeb94c3e9/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:44.359740 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d043c-ea34-47c7-8be0-3d6f27f7b01c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bc30323d54342f88af59641d603634f, user_id=40083225fc7f459d8827086eeb94c3e9, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:44.362494 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d043c-ea34-47c7-8be0-3d6f27f7b01c admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:44.440232 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1277/2549] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:43:44 2022] PUT /identity/v3/projects/1bc30323d54342f88af59641d603634f/users/40083225fc7f459d8827086eeb94c3e9/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:43:44.446768 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f887ef9-93f8-4b99-8ac0-18668cb8a2cd None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:44.447063 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f887ef9-93f8-4b99-8ac0-18668cb8a2cd None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:44.447375 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f887ef9-93f8-4b99-8ac0-18668cb8a2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:44.475255 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-0f887ef9-93f8-4b99-8ac0-18668cb8a2cd None None] MFA Rules not processed for user `40083225fc7f459d8827086eeb94c3e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:43:44.477085 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-0f887ef9-93f8-4b99-8ac0-18668cb8a2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:44.552284 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1273/2550] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:43:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:43:44.555317 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d043c-ea34-47c7-8be0-3d6f27f7b01c admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:44.603737 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:43:44.621429 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d043c-ea34-47c7-8be0-3d6f27f7b01c admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:44.626542 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc5cdc-e9a6-4247-9e10-47524e999637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:44.627225 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc5cdc-e9a6-4247-9e10-47524e999637 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:44.627512 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc5cdc-e9a6-4247-9e10-47524e999637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:44.627796 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc5cdc-e9a6-4247-9e10-47524e999637 admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:44.629243 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bc5cdc-e9a6-4247-9e10-47524e999637 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:44.631393 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bc5cdc-e9a6-4247-9e10-47524e999637 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:44.759574 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1278/2551] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:43:44 2022] POST /identity/v3/projects => generated 385 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:43:44.760805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f887ef9-93f8-4b99-8ac0-18668cb8a2cd None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:44.771973 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f887ef9-93f8-4b99-8ac0-18668cb8a2cd None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:44.839405 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946dc94-14e8-4a50-bea5-4b5236a32596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:44.840322 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946dc94-14e8-4a50-bea5-4b5236a32596 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:44.840613 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946dc94-14e8-4a50-bea5-4b5236a32596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:44.840890 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946dc94-14e8-4a50-bea5-4b5236a32596 admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:44.841815 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1946dc94-14e8-4a50-bea5-4b5236a32596 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:44.844125 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1946dc94-14e8-4a50-bea5-4b5236a32596 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:44.953067 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:43:44.958184 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1274/2552] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:43:44 2022] POST /identity/v3/users => generated 299 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 09:43:44.962289 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc5cdc-e9a6-4247-9e10-47524e999637 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:44.973302 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc5cdc-e9a6-4247-9e10-47524e999637 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:44.978893 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b56b36-7ed5-4791-8df9-064e009ba82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:44.979356 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b56b36-7ed5-4791-8df9-064e009ba82b admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:44.979644 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b56b36-7ed5-4791-8df9-064e009ba82b admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:44.979929 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b56b36-7ed5-4791-8df9-064e009ba82b admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:44.980700 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b56b36-7ed5-4791-8df9-064e009ba82b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:44.982329 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b56b36-7ed5-4791-8df9-064e009ba82b admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:44.994421 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1279/2553] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:43:44.998676 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946dc94-14e8-4a50-bea5-4b5236a32596 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:45.009485 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946dc94-14e8-4a50-bea5-4b5236a32596 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:45.014142 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8c779-69c1-4666-8761-cca826b04e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:45.015017 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8c779-69c1-4666-8761-cca826b04e90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:45.015299 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8c779-69c1-4666-8761-cca826b04e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:45.015574 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8c779-69c1-4666-8761-cca826b04e90 admin admin] PATH_INFO: `/v3/projects/85ec8c6b63f24b22bb290f0e19138da8/users/f40b271716a84944a434c7ecd73892b7/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:45.032113 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f8c779-69c1-4666-8761-cca826b04e90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85ec8c6b63f24b22bb290f0e19138da8, user_id=f40b271716a84944a434c7ecd73892b7, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:45.036239 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f8c779-69c1-4666-8761-cca826b04e90 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:45.108549 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1275/2554] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:43:44 2022] PUT /identity/v3/projects/85ec8c6b63f24b22bb290f0e19138da8/users/f40b271716a84944a434c7ecd73892b7/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:43:45.112320 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b56b36-7ed5-4791-8df9-064e009ba82b admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:45.123156 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b56b36-7ed5-4791-8df9-064e009ba82b admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:45.182081 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc3444-1791-4ebd-902d-aead596f8fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:45.182741 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc3444-1791-4ebd-902d-aead596f8fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:45.183077 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc3444-1791-4ebd-902d-aead596f8fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:45.183309 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc3444-1791-4ebd-902d-aead596f8fb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:45.184038 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc3444-1791-4ebd-902d-aead596f8fb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:45.185678 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc3444-1791-4ebd-902d-aead596f8fb0 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:45.199836 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1280/2555] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:43:45.201031 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8c779-69c1-4666-8761-cca826b04e90 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:45.220653 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8c779-69c1-4666-8761-cca826b04e90 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:45.225806 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70012cf1-3a88-4e64-bf17-870463a664d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:45.226752 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70012cf1-3a88-4e64-bf17-870463a664d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:45.227066 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70012cf1-3a88-4e64-bf17-870463a664d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:45.227340 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70012cf1-3a88-4e64-bf17-870463a664d4 admin admin] PATH_INFO: `/v3/projects/85ec8c6b63f24b22bb290f0e19138da8/users/f40b271716a84944a434c7ecd73892b7/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:45.229664 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70012cf1-3a88-4e64-bf17-870463a664d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85ec8c6b63f24b22bb290f0e19138da8, user_id=f40b271716a84944a434c7ecd73892b7, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:45.232407 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70012cf1-3a88-4e64-bf17-870463a664d4 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:45.244895 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1276/2556] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:43:45 2022] PUT /identity/v3/projects/85ec8c6b63f24b22bb290f0e19138da8/users/f40b271716a84944a434c7ecd73892b7/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:43:45.256032 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6083a-e091-4e88-a9d3-e8dabd59bd7d None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:45.256409 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6083a-e091-4e88-a9d3-e8dabd59bd7d None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:45.256649 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6083a-e091-4e88-a9d3-e8dabd59bd7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:45.285438 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-d1a6083a-e091-4e88-a9d3-e8dabd59bd7d None None] MFA Rules not processed for user `f40b271716a84944a434c7ecd73892b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:43:45.286855 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-d1a6083a-e091-4e88-a9d3-e8dabd59bd7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:45.369616 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1281/2557] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:43:45 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:43:45.377663 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70012cf1-3a88-4e64-bf17-870463a664d4 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:45.379384 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-70012cf1-3a88-4e64-bf17-870463a664d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:45.446388 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70012cf1-3a88-4e64-bf17-870463a664d4 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:45.450088 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e2b2b-b9c2-4064-a541-001de74c4ead service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:45.450731 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e2b2b-b9c2-4064-a541-001de74c4ead service cinder] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:45.451012 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e2b2b-b9c2-4064-a541-001de74c4ead service cinder] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:45.451297 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e2b2b-b9c2-4064-a541-001de74c4ead service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:45.517041 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1e2b2b-b9c2-4064-a541-001de74c4ead service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:45.518632 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1e2b2b-b9c2-4064-a541-001de74c4ead service cinder] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:45.528607 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1277/2558] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:43:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:43:53.633605 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6083a-e091-4e88-a9d3-e8dabd59bd7d None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:53.635197 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-d1a6083a-e091-4e88-a9d3-e8dabd59bd7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:53.680336 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:43:53.694901 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6083a-e091-4e88-a9d3-e8dabd59bd7d None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:53.698704 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d898a-88ad-43e5-a867-b32145b945b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:53.699350 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d898a-88ad-43e5-a867-b32145b945b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:53.699634 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d898a-88ad-43e5-a867-b32145b945b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:53.699909 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d898a-88ad-43e5-a867-b32145b945b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:53.701766 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-185d898a-88ad-43e5-a867-b32145b945b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:43:53.783388 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185d898a-88ad-43e5-a867-b32145b945b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:53.784806 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185d898a-88ad-43e5-a867-b32145b945b3 service neutron] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:53.794598 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1282/2559] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:43:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:43:53.948453 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e2b2b-b9c2-4064-a541-001de74c4ead service cinder] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:43:53.957286 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e2b2b-b9c2-4064-a541-001de74c4ead service cinder] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:43:53.961299 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10cf223-2470-4ba7-a4be-67b0913e2063 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:43:53.961944 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10cf223-2470-4ba7-a4be-67b0913e2063 service cinder] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:43:53.962231 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10cf223-2470-4ba7-a4be-67b0913e2063 service cinder] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:43:53.962502 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10cf223-2470-4ba7-a4be-67b0913e2063 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:43:53.972321 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10cf223-2470-4ba7-a4be-67b0913e2063 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:43:53.973785 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10cf223-2470-4ba7-a4be-67b0913e2063 service cinder] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:43:53.984455 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1278/2560] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:43:53 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:44:00.057382 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d898a-88ad-43e5-a867-b32145b945b3 service neutron] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:00.132696 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d898a-88ad-43e5-a867-b32145b945b3 service neutron] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:00.137894 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbdec7e-d842-4941-bd33-d083460c2ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:00.139131 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdec7e-d842-4941-bd33-d083460c2ffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:00.139131 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdec7e-d842-4941-bd33-d083460c2ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:00.139361 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdec7e-d842-4941-bd33-d083460c2ffb admin admin] PATH_INFO: `/v3/users/40083225fc7f459d8827086eeb94c3e9` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:00.140524 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbdec7e-d842-4941-bd33-d083460c2ffb admin admin] RBAC: Authorizing `identity:delete_user(user_id=40083225fc7f459d8827086eeb94c3e9)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:00.142507 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbdec7e-d842-4941-bd33-d083460c2ffb admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:00.319750 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-0fbdec7e-d842-4941-bd33-d083460c2ffb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40083225fc7f459d8827086eeb94c3e9'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:00.320457 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-0fbdec7e-d842-4941-bd33-d083460c2ffb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40083225fc7f459d8827086eeb94c3e9'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:00.383767 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-0fbdec7e-d842-4941-bd33-d083460c2ffb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40083225fc7f459d8827086eeb94c3e9'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:00.384394 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-0fbdec7e-d842-4941-bd33-d083460c2ffb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40083225fc7f459d8827086eeb94c3e9'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:00.391862 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-0fbdec7e-d842-4941-bd33-d083460c2ffb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40083225fc7f459d8827086eeb94c3e9'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:00.410744 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1283/2561] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:44:00 2022] DELETE /identity/v3/users/40083225fc7f459d8827086eeb94c3e9 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:44:00.415842 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4fb21-f545-4143-8706-cf4dcdd82621 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:00.416378 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4fb21-f545-4143-8706-cf4dcdd82621 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:00.416484 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4fb21-f545-4143-8706-cf4dcdd82621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:00.436521 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-66d4fb21-f545-4143-8706-cf4dcdd82621 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:44:00.442153 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-66d4fb21-f545-4143-8706-cf4dcdd82621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:00.504519 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1279/2562] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:44:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:44:00.519247 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbdec7e-d842-4941-bd33-d083460c2ffb admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:00.520700 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-0fbdec7e-d842-4941-bd33-d083460c2ffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:00.535599 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:00.581440 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbdec7e-d842-4941-bd33-d083460c2ffb admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:00.585386 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676cfde9-0a5d-4c8b-b1be-5147de6f1e64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:00.586035 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cfde9-0a5d-4c8b-b1be-5147de6f1e64 service neutron] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:00.586915 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cfde9-0a5d-4c8b-b1be-5147de6f1e64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:00.587282 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cfde9-0a5d-4c8b-b1be-5147de6f1e64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:00.596918 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676cfde9-0a5d-4c8b-b1be-5147de6f1e64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:00.603622 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676cfde9-0a5d-4c8b-b1be-5147de6f1e64 service neutron] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:00.608379 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1284/2563] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:44:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:44:00.872739 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee2f25-f969-4457-9088-173d974cb72a None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:00.873119 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee2f25-f969-4457-9088-173d974cb72a None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:00.873525 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee2f25-f969-4457-9088-173d974cb72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:00.887066 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:00.894154 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-05ee2f25-f969-4457-9088-173d974cb72a None None] MFA Rules not processed for user `8f5d1f2327914f9fb070c6212582b6dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:44:00.897373 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-05ee2f25-f969-4457-9088-173d974cb72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:00.987133 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1280/2564] 10.222.0.62 () {58 vars in 967 bytes} [Mon Jun 27 09:44:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:44:00.995691 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676cfde9-0a5d-4c8b-b1be-5147de6f1e64 service neutron] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:00.997194 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-676cfde9-0a5d-4c8b-b1be-5147de6f1e64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:01.071717 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676cfde9-0a5d-4c8b-b1be-5147de6f1e64 service neutron] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:01.079651 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0dd43b-1d1c-4c61-abe0-dcbcc071ab79 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5477b14dae24fd3a644c9cbd6ff85ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:01.083073 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0dd43b-1d1c-4c61-abe0-dcbcc071ab79 service swift] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:01.083387 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0dd43b-1d1c-4c61-abe0-dcbcc071ab79 service swift] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:01.083666 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0dd43b-1d1c-4c61-abe0-dcbcc071ab79 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:01.093908 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee2f25-f969-4457-9088-173d974cb72a None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:01.095428 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0dd43b-1d1c-4c61-abe0-dcbcc071ab79 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:01.096001 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-05ee2f25-f969-4457-9088-173d974cb72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:01.097202 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0dd43b-1d1c-4c61-abe0-dcbcc071ab79 service swift] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:01.111537 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee2f25-f969-4457-9088-173d974cb72a None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:01.119684 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1285/2565] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Jun 27 09:44:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 09:44:01.146342 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e99fe8-b56f-4a14-92ab-e39ec749eea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:01.147301 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e99fe8-b56f-4a14-92ab-e39ec749eea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:01.147501 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e99fe8-b56f-4a14-92ab-e39ec749eea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:01.147779 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e99fe8-b56f-4a14-92ab-e39ec749eea0 admin admin] PATH_INFO: `/v3/projects/1bc30323d54342f88af59641d603634f` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:01.154498 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e99fe8-b56f-4a14-92ab-e39ec749eea0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bc30323d54342f88af59641d603634f)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:01.156613 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e99fe8-b56f-4a14-92ab-e39ec749eea0 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:01.298938 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-51e99fe8-b56f-4a14-92ab-e39ec749eea0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bc30323d54342f88af59641d603634f', 'request_id': 'req-51e99fe8-b56f-4a14-92ab-e39ec749eea0'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:01.385398 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-51e99fe8-b56f-4a14-92ab-e39ec749eea0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bc30323d54342f88af59641d603634f', 'request_id': 'req-51e99fe8-b56f-4a14-92ab-e39ec749eea0'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:01.391471 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-51e99fe8-b56f-4a14-92ab-e39ec749eea0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bc30323d54342f88af59641d603634f', 'request_id': 'req-51e99fe8-b56f-4a14-92ab-e39ec749eea0'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:01.403236 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-51e99fe8-b56f-4a14-92ab-e39ec749eea0 admin admin] The token cache is being invalidate because project 1bc30323d54342f88af59641d603634f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:44:01.403453 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-51e99fe8-b56f-4a14-92ab-e39ec749eea0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:01.404157 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-51e99fe8-b56f-4a14-92ab-e39ec749eea0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:01.405837 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1281/2566] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:44:01 2022] DELETE /identity/v3/projects/1bc30323d54342f88af59641d603634f => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:44:01.409979 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0dd43b-1d1c-4c61-abe0-dcbcc071ab79 service swift] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:01.420667 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0dd43b-1d1c-4c61-abe0-dcbcc071ab79 service swift] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:01.484716 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6679185-0aee-472d-8329-560b3b69c734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:01.485620 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6679185-0aee-472d-8329-560b3b69c734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:01.485933 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6679185-0aee-472d-8329-560b3b69c734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:01.486267 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6679185-0aee-472d-8329-560b3b69c734 admin admin] PATH_INFO: `/v3/users/f40b271716a84944a434c7ecd73892b7` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:01.487464 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6679185-0aee-472d-8329-560b3b69c734 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f40b271716a84944a434c7ecd73892b7)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:01.489779 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6679185-0aee-472d-8329-560b3b69c734 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:01.657187 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-e6679185-0aee-472d-8329-560b3b69c734 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f40b271716a84944a434c7ecd73892b7'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:01.657766 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-e6679185-0aee-472d-8329-560b3b69c734 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f40b271716a84944a434c7ecd73892b7'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:01.659486 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:01.761956 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-e6679185-0aee-472d-8329-560b3b69c734 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f40b271716a84944a434c7ecd73892b7'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:01.764052 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-e6679185-0aee-472d-8329-560b3b69c734 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f40b271716a84944a434c7ecd73892b7'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:01.775486 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-e6679185-0aee-472d-8329-560b3b69c734 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f40b271716a84944a434c7ecd73892b7'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:01.795007 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1286/2567] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:44:01 2022] DELETE /identity/v3/users/f40b271716a84944a434c7ecd73892b7 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:44:02.259471 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e99fe8-b56f-4a14-92ab-e39ec749eea0 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:02.261132 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-51e99fe8-b56f-4a14-92ab-e39ec749eea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:02.275631 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e99fe8-b56f-4a14-92ab-e39ec749eea0 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:02.341965 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155943e-1313-4e9c-ac8d-cf16cfe55c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:02.342840 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155943e-1313-4e9c-ac8d-cf16cfe55c9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:02.343120 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155943e-1313-4e9c-ac8d-cf16cfe55c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:02.343398 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155943e-1313-4e9c-ac8d-cf16cfe55c9d admin admin] PATH_INFO: `/v3/projects/85ec8c6b63f24b22bb290f0e19138da8` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:02.344652 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0155943e-1313-4e9c-ac8d-cf16cfe55c9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=85ec8c6b63f24b22bb290f0e19138da8)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:02.346584 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0155943e-1313-4e9c-ac8d-cf16cfe55c9d admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:02.464014 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:02.473686 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-0155943e-1313-4e9c-ac8d-cf16cfe55c9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85ec8c6b63f24b22bb290f0e19138da8', 'request_id': 'req-0155943e-1313-4e9c-ac8d-cf16cfe55c9d'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:02.545348 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-0155943e-1313-4e9c-ac8d-cf16cfe55c9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85ec8c6b63f24b22bb290f0e19138da8', 'request_id': 'req-0155943e-1313-4e9c-ac8d-cf16cfe55c9d'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:02.551503 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-0155943e-1313-4e9c-ac8d-cf16cfe55c9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85ec8c6b63f24b22bb290f0e19138da8', 'request_id': 'req-0155943e-1313-4e9c-ac8d-cf16cfe55c9d'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:02.563940 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-0155943e-1313-4e9c-ac8d-cf16cfe55c9d admin admin] The token cache is being invalidate because project 85ec8c6b63f24b22bb290f0e19138da8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:44:02.564243 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-0155943e-1313-4e9c-ac8d-cf16cfe55c9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:02.569149 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-0155943e-1313-4e9c-ac8d-cf16cfe55c9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:02.569149 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1282/2568] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:44:02 2022] DELETE /identity/v3/projects/85ec8c6b63f24b22bb290f0e19138da8 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:44:02.572407 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc0414-f611-4ffe-846d-c34ca6aecfb4 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:02.572897 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc0414-f611-4ffe-846d-c34ca6aecfb4 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:02.573024 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc0414-f611-4ffe-846d-c34ca6aecfb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:02.591058 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-7dcc0414-f611-4ffe-846d-c34ca6aecfb4 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:44:02.592294 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-7dcc0414-f611-4ffe-846d-c34ca6aecfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:02.653339 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1287/2569] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:44:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:44:02.661749 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3799f6-6acc-4940-89cf-ca3ad699d072 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:02.662078 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3799f6-6acc-4940-89cf-ca3ad699d072 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:02.662595 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3799f6-6acc-4940-89cf-ca3ad699d072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:02.683052 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-fb3799f6-6acc-4940-89cf-ca3ad699d072 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:44:02.684335 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-fb3799f6-6acc-4940-89cf-ca3ad699d072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:02.693160 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1283/2570] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:44:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:44:02.699278 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc0414-f611-4ffe-846d-c34ca6aecfb4 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:02.709451 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc0414-f611-4ffe-846d-c34ca6aecfb4 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:02.714965 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9876a0c-f0ce-412c-bc11-5204f988c39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:02.715630 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9876a0c-f0ce-412c-bc11-5204f988c39e admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:02.715918 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9876a0c-f0ce-412c-bc11-5204f988c39e admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:02.716219 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9876a0c-f0ce-412c-bc11-5204f988c39e admin admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:02.716961 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9876a0c-f0ce-412c-bc11-5204f988c39e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:44:02.717273 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9876a0c-f0ce-412c-bc11-5204f988c39e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:02.719112 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9876a0c-f0ce-412c-bc11-5204f988c39e admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:02.736600 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1288/2571] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:44:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:44:02.737759 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3799f6-6acc-4940-89cf-ca3ad699d072 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:02.748773 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3799f6-6acc-4940-89cf-ca3ad699d072 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:02.753609 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f3b89-4d4f-4171-b958-06c1e0f67a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:02.754274 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f3b89-4d4f-4171-b958-06c1e0f67a7b admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:02.754558 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f3b89-4d4f-4171-b958-06c1e0f67a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:02.754832 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f3b89-4d4f-4171-b958-06c1e0f67a7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:02.755521 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113f3b89-4d4f-4171-b958-06c1e0f67a7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:02.757456 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113f3b89-4d4f-4171-b958-06c1e0f67a7b admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:02.856807 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1284/2572] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:44:02 2022] POST /identity/v3/projects => generated 377 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:44:02.861043 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9876a0c-f0ce-412c-bc11-5204f988c39e admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:02.872126 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9876a0c-f0ce-412c-bc11-5204f988c39e admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:02.930970 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9b2f8-9455-4650-8d2b-bdfe9a3da840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:02.931669 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9b2f8-9455-4650-8d2b-bdfe9a3da840 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:02.931945 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9b2f8-9455-4650-8d2b-bdfe9a3da840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:02.932260 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9b2f8-9455-4650-8d2b-bdfe9a3da840 admin admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:02.932942 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9b2f8-9455-4650-8d2b-bdfe9a3da840 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:02.934877 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9b2f8-9455-4650-8d2b-bdfe9a3da840 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:03.072234 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1289/2573] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:44:02 2022] POST /identity/v3/users => generated 289 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:44:03.076605 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f3b89-4d4f-4171-b958-06c1e0f67a7b admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:03.088371 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f3b89-4d4f-4171-b958-06c1e0f67a7b admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:03.093202 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a1d36-8bed-4c22-9dea-7dad5dccaa98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:03.093866 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a1d36-8bed-4c22-9dea-7dad5dccaa98 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:03.094148 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a1d36-8bed-4c22-9dea-7dad5dccaa98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:03.094423 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a1d36-8bed-4c22-9dea-7dad5dccaa98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:03.095148 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518a1d36-8bed-4c22-9dea-7dad5dccaa98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:03.096873 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518a1d36-8bed-4c22-9dea-7dad5dccaa98 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:03.110388 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1285/2574] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:44:03.113757 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9b2f8-9455-4650-8d2b-bdfe9a3da840 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:03.125041 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9b2f8-9455-4650-8d2b-bdfe9a3da840 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:03.129934 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74942ea3-9764-4260-9f9d-f4811b8a9451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:03.130504 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74942ea3-9764-4260-9f9d-f4811b8a9451 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:03.130783 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74942ea3-9764-4260-9f9d-f4811b8a9451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:03.131057 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74942ea3-9764-4260-9f9d-f4811b8a9451 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:03.131778 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74942ea3-9764-4260-9f9d-f4811b8a9451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:03.134063 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74942ea3-9764-4260-9f9d-f4811b8a9451 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:03.144248 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1290/2575] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:44:03.148569 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a1d36-8bed-4c22-9dea-7dad5dccaa98 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:03.159199 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a1d36-8bed-4c22-9dea-7dad5dccaa98 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:03.163728 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fde57c-5c4c-46b6-a650-cd2ccad3f77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:03.164659 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fde57c-5c4c-46b6-a650-cd2ccad3f77d admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:03.164934 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fde57c-5c4c-46b6-a650-cd2ccad3f77d admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:03.165200 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fde57c-5c4c-46b6-a650-cd2ccad3f77d admin admin] PATH_INFO: `/v3/projects/2a13b5a1198f43b5a38e867b6ad716bd/users/783c8b0af18d4ba5a4390a923d70fef2/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:03.180876 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fde57c-5c4c-46b6-a650-cd2ccad3f77d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a13b5a1198f43b5a38e867b6ad716bd, user_id=783c8b0af18d4ba5a4390a923d70fef2, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:03.183553 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fde57c-5c4c-46b6-a650-cd2ccad3f77d admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:03.286551 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1286/2576] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:44:03 2022] PUT /identity/v3/projects/2a13b5a1198f43b5a38e867b6ad716bd/users/783c8b0af18d4ba5a4390a923d70fef2/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:44:03.298463 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f79bb9-36a1-4c4a-8f4d-3513ba1126c3 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:03.298757 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f79bb9-36a1-4c4a-8f4d-3513ba1126c3 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:03.299038 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f79bb9-36a1-4c4a-8f4d-3513ba1126c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:03.330887 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-f2f79bb9-36a1-4c4a-8f4d-3513ba1126c3 None None] MFA Rules not processed for user `783c8b0af18d4ba5a4390a923d70fef2`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:44:03.332129 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-f2f79bb9-36a1-4c4a-8f4d-3513ba1126c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:03.352252 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:03.422571 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1291/2577] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:44:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:44:03.429868 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fde57c-5c4c-46b6-a650-cd2ccad3f77d admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:03.433890 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-25fde57c-5c4c-46b6-a650-cd2ccad3f77d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:03.501083 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fde57c-5c4c-46b6-a650-cd2ccad3f77d admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:03.512483 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3228a8b7-c75e-47e1-9c2c-d530e27559a4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6f97b803a28453c8b78fd8380ac64ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:03.513424 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228a8b7-c75e-47e1-9c2c-d530e27559a4 service glance] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:03.513869 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228a8b7-c75e-47e1-9c2c-d530e27559a4 service glance] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:03.514295 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228a8b7-c75e-47e1-9c2c-d530e27559a4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:03.525323 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3228a8b7-c75e-47e1-9c2c-d530e27559a4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:03.527216 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3228a8b7-c75e-47e1-9c2c-d530e27559a4 service glance] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:03.538974 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1287/2578] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:44:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:44:04.122528 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f79bb9-36a1-4c4a-8f4d-3513ba1126c3 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:04.123979 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-f2f79bb9-36a1-4c4a-8f4d-3513ba1126c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:04.184475 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f79bb9-36a1-4c4a-8f4d-3513ba1126c3 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:04.188484 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21b0bc-930d-4787-a168-3c0cf5cc4395 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:04.189139 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21b0bc-930d-4787-a168-3c0cf5cc4395 service neutron] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:04.189759 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21b0bc-930d-4787-a168-3c0cf5cc4395 service neutron] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:04.189759 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21b0bc-930d-4787-a168-3c0cf5cc4395 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:04.191929 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-ab21b0bc-930d-4787-a168-3c0cf5cc4395 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:04.259610 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab21b0bc-930d-4787-a168-3c0cf5cc4395 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:04.261005 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab21b0bc-930d-4787-a168-3c0cf5cc4395 service neutron] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:04.270979 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1292/2579] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:44:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:44:10.884570 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3228a8b7-c75e-47e1-9c2c-d530e27559a4 service glance] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:10.886392 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-3228a8b7-c75e-47e1-9c2c-d530e27559a4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:10.901250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3228a8b7-c75e-47e1-9c2c-d530e27559a4 service glance] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:10.905158 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ec500-a2c5-4892-8b70-acca8e789558 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:10.906080 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ec500-a2c5-4892-8b70-acca8e789558 service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:10.906558 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ec500-a2c5-4892-8b70-acca8e789558 service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:10.906911 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ec500-a2c5-4892-8b70-acca8e789558 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:10.909146 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-9b0ec500-a2c5-4892-8b70-acca8e789558 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:10.923361 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ec500-a2c5-4892-8b70-acca8e789558 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:10.924861 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ec500-a2c5-4892-8b70-acca8e789558 service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:10.937865 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1288/2580] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:44:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:44:12.800436 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21b0bc-930d-4787-a168-3c0cf5cc4395 service neutron] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:12.802166 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-ab21b0bc-930d-4787-a168-3c0cf5cc4395 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:12.815687 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21b0bc-930d-4787-a168-3c0cf5cc4395 service neutron] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:12.819945 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b70a92-ba9b-4f89-b7d2-29f3a1c75e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:12.821353 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b70a92-ba9b-4f89-b7d2-29f3a1c75e7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:12.821639 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b70a92-ba9b-4f89-b7d2-29f3a1c75e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:12.822031 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b70a92-ba9b-4f89-b7d2-29f3a1c75e7a admin admin] PATH_INFO: `/v3/users/2b93f2292e2c40cfade9c4f04eb1bc12` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:12.823122 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b70a92-ba9b-4f89-b7d2-29f3a1c75e7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b93f2292e2c40cfade9c4f04eb1bc12)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:12.825221 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b70a92-ba9b-4f89-b7d2-29f3a1c75e7a admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:13.058809 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-f8b70a92-ba9b-4f89-b7d2-29f3a1c75e7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b93f2292e2c40cfade9c4f04eb1bc12'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:13.059534 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-f8b70a92-ba9b-4f89-b7d2-29f3a1c75e7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b93f2292e2c40cfade9c4f04eb1bc12'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:13.134914 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-f8b70a92-ba9b-4f89-b7d2-29f3a1c75e7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b93f2292e2c40cfade9c4f04eb1bc12'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:13.135629 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-f8b70a92-ba9b-4f89-b7d2-29f3a1c75e7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b93f2292e2c40cfade9c4f04eb1bc12'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:13.145844 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-f8b70a92-ba9b-4f89-b7d2-29f3a1c75e7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b93f2292e2c40cfade9c4f04eb1bc12'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:13.148962 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:13.173538 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1293/2581] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:44:12 2022] DELETE /identity/v3/users/2b93f2292e2c40cfade9c4f04eb1bc12 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:44:13.455036 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ec500-a2c5-4892-8b70-acca8e789558 service neutron] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:13.465647 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ec500-a2c5-4892-8b70-acca8e789558 service neutron] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:13.567028 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:13.580293 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25301c40-7b39-449a-911b-5cc05ebed770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:13.581353 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25301c40-7b39-449a-911b-5cc05ebed770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:13.581726 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25301c40-7b39-449a-911b-5cc05ebed770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:13.582056 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25301c40-7b39-449a-911b-5cc05ebed770 admin admin] PATH_INFO: `/v3/projects/6b9d83dd20c744bdb87c90594016af65` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:13.583707 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25301c40-7b39-449a-911b-5cc05ebed770 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b9d83dd20c744bdb87c90594016af65)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:13.586795 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25301c40-7b39-449a-911b-5cc05ebed770 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:13.735153 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-25301c40-7b39-449a-911b-5cc05ebed770 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b9d83dd20c744bdb87c90594016af65', 'request_id': 'req-25301c40-7b39-449a-911b-5cc05ebed770'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:13.802469 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-25301c40-7b39-449a-911b-5cc05ebed770 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b9d83dd20c744bdb87c90594016af65', 'request_id': 'req-25301c40-7b39-449a-911b-5cc05ebed770'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:13.809298 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-25301c40-7b39-449a-911b-5cc05ebed770 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b9d83dd20c744bdb87c90594016af65', 'request_id': 'req-25301c40-7b39-449a-911b-5cc05ebed770'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:13.823664 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-25301c40-7b39-449a-911b-5cc05ebed770 admin admin] The token cache is being invalidate because project 6b9d83dd20c744bdb87c90594016af65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:44:13.825651 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-25301c40-7b39-449a-911b-5cc05ebed770 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:13.827084 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-25301c40-7b39-449a-911b-5cc05ebed770 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:13.828914 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1289/2582] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:44:13 2022] DELETE /identity/v3/projects/6b9d83dd20c744bdb87c90594016af65 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:44:13.833108 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b70a92-ba9b-4f89-b7d2-29f3a1c75e7a admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:13.835676 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-f8b70a92-ba9b-4f89-b7d2-29f3a1c75e7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:13.849411 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b70a92-ba9b-4f89-b7d2-29f3a1c75e7a admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:13.935739 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04152fe-af2b-422f-9767-ccd15cc99a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:13.936684 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04152fe-af2b-422f-9767-ccd15cc99a8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:13.936972 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04152fe-af2b-422f-9767-ccd15cc99a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:13.937328 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04152fe-af2b-422f-9767-ccd15cc99a8d admin admin] PATH_INFO: `/v3/users/ec43aed384424cf29e10b94e239c36d5` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:13.938768 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04152fe-af2b-422f-9767-ccd15cc99a8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec43aed384424cf29e10b94e239c36d5)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:13.944429 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04152fe-af2b-422f-9767-ccd15cc99a8d admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:14.142224 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-f04152fe-af2b-422f-9767-ccd15cc99a8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec43aed384424cf29e10b94e239c36d5'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:14.142922 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-f04152fe-af2b-422f-9767-ccd15cc99a8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec43aed384424cf29e10b94e239c36d5'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:14.228817 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-f04152fe-af2b-422f-9767-ccd15cc99a8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec43aed384424cf29e10b94e239c36d5'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:14.229468 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-f04152fe-af2b-422f-9767-ccd15cc99a8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec43aed384424cf29e10b94e239c36d5'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:14.237536 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-f04152fe-af2b-422f-9767-ccd15cc99a8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec43aed384424cf29e10b94e239c36d5'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:14.256184 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1294/2583] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:44:13 2022] DELETE /identity/v3/users/ec43aed384424cf29e10b94e239c36d5 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:44:14.559619 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25301c40-7b39-449a-911b-5cc05ebed770 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:14.559619 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-25301c40-7b39-449a-911b-5cc05ebed770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:14.586485 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25301c40-7b39-449a-911b-5cc05ebed770 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:14.659646 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4caafab-b828-4f73-abbd-a092be889c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:14.660604 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4caafab-b828-4f73-abbd-a092be889c47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:14.660915 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4caafab-b828-4f73-abbd-a092be889c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:14.661184 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4caafab-b828-4f73-abbd-a092be889c47 admin admin] PATH_INFO: `/v3/projects/0eea87959c9448e9a1b19146af592806` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:14.662593 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4caafab-b828-4f73-abbd-a092be889c47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0eea87959c9448e9a1b19146af592806)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:14.664549 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4caafab-b828-4f73-abbd-a092be889c47 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:14.807218 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-b4caafab-b828-4f73-abbd-a092be889c47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0eea87959c9448e9a1b19146af592806', 'request_id': 'req-b4caafab-b828-4f73-abbd-a092be889c47'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:14.883283 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-b4caafab-b828-4f73-abbd-a092be889c47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0eea87959c9448e9a1b19146af592806', 'request_id': 'req-b4caafab-b828-4f73-abbd-a092be889c47'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:14.897100 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-b4caafab-b828-4f73-abbd-a092be889c47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0eea87959c9448e9a1b19146af592806', 'request_id': 'req-b4caafab-b828-4f73-abbd-a092be889c47'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:14.910254 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-b4caafab-b828-4f73-abbd-a092be889c47 admin admin] The token cache is being invalidate because project 0eea87959c9448e9a1b19146af592806 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:44:14.910653 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-b4caafab-b828-4f73-abbd-a092be889c47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:14.911364 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-b4caafab-b828-4f73-abbd-a092be889c47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:14.913287 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1290/2584] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:44:14 2022] DELETE /identity/v3/projects/0eea87959c9448e9a1b19146af592806 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:44:15.516751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04152fe-af2b-422f-9767-ccd15cc99a8d admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:15.518498 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-f04152fe-af2b-422f-9767-ccd15cc99a8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:15.535750 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04152fe-af2b-422f-9767-ccd15cc99a8d admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:15.593381 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f3e53-e1a4-4186-ae2c-a80586dcfea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:15.594188 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f3e53-e1a4-4186-ae2c-a80586dcfea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:15.594472 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f3e53-e1a4-4186-ae2c-a80586dcfea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:15.594749 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f3e53-e1a4-4186-ae2c-a80586dcfea0 admin admin] PATH_INFO: `/v3/users/4c30a14c11d24ff3bd270c8e865a55d5` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:15.595945 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f3e53-e1a4-4186-ae2c-a80586dcfea0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c30a14c11d24ff3bd270c8e865a55d5)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:15.597971 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f3e53-e1a4-4186-ae2c-a80586dcfea0 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:15.600479 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:15.818439 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-122f3e53-e1a4-4186-ae2c-a80586dcfea0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c30a14c11d24ff3bd270c8e865a55d5'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:15.819083 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-122f3e53-e1a4-4186-ae2c-a80586dcfea0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c30a14c11d24ff3bd270c8e865a55d5'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:15.932788 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-122f3e53-e1a4-4186-ae2c-a80586dcfea0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c30a14c11d24ff3bd270c8e865a55d5'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:15.933339 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-122f3e53-e1a4-4186-ae2c-a80586dcfea0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c30a14c11d24ff3bd270c8e865a55d5'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:15.941787 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-122f3e53-e1a4-4186-ae2c-a80586dcfea0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c30a14c11d24ff3bd270c8e865a55d5'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:15.959931 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1295/2585] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:44:15 2022] DELETE /identity/v3/users/4c30a14c11d24ff3bd270c8e865a55d5 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:44:16.203545 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4caafab-b828-4f73-abbd-a092be889c47 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:16.203545 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-b4caafab-b828-4f73-abbd-a092be889c47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:16.218885 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4caafab-b828-4f73-abbd-a092be889c47 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:16.225353 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:16.279242 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c54eed-ca10-4082-a511-34f7b5fced48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:16.280101 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c54eed-ca10-4082-a511-34f7b5fced48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:16.280416 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c54eed-ca10-4082-a511-34f7b5fced48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:16.280692 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c54eed-ca10-4082-a511-34f7b5fced48 admin admin] PATH_INFO: `/v3/projects/68753bc10c4147468040c550ef88a6f4` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:16.281928 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c54eed-ca10-4082-a511-34f7b5fced48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68753bc10c4147468040c550ef88a6f4)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:16.283828 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c54eed-ca10-4082-a511-34f7b5fced48 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:16.436249 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-56c54eed-ca10-4082-a511-34f7b5fced48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68753bc10c4147468040c550ef88a6f4', 'request_id': 'req-56c54eed-ca10-4082-a511-34f7b5fced48'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:16.537225 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-56c54eed-ca10-4082-a511-34f7b5fced48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68753bc10c4147468040c550ef88a6f4', 'request_id': 'req-56c54eed-ca10-4082-a511-34f7b5fced48'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:16.544045 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-56c54eed-ca10-4082-a511-34f7b5fced48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68753bc10c4147468040c550ef88a6f4', 'request_id': 'req-56c54eed-ca10-4082-a511-34f7b5fced48'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:16.555956 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-56c54eed-ca10-4082-a511-34f7b5fced48 admin admin] The token cache is being invalidate because project 68753bc10c4147468040c550ef88a6f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:44:16.556275 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-56c54eed-ca10-4082-a511-34f7b5fced48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:16.556933 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-56c54eed-ca10-4082-a511-34f7b5fced48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:16.558487 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1291/2586] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:44:16 2022] DELETE /identity/v3/projects/68753bc10c4147468040c550ef88a6f4 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:44:16.563780 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748645fc-fc7a-412b-a33b-174958e77ee0 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:16.567455 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748645fc-fc7a-412b-a33b-174958e77ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:16.567455 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748645fc-fc7a-412b-a33b-174958e77ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:16.583886 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-748645fc-fc7a-412b-a33b-174958e77ee0 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:44:16.585148 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-748645fc-fc7a-412b-a33b-174958e77ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:16.646810 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1296/2587] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:44:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:44:16.655567 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9673c-ab5b-439f-9a5d-6602c09348fa None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:16.655870 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9673c-ab5b-439f-9a5d-6602c09348fa None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:16.656147 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9673c-ab5b-439f-9a5d-6602c09348fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:16.674632 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-e1c9673c-ab5b-439f-9a5d-6602c09348fa None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:44:16.675837 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-e1c9673c-ab5b-439f-9a5d-6602c09348fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:16.683800 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1292/2588] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:44:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:44:16.687970 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748645fc-fc7a-412b-a33b-174958e77ee0 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:16.698183 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748645fc-fc7a-412b-a33b-174958e77ee0 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:16.703210 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7affe559-8e9a-4601-b3f6-8bd948823c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:16.703861 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7affe559-8e9a-4601-b3f6-8bd948823c22 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:16.704143 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7affe559-8e9a-4601-b3f6-8bd948823c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:16.704451 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7affe559-8e9a-4601-b3f6-8bd948823c22 admin admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:16.705184 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7affe559-8e9a-4601-b3f6-8bd948823c22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:44:16.705495 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7affe559-8e9a-4601-b3f6-8bd948823c22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:16.707094 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7affe559-8e9a-4601-b3f6-8bd948823c22 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:16.719279 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1297/2589] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:44:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:44:16.723473 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c9673c-ab5b-439f-9a5d-6602c09348fa None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:16.733098 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c9673c-ab5b-439f-9a5d-6602c09348fa None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:16.737883 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b2af4e-4046-46b8-9f1a-58c2ac46c1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:16.738526 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2af4e-4046-46b8-9f1a-58c2ac46c1af admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:16.738811 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2af4e-4046-46b8-9f1a-58c2ac46c1af admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:16.739087 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2af4e-4046-46b8-9f1a-58c2ac46c1af admin admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:16.739785 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b2af4e-4046-46b8-9f1a-58c2ac46c1af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:16.741704 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b2af4e-4046-46b8-9f1a-58c2ac46c1af admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:16.818307 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1293/2590] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:44:16 2022] POST /identity/v3/projects => generated 405 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:44:16.822991 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7affe559-8e9a-4601-b3f6-8bd948823c22 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:16.833257 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7affe559-8e9a-4601-b3f6-8bd948823c22 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:16.897706 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2687ad-30f9-432a-a025-51173a46665f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:16.898802 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2687ad-30f9-432a-a025-51173a46665f admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:16.899848 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2687ad-30f9-432a-a025-51173a46665f admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:16.900351 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2687ad-30f9-432a-a025-51173a46665f admin admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:16.901557 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2687ad-30f9-432a-a025-51173a46665f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:16.904965 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2687ad-30f9-432a-a025-51173a46665f admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:16.991364 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:16.997489 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1298/2591] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:44:16 2022] POST /identity/v3/users => generated 303 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:44:17.001408 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b2af4e-4046-46b8-9f1a-58c2ac46c1af admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:17.011918 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b2af4e-4046-46b8-9f1a-58c2ac46c1af admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:17.016701 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d1bac-c100-423b-907b-b54cfd783f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:17.017352 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d1bac-c100-423b-907b-b54cfd783f24 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:17.017638 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d1bac-c100-423b-907b-b54cfd783f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:17.017999 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d1bac-c100-423b-907b-b54cfd783f24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:17.018758 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d1bac-c100-423b-907b-b54cfd783f24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:17.020369 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d1bac-c100-423b-907b-b54cfd783f24 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:17.031597 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1294/2592] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:44:17.035555 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2687ad-30f9-432a-a025-51173a46665f admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:17.046314 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2687ad-30f9-432a-a025-51173a46665f admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:17.051658 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655cdadb-a2e1-4f6a-8a5d-4caef12f6b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:17.052362 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655cdadb-a2e1-4f6a-8a5d-4caef12f6b26 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:17.052645 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655cdadb-a2e1-4f6a-8a5d-4caef12f6b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:17.052922 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655cdadb-a2e1-4f6a-8a5d-4caef12f6b26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:17.053678 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655cdadb-a2e1-4f6a-8a5d-4caef12f6b26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:17.055302 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655cdadb-a2e1-4f6a-8a5d-4caef12f6b26 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:17.065911 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1299/2593] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:44:17.071902 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d1bac-c100-423b-907b-b54cfd783f24 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:17.082120 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d1bac-c100-423b-907b-b54cfd783f24 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:17.088000 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5691ad65-7611-4887-981c-9ccef4d47fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:17.088918 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691ad65-7611-4887-981c-9ccef4d47fa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:17.089201 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691ad65-7611-4887-981c-9ccef4d47fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:17.089474 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691ad65-7611-4887-981c-9ccef4d47fa6 admin admin] PATH_INFO: `/v3/projects/9d01d94441cd477a955af155c8139eb1/users/d51054fa5c4a4e6983abab18c0c22919/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:17.105189 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5691ad65-7611-4887-981c-9ccef4d47fa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d01d94441cd477a955af155c8139eb1, user_id=d51054fa5c4a4e6983abab18c0c22919, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:17.107846 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5691ad65-7611-4887-981c-9ccef4d47fa6 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:17.197762 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1295/2594] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:44:17 2022] PUT /identity/v3/projects/9d01d94441cd477a955af155c8139eb1/users/d51054fa5c4a4e6983abab18c0c22919/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:44:17.203152 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84350ebb-397a-4b7a-9335-0645d9a616b4 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:17.203409 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84350ebb-397a-4b7a-9335-0645d9a616b4 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:17.203675 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84350ebb-397a-4b7a-9335-0645d9a616b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:17.225196 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-84350ebb-397a-4b7a-9335-0645d9a616b4 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:44:17.226933 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-84350ebb-397a-4b7a-9335-0645d9a616b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:17.288350 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1300/2595] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:44:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:44:17.299996 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5691ad65-7611-4887-981c-9ccef4d47fa6 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:17.301748 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-5691ad65-7611-4887-981c-9ccef4d47fa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:17.342561 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:17.359248 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5691ad65-7611-4887-981c-9ccef4d47fa6 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:17.362827 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede6fcd-648f-467d-b70e-a66591aa2fab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:17.363471 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede6fcd-648f-467d-b70e-a66591aa2fab service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:17.363755 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede6fcd-648f-467d-b70e-a66591aa2fab service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:17.364029 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede6fcd-648f-467d-b70e-a66591aa2fab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:17.373492 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ede6fcd-648f-467d-b70e-a66591aa2fab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:17.374931 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ede6fcd-648f-467d-b70e-a66591aa2fab service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:17.385115 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1296/2596] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:44:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:44:18.729428 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503244b-81d6-4744-8c4a-8eaa7103e874 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:18.730003 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503244b-81d6-4744-8c4a-8eaa7103e874 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:18.730003 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503244b-81d6-4744-8c4a-8eaa7103e874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:18.758025 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-3503244b-81d6-4744-8c4a-8eaa7103e874 None None] MFA Rules not processed for user `d51054fa5c4a4e6983abab18c0c22919`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:44:18.760314 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-3503244b-81d6-4744-8c4a-8eaa7103e874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:18.829034 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1301/2597] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:44:18 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:44:18.833388 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede6fcd-648f-467d-b70e-a66591aa2fab service neutron] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:18.843903 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede6fcd-648f-467d-b70e-a66591aa2fab service neutron] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:18.848421 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b61fc-2b35-4229-a7bf-05503427eb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:18.849057 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b61fc-2b35-4229-a7bf-05503427eb31 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:18.849339 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b61fc-2b35-4229-a7bf-05503427eb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:18.849615 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b61fc-2b35-4229-a7bf-05503427eb31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:18.850303 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b61fc-2b35-4229-a7bf-05503427eb31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:18.852501 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b61fc-2b35-4229-a7bf-05503427eb31 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:18.975581 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1297/2598] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:44:18 2022] POST /identity/v3/projects => generated 403 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:44:18.980155 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503244b-81d6-4744-8c4a-8eaa7103e874 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:18.990851 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503244b-81d6-4744-8c4a-8eaa7103e874 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:19.047377 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed247a7-1f47-4212-a532-ff16065fd682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:19.048035 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed247a7-1f47-4212-a532-ff16065fd682 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:19.048347 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed247a7-1f47-4212-a532-ff16065fd682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:19.048621 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed247a7-1f47-4212-a532-ff16065fd682 admin admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:19.049311 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed247a7-1f47-4212-a532-ff16065fd682 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:19.051245 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed247a7-1f47-4212-a532-ff16065fd682 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:19.160703 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1302/2599] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:44:18 2022] POST /identity/v3/users => generated 308 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 09:44:19.165615 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b61fc-2b35-4229-a7bf-05503427eb31 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:19.176158 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b61fc-2b35-4229-a7bf-05503427eb31 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:19.181064 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abed68d-d2f2-41c2-8d87-169f6ee8cc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:19.181753 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abed68d-d2f2-41c2-8d87-169f6ee8cc1a admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:19.182039 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abed68d-d2f2-41c2-8d87-169f6ee8cc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:19.182317 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abed68d-d2f2-41c2-8d87-169f6ee8cc1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:19.183046 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abed68d-d2f2-41c2-8d87-169f6ee8cc1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:19.184733 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abed68d-d2f2-41c2-8d87-169f6ee8cc1a admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:19.195217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1298/2600] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 09:44:19.199403 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed247a7-1f47-4212-a532-ff16065fd682 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:19.209380 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed247a7-1f47-4212-a532-ff16065fd682 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:19.214556 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305aa00-6507-4562-b7f0-cd2655380fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:19.215424 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305aa00-6507-4562-b7f0-cd2655380fdb admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:19.215699 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305aa00-6507-4562-b7f0-cd2655380fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:19.215967 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305aa00-6507-4562-b7f0-cd2655380fdb admin admin] PATH_INFO: `/v3/projects/d3ff77fd64c847fcb3c83777a6db4f8b/users/b40e852b58de41b18b7d35050a94e803/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:19.218228 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:19.232068 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8305aa00-6507-4562-b7f0-cd2655380fdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3ff77fd64c847fcb3c83777a6db4f8b, user_id=b40e852b58de41b18b7d35050a94e803, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:19.235654 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8305aa00-6507-4562-b7f0-cd2655380fdb admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:19.314950 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1303/2601] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:44:19 2022] PUT /identity/v3/projects/d3ff77fd64c847fcb3c83777a6db4f8b/users/b40e852b58de41b18b7d35050a94e803/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:44:19.320540 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abed68d-d2f2-41c2-8d87-169f6ee8cc1a admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:19.332659 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abed68d-d2f2-41c2-8d87-169f6ee8cc1a admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:19.392139 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aec5a6-1900-4f48-a62b-4b93789cc8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:19.392833 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aec5a6-1900-4f48-a62b-4b93789cc8d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:19.393111 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aec5a6-1900-4f48-a62b-4b93789cc8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:19.393381 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aec5a6-1900-4f48-a62b-4b93789cc8d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:19.394091 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aec5a6-1900-4f48-a62b-4b93789cc8d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:19.395723 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aec5a6-1900-4f48-a62b-4b93789cc8d9 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:19.405843 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1299/2602] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:44:19.410211 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305aa00-6507-4562-b7f0-cd2655380fdb admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:19.421824 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305aa00-6507-4562-b7f0-cd2655380fdb admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:19.427172 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f46f9c-d3bc-4d3a-a844-1dbac30d219b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:19.428071 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f46f9c-d3bc-4d3a-a844-1dbac30d219b admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:19.428394 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f46f9c-d3bc-4d3a-a844-1dbac30d219b admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:19.428673 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f46f9c-d3bc-4d3a-a844-1dbac30d219b admin admin] PATH_INFO: `/v3/projects/d3ff77fd64c847fcb3c83777a6db4f8b/users/b40e852b58de41b18b7d35050a94e803/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:19.431267 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f46f9c-d3bc-4d3a-a844-1dbac30d219b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3ff77fd64c847fcb3c83777a6db4f8b, user_id=b40e852b58de41b18b7d35050a94e803, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:19.433974 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f46f9c-d3bc-4d3a-a844-1dbac30d219b admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:19.444761 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1304/2603] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:44:19 2022] PUT /identity/v3/projects/d3ff77fd64c847fcb3c83777a6db4f8b/users/b40e852b58de41b18b7d35050a94e803/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:44:20.682717 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc0853-f561-4f80-b748-ebe91fbde699 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:20.683309 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc0853-f561-4f80-b748-ebe91fbde699 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:20.683309 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc0853-f561-4f80-b748-ebe91fbde699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:20.711553 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-c3cc0853-f561-4f80-b748-ebe91fbde699 None None] MFA Rules not processed for user `b40e852b58de41b18b7d35050a94e803`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:44:20.712820 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-c3cc0853-f561-4f80-b748-ebe91fbde699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:20.784706 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1300/2604] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:44:20 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:44:22.163690 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f46f9c-d3bc-4d3a-a844-1dbac30d219b admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:22.236653 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f46f9c-d3bc-4d3a-a844-1dbac30d219b admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:22.241546 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2273628-80c5-456b-8535-1ee8b4476906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:22.242442 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2273628-80c5-456b-8535-1ee8b4476906 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:22.243253 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2273628-80c5-456b-8535-1ee8b4476906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:22.243529 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2273628-80c5-456b-8535-1ee8b4476906 admin admin] PATH_INFO: `/v3/users/d51054fa5c4a4e6983abab18c0c22919` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:22.244745 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2273628-80c5-456b-8535-1ee8b4476906 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d51054fa5c4a4e6983abab18c0c22919)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:22.246708 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2273628-80c5-456b-8535-1ee8b4476906 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:22.444339 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-e2273628-80c5-456b-8535-1ee8b4476906 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd51054fa5c4a4e6983abab18c0c22919'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:22.445280 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-e2273628-80c5-456b-8535-1ee8b4476906 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd51054fa5c4a4e6983abab18c0c22919'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:22.568098 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-e2273628-80c5-456b-8535-1ee8b4476906 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd51054fa5c4a4e6983abab18c0c22919'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:22.568911 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-e2273628-80c5-456b-8535-1ee8b4476906 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd51054fa5c4a4e6983abab18c0c22919'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:22.578260 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-e2273628-80c5-456b-8535-1ee8b4476906 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd51054fa5c4a4e6983abab18c0c22919'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:22.597330 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1305/2605] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:44:22 2022] DELETE /identity/v3/users/d51054fa5c4a4e6983abab18c0c22919 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:44:22.871857 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc0853-f561-4f80-b748-ebe91fbde699 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:22.884785 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc0853-f561-4f80-b748-ebe91fbde699 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:22.919627 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:22.954931 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc30a0-f04f-4a75-9977-da5dbedc145c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:22.955888 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc30a0-f04f-4a75-9977-da5dbedc145c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:22.956167 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc30a0-f04f-4a75-9977-da5dbedc145c admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:22.956477 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc30a0-f04f-4a75-9977-da5dbedc145c admin admin] PATH_INFO: `/v3/projects/9d01d94441cd477a955af155c8139eb1` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:22.957974 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdc30a0-f04f-4a75-9977-da5dbedc145c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d01d94441cd477a955af155c8139eb1)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:22.959954 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdc30a0-f04f-4a75-9977-da5dbedc145c admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:23.057901 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-ccdc30a0-f04f-4a75-9977-da5dbedc145c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d01d94441cd477a955af155c8139eb1', 'request_id': 'req-ccdc30a0-f04f-4a75-9977-da5dbedc145c'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:23.128443 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-ccdc30a0-f04f-4a75-9977-da5dbedc145c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d01d94441cd477a955af155c8139eb1', 'request_id': 'req-ccdc30a0-f04f-4a75-9977-da5dbedc145c'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:23.135028 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-ccdc30a0-f04f-4a75-9977-da5dbedc145c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d01d94441cd477a955af155c8139eb1', 'request_id': 'req-ccdc30a0-f04f-4a75-9977-da5dbedc145c'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:23.146019 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-ccdc30a0-f04f-4a75-9977-da5dbedc145c admin admin] The token cache is being invalidate because project 9d01d94441cd477a955af155c8139eb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:44:23.146301 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-ccdc30a0-f04f-4a75-9977-da5dbedc145c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:23.146956 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-ccdc30a0-f04f-4a75-9977-da5dbedc145c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:23.148547 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1301/2606] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:44:22 2022] DELETE /identity/v3/projects/9d01d94441cd477a955af155c8139eb1 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:44:23.153221 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2273628-80c5-456b-8535-1ee8b4476906 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:23.154649 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-e2273628-80c5-456b-8535-1ee8b4476906 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:23.168796 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2273628-80c5-456b-8535-1ee8b4476906 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:23.218311 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:23.230580 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad22b3f-0ffa-49e4-83ba-c909e686e5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:23.234398 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad22b3f-0ffa-49e4-83ba-c909e686e5af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:23.234398 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad22b3f-0ffa-49e4-83ba-c909e686e5af admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:23.234398 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad22b3f-0ffa-49e4-83ba-c909e686e5af admin admin] PATH_INFO: `/v3/users/b40e852b58de41b18b7d35050a94e803` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:23.234398 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad22b3f-0ffa-49e4-83ba-c909e686e5af admin admin] RBAC: Authorizing `identity:delete_user(user_id=b40e852b58de41b18b7d35050a94e803)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:23.235406 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad22b3f-0ffa-49e4-83ba-c909e686e5af admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:23.478013 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-6ad22b3f-0ffa-49e4-83ba-c909e686e5af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b40e852b58de41b18b7d35050a94e803'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:23.478593 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-6ad22b3f-0ffa-49e4-83ba-c909e686e5af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b40e852b58de41b18b7d35050a94e803'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:23.560269 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-6ad22b3f-0ffa-49e4-83ba-c909e686e5af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b40e852b58de41b18b7d35050a94e803'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:23.560887 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-6ad22b3f-0ffa-49e4-83ba-c909e686e5af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b40e852b58de41b18b7d35050a94e803'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:23.568695 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-6ad22b3f-0ffa-49e4-83ba-c909e686e5af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b40e852b58de41b18b7d35050a94e803'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:23.587048 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1306/2607] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:44:23 2022] DELETE /identity/v3/users/b40e852b58de41b18b7d35050a94e803 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:44:23.849810 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc30a0-f04f-4a75-9977-da5dbedc145c admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:23.851573 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-ccdc30a0-f04f-4a75-9977-da5dbedc145c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:23.865776 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc30a0-f04f-4a75-9977-da5dbedc145c admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:23.928440 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3257ca-83c8-4d1e-842e-e9893015dbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:23.929292 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3257ca-83c8-4d1e-842e-e9893015dbd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:23.929574 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3257ca-83c8-4d1e-842e-e9893015dbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:23.929849 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3257ca-83c8-4d1e-842e-e9893015dbd3 admin admin] PATH_INFO: `/v3/projects/d3ff77fd64c847fcb3c83777a6db4f8b` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:23.931698 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3257ca-83c8-4d1e-842e-e9893015dbd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3ff77fd64c847fcb3c83777a6db4f8b)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:23.933644 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3257ca-83c8-4d1e-842e-e9893015dbd3 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:24.045493 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-bf3257ca-83c8-4d1e-842e-e9893015dbd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3ff77fd64c847fcb3c83777a6db4f8b', 'request_id': 'req-bf3257ca-83c8-4d1e-842e-e9893015dbd3'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:24.119951 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-bf3257ca-83c8-4d1e-842e-e9893015dbd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3ff77fd64c847fcb3c83777a6db4f8b', 'request_id': 'req-bf3257ca-83c8-4d1e-842e-e9893015dbd3'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:24.122334 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:24.126501 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-bf3257ca-83c8-4d1e-842e-e9893015dbd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3ff77fd64c847fcb3c83777a6db4f8b', 'request_id': 'req-bf3257ca-83c8-4d1e-842e-e9893015dbd3'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:24.138291 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-bf3257ca-83c8-4d1e-842e-e9893015dbd3 admin admin] The token cache is being invalidate because project d3ff77fd64c847fcb3c83777a6db4f8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:44:24.138594 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-bf3257ca-83c8-4d1e-842e-e9893015dbd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:24.139236 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-bf3257ca-83c8-4d1e-842e-e9893015dbd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:24.140805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1302/2608] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:44:23 2022] DELETE /identity/v3/projects/d3ff77fd64c847fcb3c83777a6db4f8b => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:44:24.145994 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b235f9-df98-425b-a2c0-c3caebe59792 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:24.146287 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b235f9-df98-425b-a2c0-c3caebe59792 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:24.146566 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b235f9-df98-425b-a2c0-c3caebe59792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:24.165420 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-21b235f9-df98-425b-a2c0-c3caebe59792 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:44:24.166643 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-21b235f9-df98-425b-a2c0-c3caebe59792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:24.226565 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1307/2609] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:44:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:44:24.234336 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b83c60-b1bd-4832-b95c-cb3b309a4560 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:24.234912 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b83c60-b1bd-4832-b95c-cb3b309a4560 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:24.235430 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b83c60-b1bd-4832-b95c-cb3b309a4560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:24.251726 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b235f9-df98-425b-a2c0-c3caebe59792 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:24.253545 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-21b235f9-df98-425b-a2c0-c3caebe59792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:24.255191 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-94b83c60-b1bd-4832-b95c-cb3b309a4560 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:44:24.256408 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-94b83c60-b1bd-4832-b95c-cb3b309a4560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:24.266621 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1303/2610] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:44:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:44:24.269901 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b235f9-df98-425b-a2c0-c3caebe59792 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:24.274202 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b83c60-b1bd-4832-b95c-cb3b309a4560 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:24.274912 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f74dab-e795-48ee-9403-90677e451c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:24.275858 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f74dab-e795-48ee-9403-90677e451c51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:24.276153 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f74dab-e795-48ee-9403-90677e451c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:24.276454 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f74dab-e795-48ee-9403-90677e451c51 admin admin] PATH_INFO: `/v3/users/783c8b0af18d4ba5a4390a923d70fef2` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:24.277677 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f74dab-e795-48ee-9403-90677e451c51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=783c8b0af18d4ba5a4390a923d70fef2)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:24.279638 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f74dab-e795-48ee-9403-90677e451c51 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:24.280756 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b83c60-b1bd-4832-b95c-cb3b309a4560 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:24.285600 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aca2446-11bc-450f-9d0f-54e2345287c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:24.286303 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca2446-11bc-450f-9d0f-54e2345287c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:24.286652 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca2446-11bc-450f-9d0f-54e2345287c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:24.286933 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca2446-11bc-450f-9d0f-54e2345287c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:24.287681 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aca2446-11bc-450f-9d0f-54e2345287c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:44:24.287995 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aca2446-11bc-450f-9d0f-54e2345287c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:24.289693 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aca2446-11bc-450f-9d0f-54e2345287c1 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:24.308048 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1304/2611] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:44:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:44:24.309242 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aca2446-11bc-450f-9d0f-54e2345287c1 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:24.321673 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aca2446-11bc-450f-9d0f-54e2345287c1 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:24.326843 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0790f-fff7-4bb6-a09e-f0c382d6572d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:24.327497 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0790f-fff7-4bb6-a09e-f0c382d6572d admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:24.327779 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0790f-fff7-4bb6-a09e-f0c382d6572d admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:24.328052 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0790f-fff7-4bb6-a09e-f0c382d6572d admin admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:24.328775 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a0790f-fff7-4bb6-a09e-f0c382d6572d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:24.330666 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a0790f-fff7-4bb6-a09e-f0c382d6572d admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:24.428372 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1305/2612] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:44:24 2022] POST /identity/v3/projects => generated 371 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 09:44:24.432408 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0790f-fff7-4bb6-a09e-f0c382d6572d admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:24.494643 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0790f-fff7-4bb6-a09e-f0c382d6572d admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:24.499424 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac92162-6490-491d-8a2a-772261aa7794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:24.500081 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac92162-6490-491d-8a2a-772261aa7794 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:24.500401 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac92162-6490-491d-8a2a-772261aa7794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:24.500675 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac92162-6490-491d-8a2a-772261aa7794 admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:24.501355 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac92162-6490-491d-8a2a-772261aa7794 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:24.503247 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac92162-6490-491d-8a2a-772261aa7794 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:24.524878 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-19f74dab-e795-48ee-9403-90677e451c51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '783c8b0af18d4ba5a4390a923d70fef2'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:24.527739 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-19f74dab-e795-48ee-9403-90677e451c51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '783c8b0af18d4ba5a4390a923d70fef2'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:24.600648 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1306/2613] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:44:24 2022] POST /identity/v3/users => generated 286 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 09:44:24.605315 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac92162-6490-491d-8a2a-772261aa7794 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:24.605456 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-19f74dab-e795-48ee-9403-90677e451c51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '783c8b0af18d4ba5a4390a923d70fef2'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:24.606023 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-19f74dab-e795-48ee-9403-90677e451c51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '783c8b0af18d4ba5a4390a923d70fef2'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:24.607251 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-7ac92162-6490-491d-8a2a-772261aa7794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:24.615832 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-19f74dab-e795-48ee-9403-90677e451c51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '783c8b0af18d4ba5a4390a923d70fef2'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:24.617470 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:24.621531 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac92162-6490-491d-8a2a-772261aa7794 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:24.626832 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b9051-4ec6-4c84-8896-fca072cf8ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:24.627507 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b9051-4ec6-4c84-8896-fca072cf8ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:24.627788 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b9051-4ec6-4c84-8896-fca072cf8ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:24.628060 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b9051-4ec6-4c84-8896-fca072cf8ac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:24.629034 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590b9051-4ec6-4c84-8896-fca072cf8ac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:24.630644 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590b9051-4ec6-4c84-8896-fca072cf8ac2 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:24.640157 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1308/2614] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:44:24 2022] DELETE /identity/v3/users/783c8b0af18d4ba5a4390a923d70fef2 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:44:24.644139 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1307/2615] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 09:44:24.644543 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97dd322-1b12-4fa5-ad9f-271b29713016 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:24.644838 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97dd322-1b12-4fa5-ad9f-271b29713016 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:24.645032 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b9051-4ec6-4c84-8896-fca072cf8ac2 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:24.645845 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97dd322-1b12-4fa5-ad9f-271b29713016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:24.655178 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b9051-4ec6-4c84-8896-fca072cf8ac2 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:24.663136 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-a97dd322-1b12-4fa5-ad9f-271b29713016 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:44:24.666079 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-a97dd322-1b12-4fa5-ad9f-271b29713016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:24.717579 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf11283-95bb-4e09-8c99-85a69c8311f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:24.718249 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf11283-95bb-4e09-8c99-85a69c8311f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:24.718532 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf11283-95bb-4e09-8c99-85a69c8311f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:24.718810 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf11283-95bb-4e09-8c99-85a69c8311f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:24.719601 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf11283-95bb-4e09-8c99-85a69c8311f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:24.721285 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf11283-95bb-4e09-8c99-85a69c8311f2 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:24.729763 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1309/2616] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:44:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 09:44:24.732360 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1308/2617] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:44:24.736553 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97dd322-1b12-4fa5-ad9f-271b29713016 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:24.739556 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf11283-95bb-4e09-8c99-85a69c8311f2 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:24.741515 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-7cf11283-95bb-4e09-8c99-85a69c8311f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:24.746812 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97dd322-1b12-4fa5-ad9f-271b29713016 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:24.751586 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e8d27-fb4c-4491-a1bb-cff4801719cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:24.752507 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e8d27-fb4c-4491-a1bb-cff4801719cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:24.752789 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e8d27-fb4c-4491-a1bb-cff4801719cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:24.753063 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e8d27-fb4c-4491-a1bb-cff4801719cd admin admin] PATH_INFO: `/v3/projects/71226c4d3eb148e3b73ae61bf6ca57fd/users/cb57a79f57044fac8e1812ba90f27a8c/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:24.765184 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:24.770031 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1e8d27-fb4c-4491-a1bb-cff4801719cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=71226c4d3eb148e3b73ae61bf6ca57fd, user_id=cb57a79f57044fac8e1812ba90f27a8c, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:24.772780 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1e8d27-fb4c-4491-a1bb-cff4801719cd admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:24.800575 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf11283-95bb-4e09-8c99-85a69c8311f2 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:24.804190 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4547aa-a7f0-42fe-b58c-6c4b21424063 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:24.804854 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4547aa-a7f0-42fe-b58c-6c4b21424063 service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:24.805703 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4547aa-a7f0-42fe-b58c-6c4b21424063 service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:24.805982 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4547aa-a7f0-42fe-b58c-6c4b21424063 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:24.814845 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4547aa-a7f0-42fe-b58c-6c4b21424063 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:24.819379 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4547aa-a7f0-42fe-b58c-6c4b21424063 service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:24.825836 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1309/2618] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:44:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 09:44:24.840005 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1310/2619] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:44:24 2022] PUT /identity/v3/projects/71226c4d3eb148e3b73ae61bf6ca57fd/users/cb57a79f57044fac8e1812ba90f27a8c/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:44:24.850577 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe63e35-d0a8-4420-bbd2-3a2b23450ad9 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:24.850990 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe63e35-d0a8-4420-bbd2-3a2b23450ad9 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:24.851538 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe63e35-d0a8-4420-bbd2-3a2b23450ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:24.879152 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-cfe63e35-d0a8-4420-bbd2-3a2b23450ad9 None None] MFA Rules not processed for user `cb57a79f57044fac8e1812ba90f27a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:44:24.880519 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-cfe63e35-d0a8-4420-bbd2-3a2b23450ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:24.950790 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1310/2620] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:44:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:44:24.955570 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e8d27-fb4c-4491-a1bb-cff4801719cd admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:25.019950 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e8d27-fb4c-4491-a1bb-cff4801719cd admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:25.025286 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f48b4c1-8ce4-421c-b39e-3a7fad8a0142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:25.025951 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48b4c1-8ce4-421c-b39e-3a7fad8a0142 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:25.026235 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48b4c1-8ce4-421c-b39e-3a7fad8a0142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:25.026505 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48b4c1-8ce4-421c-b39e-3a7fad8a0142 admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:25.027350 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f48b4c1-8ce4-421c-b39e-3a7fad8a0142 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:25.029369 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f48b4c1-8ce4-421c-b39e-3a7fad8a0142 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:25.122975 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1311/2621] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:44:24 2022] POST /identity/v3/projects => generated 371 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 09:44:25.124533 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe63e35-d0a8-4420-bbd2-3a2b23450ad9 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:25.136228 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe63e35-d0a8-4420-bbd2-3a2b23450ad9 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:25.194990 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ac4af-4320-495b-82bc-630a714e05c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:25.196335 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ac4af-4320-495b-82bc-630a714e05c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:25.207462 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ac4af-4320-495b-82bc-630a714e05c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:25.207462 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ac4af-4320-495b-82bc-630a714e05c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:25.207462 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ac4af-4320-495b-82bc-630a714e05c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:25.207462 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ac4af-4320-495b-82bc-630a714e05c4 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:25.292039 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1311/2622] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:44:25 2022] POST /identity/v3/users => generated 292 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:44:25.292151 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f48b4c1-8ce4-421c-b39e-3a7fad8a0142 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:25.293704 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ac4af-4320-495b-82bc-630a714e05c4 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:25.295676 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-8f48b4c1-8ce4-421c-b39e-3a7fad8a0142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:25.305837 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ac4af-4320-495b-82bc-630a714e05c4 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:25.309867 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f48b4c1-8ce4-421c-b39e-3a7fad8a0142 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:25.314615 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1944a12-c4d7-4fbb-a900-4f0aee4e5cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:25.315291 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1944a12-c4d7-4fbb-a900-4f0aee4e5cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:25.315413 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d04b6-4d4a-4b79-a307-8f403386a028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:25.315568 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1944a12-c4d7-4fbb-a900-4f0aee4e5cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:25.315836 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1944a12-c4d7-4fbb-a900-4f0aee4e5cd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:25.316652 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1944a12-c4d7-4fbb-a900-4f0aee4e5cd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:25.317008 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d04b6-4d4a-4b79-a307-8f403386a028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:25.317508 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d04b6-4d4a-4b79-a307-8f403386a028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:25.317960 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d04b6-4d4a-4b79-a307-8f403386a028 admin admin] PATH_INFO: `/v3/projects/2a13b5a1198f43b5a38e867b6ad716bd` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:25.318598 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1944a12-c4d7-4fbb-a900-4f0aee4e5cd0 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:25.319348 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d04b6-4d4a-4b79-a307-8f403386a028 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a13b5a1198f43b5a38e867b6ad716bd)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:25.326381 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d04b6-4d4a-4b79-a307-8f403386a028 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:25.330914 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1312/2623] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:44:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:44:25.335123 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1944a12-c4d7-4fbb-a900-4f0aee4e5cd0 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:25.345740 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1944a12-c4d7-4fbb-a900-4f0aee4e5cd0 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:25.350438 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41173fc-74f1-453f-8a0b-9db59fef15db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:25.351583 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41173fc-74f1-453f-8a0b-9db59fef15db admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:25.351868 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41173fc-74f1-453f-8a0b-9db59fef15db admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:25.352141 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41173fc-74f1-453f-8a0b-9db59fef15db admin admin] PATH_INFO: `/v3/projects/8458a59e7c6a4341b35ea9b3bbe926aa/users/4c7e23aa5f5e41d7a1f85e8394b20c3a/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:25.367365 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41173fc-74f1-453f-8a0b-9db59fef15db admin admin] RBAC: Authorizing `identity:create_grant(project_id=8458a59e7c6a4341b35ea9b3bbe926aa, user_id=4c7e23aa5f5e41d7a1f85e8394b20c3a, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:25.369986 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41173fc-74f1-453f-8a0b-9db59fef15db admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:25.442812 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1313/2624] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:44:25 2022] PUT /identity/v3/projects/8458a59e7c6a4341b35ea9b3bbe926aa/users/4c7e23aa5f5e41d7a1f85e8394b20c3a/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:44:25.447652 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41173fc-74f1-453f-8a0b-9db59fef15db admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:25.450081 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:25.456649 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:25.459054 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-897d04b6-4d4a-4b79-a307-8f403386a028 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a13b5a1198f43b5a38e867b6ad716bd', 'request_id': 'req-897d04b6-4d4a-4b79-a307-8f403386a028'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:25.509060 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41173fc-74f1-453f-8a0b-9db59fef15db admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:25.550595 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-897d04b6-4d4a-4b79-a307-8f403386a028 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a13b5a1198f43b5a38e867b6ad716bd', 'request_id': 'req-897d04b6-4d4a-4b79-a307-8f403386a028'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:25.557381 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-897d04b6-4d4a-4b79-a307-8f403386a028 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a13b5a1198f43b5a38e867b6ad716bd', 'request_id': 'req-897d04b6-4d4a-4b79-a307-8f403386a028'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:25.565749 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f38d1-ba12-49fc-b990-93c980284e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:25.566423 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f38d1-ba12-49fc-b990-93c980284e4c admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:25.566747 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f38d1-ba12-49fc-b990-93c980284e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:25.567042 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f38d1-ba12-49fc-b990-93c980284e4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:25.567803 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6f38d1-ba12-49fc-b990-93c980284e4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:25.569084 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-897d04b6-4d4a-4b79-a307-8f403386a028 admin admin] The token cache is being invalidate because project 2a13b5a1198f43b5a38e867b6ad716bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:44:25.569369 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-897d04b6-4d4a-4b79-a307-8f403386a028 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:25.569498 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6f38d1-ba12-49fc-b990-93c980284e4c admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:25.570049 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-897d04b6-4d4a-4b79-a307-8f403386a028 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:25.571723 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1312/2625] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:44:25 2022] DELETE /identity/v3/projects/2a13b5a1198f43b5a38e867b6ad716bd => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:44:25.576749 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a983ac-21ba-4927-9b6a-230cd1262b2b None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:25.577081 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a983ac-21ba-4927-9b6a-230cd1262b2b None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:25.577367 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a983ac-21ba-4927-9b6a-230cd1262b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:25.581575 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1314/2626] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:44:25 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 09:44:25.587140 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f38d1-ba12-49fc-b990-93c980284e4c admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:25.589018 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-fa6f38d1-ba12-49fc-b990-93c980284e4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:25.597947 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-39a983ac-21ba-4927-9b6a-230cd1262b2b None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:44:25.599138 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-39a983ac-21ba-4927-9b6a-230cd1262b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:25.602533 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f38d1-ba12-49fc-b990-93c980284e4c admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:25.607390 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8cdd1c-be74-43ba-836a-8cb885e5f251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:25.608422 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cdd1c-be74-43ba-836a-8cb885e5f251 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:25.608656 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1313/2627] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:44:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 09:44:25.611565 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cdd1c-be74-43ba-836a-8cb885e5f251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:25.611565 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cdd1c-be74-43ba-836a-8cb885e5f251 admin admin] PATH_INFO: `/v3/projects/8458a59e7c6a4341b35ea9b3bbe926aa/users/4c7e23aa5f5e41d7a1f85e8394b20c3a/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:25.611565 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8cdd1c-be74-43ba-836a-8cb885e5f251 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8458a59e7c6a4341b35ea9b3bbe926aa, user_id=4c7e23aa5f5e41d7a1f85e8394b20c3a, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:25.613805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8cdd1c-be74-43ba-836a-8cb885e5f251 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:25.626004 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1315/2628] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:44:25 2022] PUT /identity/v3/projects/8458a59e7c6a4341b35ea9b3bbe926aa/users/4c7e23aa5f5e41d7a1f85e8394b20c3a/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:44:25.638152 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce049a-b021-40e1-adbe-f1033cd7d391 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:25.638446 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce049a-b021-40e1-adbe-f1033cd7d391 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:25.643060 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce049a-b021-40e1-adbe-f1033cd7d391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:25.668671 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-24ce049a-b021-40e1-adbe-f1033cd7d391 None None] MFA Rules not processed for user `4c7e23aa5f5e41d7a1f85e8394b20c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:44:25.675047 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-24ce049a-b021-40e1-adbe-f1033cd7d391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:25.675255 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b438b6-d699-4011-9bdf-5283202100d0 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:25.675255 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b438b6-d699-4011-9bdf-5283202100d0 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:25.675460 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b438b6-d699-4011-9bdf-5283202100d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:25.694896 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-e3b438b6-d699-4011-9bdf-5283202100d0 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:44:25.696635 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-e3b438b6-d699-4011-9bdf-5283202100d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:25.741869 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1314/2629] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:44:25 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:44:25.753804 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce049a-b021-40e1-adbe-f1033cd7d391 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:25.755154 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-24ce049a-b021-40e1-adbe-f1033cd7d391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:25.757276 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1316/2630] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:44:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 09:44:25.761921 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b438b6-d699-4011-9bdf-5283202100d0 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:25.771246 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b438b6-d699-4011-9bdf-5283202100d0 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:25.775935 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e85cae-dab2-4a7b-8cb8-151159aae5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:25.776607 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e85cae-dab2-4a7b-8cb8-151159aae5b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:25.776888 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e85cae-dab2-4a7b-8cb8-151159aae5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:25.777163 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e85cae-dab2-4a7b-8cb8-151159aae5b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:25.777873 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e85cae-dab2-4a7b-8cb8-151159aae5b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:44:25.778175 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e85cae-dab2-4a7b-8cb8-151159aae5b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:25.779775 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e85cae-dab2-4a7b-8cb8-151159aae5b5 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:25.791604 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1317/2631] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:44:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:44:25.796042 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e85cae-dab2-4a7b-8cb8-151159aae5b5 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:25.806269 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e85cae-dab2-4a7b-8cb8-151159aae5b5 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:25.810809 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa2768-9201-48ac-a171-3d25cfa41e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:25.811439 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa2768-9201-48ac-a171-3d25cfa41e1f admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:25.811718 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa2768-9201-48ac-a171-3d25cfa41e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:25.811991 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa2768-9201-48ac-a171-3d25cfa41e1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:25.812700 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa2768-9201-48ac-a171-3d25cfa41e1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:25.814584 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa2768-9201-48ac-a171-3d25cfa41e1f admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:25.814698 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce049a-b021-40e1-adbe-f1033cd7d391 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:25.818566 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915f26e-22a9-4ce9-9a79-963ef5a742e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:25.819215 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915f26e-22a9-4ce9-9a79-963ef5a742e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:25.819521 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915f26e-22a9-4ce9-9a79-963ef5a742e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:25.819851 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915f26e-22a9-4ce9-9a79-963ef5a742e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:25.829939 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4915f26e-22a9-4ce9-9a79-963ef5a742e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:25.831434 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4915f26e-22a9-4ce9-9a79-963ef5a742e9 service cinder] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:25.841095 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1315/2632] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:44:25 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 09:44:25.949428 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1318/2633] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:44:25 2022] POST /identity/v3/projects => generated 369 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 09:44:25.953396 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915f26e-22a9-4ce9-9a79-963ef5a742e9 service cinder] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:25.969270 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915f26e-22a9-4ce9-9a79-963ef5a742e9 service cinder] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:26.018458 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:26.031834 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837065e8-f4ee-460b-a9d9-3517e0b39878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:26.032534 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837065e8-f4ee-460b-a9d9-3517e0b39878 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:26.032820 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837065e8-f4ee-460b-a9d9-3517e0b39878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:26.033117 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837065e8-f4ee-460b-a9d9-3517e0b39878 admin admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:26.033796 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837065e8-f4ee-460b-a9d9-3517e0b39878 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:26.035809 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837065e8-f4ee-460b-a9d9-3517e0b39878 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:26.126530 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1316/2634] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:44:25 2022] POST /identity/v3/users => generated 285 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 09:44:26.130772 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa2768-9201-48ac-a171-3d25cfa41e1f admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:26.136395 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:26.141934 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa2768-9201-48ac-a171-3d25cfa41e1f admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:26.146633 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc05fc-0da3-4dfe-9333-ec51bde6b036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:26.147289 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc05fc-0da3-4dfe-9333-ec51bde6b036 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:26.147569 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc05fc-0da3-4dfe-9333-ec51bde6b036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:26.147845 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc05fc-0da3-4dfe-9333-ec51bde6b036 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:26.148647 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc05fc-0da3-4dfe-9333-ec51bde6b036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:26.150244 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc05fc-0da3-4dfe-9333-ec51bde6b036 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:26.160438 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1319/2635] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:44:26.165011 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837065e8-f4ee-460b-a9d9-3517e0b39878 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:26.175208 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837065e8-f4ee-460b-a9d9-3517e0b39878 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:26.179831 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fcb059-344d-41b9-9090-be01d6f4081c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:26.181113 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fcb059-344d-41b9-9090-be01d6f4081c admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:26.181399 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fcb059-344d-41b9-9090-be01d6f4081c admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:26.181679 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fcb059-344d-41b9-9090-be01d6f4081c admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:26.182403 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fcb059-344d-41b9-9090-be01d6f4081c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:26.184000 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fcb059-344d-41b9-9090-be01d6f4081c admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:26.193908 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1317/2636] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:44:26.198654 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc05fc-0da3-4dfe-9333-ec51bde6b036 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:26.208949 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc05fc-0da3-4dfe-9333-ec51bde6b036 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:26.215346 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9267ce-652c-46e2-b406-bad460af6a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:26.216407 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9267ce-652c-46e2-b406-bad460af6a9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:26.216678 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9267ce-652c-46e2-b406-bad460af6a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:26.216955 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9267ce-652c-46e2-b406-bad460af6a9c admin admin] PATH_INFO: `/v3/projects/bb24e5e90c854d6eb9ac1450337c5314/users/f79907ce56b94895b32e26795b60a5f7/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:26.232043 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9267ce-652c-46e2-b406-bad460af6a9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb24e5e90c854d6eb9ac1450337c5314, user_id=f79907ce56b94895b32e26795b60a5f7, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:26.238377 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9267ce-652c-46e2-b406-bad460af6a9c admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:26.362445 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1320/2637] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:44:26 2022] PUT /identity/v3/projects/bb24e5e90c854d6eb9ac1450337c5314/users/f79907ce56b94895b32e26795b60a5f7/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:44:26.372398 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5b061-357b-4f18-89be-49e1e888442e None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:26.372879 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5b061-357b-4f18-89be-49e1e888442e None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:26.372994 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5b061-357b-4f18-89be-49e1e888442e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:26.402298 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-d1c5b061-357b-4f18-89be-49e1e888442e None None] MFA Rules not processed for user `f79907ce56b94895b32e26795b60a5f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:44:26.403541 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-d1c5b061-357b-4f18-89be-49e1e888442e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:26.473521 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1318/2638] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:44:26 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:44:26.486941 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9267ce-652c-46e2-b406-bad460af6a9c admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:26.488823 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-fa9267ce-652c-46e2-b406-bad460af6a9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:26.548223 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9267ce-652c-46e2-b406-bad460af6a9c admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:26.551863 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87f5b9-5a33-405d-8665-896515a1ee76 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6f97b803a28453c8b78fd8380ac64ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:26.552580 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87f5b9-5a33-405d-8665-896515a1ee76 service glance] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:26.552860 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87f5b9-5a33-405d-8665-896515a1ee76 service glance] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:26.553131 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87f5b9-5a33-405d-8665-896515a1ee76 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:26.562216 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab87f5b9-5a33-405d-8665-896515a1ee76 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:26.563703 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab87f5b9-5a33-405d-8665-896515a1ee76 service glance] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:26.573499 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1321/2639] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:44:26 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:44:26.977027 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5b061-357b-4f18-89be-49e1e888442e None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:27.043125 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5b061-357b-4f18-89be-49e1e888442e None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:27.049541 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5db9c8-34bd-4afb-bdc9-9a095f1f98f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:27.050705 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5db9c8-34bd-4afb-bdc9-9a095f1f98f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:27.051116 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5db9c8-34bd-4afb-bdc9-9a095f1f98f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:27.051498 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5db9c8-34bd-4afb-bdc9-9a095f1f98f5 admin admin] PATH_INFO: `/v3/users/cb57a79f57044fac8e1812ba90f27a8c` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:27.052941 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5db9c8-34bd-4afb-bdc9-9a095f1f98f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb57a79f57044fac8e1812ba90f27a8c)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:27.055007 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5db9c8-34bd-4afb-bdc9-9a095f1f98f5 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:27.457436 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-5b5db9c8-34bd-4afb-bdc9-9a095f1f98f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb57a79f57044fac8e1812ba90f27a8c'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:27.458331 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-5b5db9c8-34bd-4afb-bdc9-9a095f1f98f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb57a79f57044fac8e1812ba90f27a8c'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:27.551033 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-5b5db9c8-34bd-4afb-bdc9-9a095f1f98f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb57a79f57044fac8e1812ba90f27a8c'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:27.551659 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-5b5db9c8-34bd-4afb-bdc9-9a095f1f98f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb57a79f57044fac8e1812ba90f27a8c'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:27.554247 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:27.560393 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-5b5db9c8-34bd-4afb-bdc9-9a095f1f98f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb57a79f57044fac8e1812ba90f27a8c'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:27.577264 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1319/2640] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:44:26 2022] DELETE /identity/v3/users/cb57a79f57044fac8e1812ba90f27a8c => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:44:27.581749 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be52dc-4c5d-49b5-8c63-d65b8953d130 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:27.582290 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be52dc-4c5d-49b5-8c63-d65b8953d130 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:27.582290 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be52dc-4c5d-49b5-8c63-d65b8953d130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:27.600309 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-98be52dc-4c5d-49b5-8c63-d65b8953d130 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:44:27.601791 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-98be52dc-4c5d-49b5-8c63-d65b8953d130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:27.663467 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1322/2641] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:44:27.673459 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5db9c8-34bd-4afb-bdc9-9a095f1f98f5 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:27.674978 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-5b5db9c8-34bd-4afb-bdc9-9a095f1f98f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:27.734857 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5db9c8-34bd-4afb-bdc9-9a095f1f98f5 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:27.738731 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac514a9f-c75e-4345-9a22-59dc978ed4dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:27.739388 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac514a9f-c75e-4345-9a22-59dc978ed4dc service neutron] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:27.739677 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac514a9f-c75e-4345-9a22-59dc978ed4dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:27.739952 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac514a9f-c75e-4345-9a22-59dc978ed4dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:27.752626 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac514a9f-c75e-4345-9a22-59dc978ed4dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:27.754074 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac514a9f-c75e-4345-9a22-59dc978ed4dc service neutron] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:27.764921 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1320/2642] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:44:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:44:28.210108 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be52dc-4c5d-49b5-8c63-d65b8953d130 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:28.212165 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-98be52dc-4c5d-49b5-8c63-d65b8953d130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:28.227132 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be52dc-4c5d-49b5-8c63-d65b8953d130 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:28.233209 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d26a1-3fd1-476c-ac43-d561190dc7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:28.234159 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d26a1-3fd1-476c-ac43-d561190dc7d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:28.234498 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d26a1-3fd1-476c-ac43-d561190dc7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:28.234806 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d26a1-3fd1-476c-ac43-d561190dc7d7 admin admin] PATH_INFO: `/v3/projects/71226c4d3eb148e3b73ae61bf6ca57fd` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:28.236172 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d26a1-3fd1-476c-ac43-d561190dc7d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71226c4d3eb148e3b73ae61bf6ca57fd)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:28.238148 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d26a1-3fd1-476c-ac43-d561190dc7d7 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:28.354168 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-b07d26a1-3fd1-476c-ac43-d561190dc7d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71226c4d3eb148e3b73ae61bf6ca57fd', 'request_id': 'req-b07d26a1-3fd1-476c-ac43-d561190dc7d7'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:28.419725 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-b07d26a1-3fd1-476c-ac43-d561190dc7d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71226c4d3eb148e3b73ae61bf6ca57fd', 'request_id': 'req-b07d26a1-3fd1-476c-ac43-d561190dc7d7'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:28.427358 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-b07d26a1-3fd1-476c-ac43-d561190dc7d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71226c4d3eb148e3b73ae61bf6ca57fd', 'request_id': 'req-b07d26a1-3fd1-476c-ac43-d561190dc7d7'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:28.429859 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:28.439050 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-b07d26a1-3fd1-476c-ac43-d561190dc7d7 admin admin] The token cache is being invalidate because project 71226c4d3eb148e3b73ae61bf6ca57fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:44:28.439337 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-b07d26a1-3fd1-476c-ac43-d561190dc7d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:28.440027 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-b07d26a1-3fd1-476c-ac43-d561190dc7d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:28.441840 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1323/2643] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:44:28 2022] DELETE /identity/v3/projects/71226c4d3eb148e3b73ae61bf6ca57fd => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:44:28.445844 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac514a9f-c75e-4345-9a22-59dc978ed4dc service neutron] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:28.456562 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac514a9f-c75e-4345-9a22-59dc978ed4dc service neutron] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:28.517526 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b82042-e6d9-4e4d-88a6-966e236d4b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:28.518327 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b82042-e6d9-4e4d-88a6-966e236d4b81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:28.518612 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b82042-e6d9-4e4d-88a6-966e236d4b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:28.518891 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b82042-e6d9-4e4d-88a6-966e236d4b81 admin admin] PATH_INFO: `/v3/users/4c7e23aa5f5e41d7a1f85e8394b20c3a` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:28.520155 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b82042-e6d9-4e4d-88a6-966e236d4b81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c7e23aa5f5e41d7a1f85e8394b20c3a)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:28.522213 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b82042-e6d9-4e4d-88a6-966e236d4b81 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:28.765793 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-f7b82042-e6d9-4e4d-88a6-966e236d4b81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c7e23aa5f5e41d7a1f85e8394b20c3a'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:28.768766 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-f7b82042-e6d9-4e4d-88a6-966e236d4b81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c7e23aa5f5e41d7a1f85e8394b20c3a'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:28.845752 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-f7b82042-e6d9-4e4d-88a6-966e236d4b81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c7e23aa5f5e41d7a1f85e8394b20c3a'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:28.846461 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-f7b82042-e6d9-4e4d-88a6-966e236d4b81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c7e23aa5f5e41d7a1f85e8394b20c3a'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:28.856483 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-f7b82042-e6d9-4e4d-88a6-966e236d4b81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c7e23aa5f5e41d7a1f85e8394b20c3a'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:28.869142 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:28.876285 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1321/2644] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:44:28 2022] DELETE /identity/v3/users/4c7e23aa5f5e41d7a1f85e8394b20c3a => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:44:29.438829 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d26a1-3fd1-476c-ac43-d561190dc7d7 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:29.441213 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-b07d26a1-3fd1-476c-ac43-d561190dc7d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:29.455520 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d26a1-3fd1-476c-ac43-d561190dc7d7 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:29.518805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7155e-606b-48df-96c0-ac62424bc16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:29.519667 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7155e-606b-48df-96c0-ac62424bc16c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:29.519950 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7155e-606b-48df-96c0-ac62424bc16c admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:29.520246 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7155e-606b-48df-96c0-ac62424bc16c admin admin] PATH_INFO: `/v3/projects/8458a59e7c6a4341b35ea9b3bbe926aa` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:29.521429 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d7155e-606b-48df-96c0-ac62424bc16c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8458a59e7c6a4341b35ea9b3bbe926aa)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:29.523342 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d7155e-606b-48df-96c0-ac62424bc16c admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:29.642743 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-10d7155e-606b-48df-96c0-ac62424bc16c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8458a59e7c6a4341b35ea9b3bbe926aa', 'request_id': 'req-10d7155e-606b-48df-96c0-ac62424bc16c'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:29.750867 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-10d7155e-606b-48df-96c0-ac62424bc16c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8458a59e7c6a4341b35ea9b3bbe926aa', 'request_id': 'req-10d7155e-606b-48df-96c0-ac62424bc16c'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:29.760610 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-10d7155e-606b-48df-96c0-ac62424bc16c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8458a59e7c6a4341b35ea9b3bbe926aa', 'request_id': 'req-10d7155e-606b-48df-96c0-ac62424bc16c'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:29.772175 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-10d7155e-606b-48df-96c0-ac62424bc16c admin admin] The token cache is being invalidate because project 8458a59e7c6a4341b35ea9b3bbe926aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:44:29.772492 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-10d7155e-606b-48df-96c0-ac62424bc16c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:29.773152 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-10d7155e-606b-48df-96c0-ac62424bc16c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:29.775221 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1324/2645] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:44:29 2022] DELETE /identity/v3/projects/8458a59e7c6a4341b35ea9b3bbe926aa => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:44:29.782670 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2bc78-b2d2-48ae-9f1d-4612d5a3ba70 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:29.783163 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2bc78-b2d2-48ae-9f1d-4612d5a3ba70 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:29.783276 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2bc78-b2d2-48ae-9f1d-4612d5a3ba70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:29.802681 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-a5f2bc78-b2d2-48ae-9f1d-4612d5a3ba70 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:44:29.803966 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-a5f2bc78-b2d2-48ae-9f1d-4612d5a3ba70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:29.865924 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1322/2646] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:44:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:44:29.873783 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d9410-5c3b-49a0-93ea-f854f5e6c2fa None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:29.874070 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d9410-5c3b-49a0-93ea-f854f5e6c2fa None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:29.876903 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d9410-5c3b-49a0-93ea-f854f5e6c2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:29.894318 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-cd5d9410-5c3b-49a0-93ea-f854f5e6c2fa None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:44:29.895549 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-cd5d9410-5c3b-49a0-93ea-f854f5e6c2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:29.904487 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1325/2647] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:44:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:44:29.914157 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f2bc78-b2d2-48ae-9f1d-4612d5a3ba70 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:29.923995 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f2bc78-b2d2-48ae-9f1d-4612d5a3ba70 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:29.928591 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8304051b-169d-408d-9281-2189d46461fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:29.929317 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8304051b-169d-408d-9281-2189d46461fd admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:29.929524 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8304051b-169d-408d-9281-2189d46461fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:29.929802 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8304051b-169d-408d-9281-2189d46461fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:29.930528 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8304051b-169d-408d-9281-2189d46461fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:44:29.930842 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8304051b-169d-408d-9281-2189d46461fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:29.932512 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8304051b-169d-408d-9281-2189d46461fd admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:29.945221 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1323/2648] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:44:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:44:29.950390 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d9410-5c3b-49a0-93ea-f854f5e6c2fa None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:29.959740 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d9410-5c3b-49a0-93ea-f854f5e6c2fa None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:29.965085 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ab746-15d9-4312-832b-9e1a07e3f498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:29.968730 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ab746-15d9-4312-832b-9e1a07e3f498 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:29.968730 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ab746-15d9-4312-832b-9e1a07e3f498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:29.968730 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ab746-15d9-4312-832b-9e1a07e3f498 admin admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:29.968730 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ab746-15d9-4312-832b-9e1a07e3f498 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:29.969193 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ab746-15d9-4312-832b-9e1a07e3f498 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:30.064509 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1326/2649] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:44:29 2022] POST /identity/v3/projects => generated 365 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:44:30.067281 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8304051b-169d-408d-9281-2189d46461fd admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:30.078493 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8304051b-169d-408d-9281-2189d46461fd admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:30.137871 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046bb712-9092-48c7-97f7-831e10be881e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:30.138623 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046bb712-9092-48c7-97f7-831e10be881e admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:30.138910 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046bb712-9092-48c7-97f7-831e10be881e admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:30.139187 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046bb712-9092-48c7-97f7-831e10be881e admin admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:30.139924 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046bb712-9092-48c7-97f7-831e10be881e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:30.141908 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046bb712-9092-48c7-97f7-831e10be881e admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:30.223822 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1324/2650] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:44:30 2022] POST /identity/v3/users => generated 283 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:44:30.228727 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ab746-15d9-4312-832b-9e1a07e3f498 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:30.239464 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ab746-15d9-4312-832b-9e1a07e3f498 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:30.244240 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45133b4-2d2e-43bf-93c2-13609f4dcb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:30.244902 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45133b4-2d2e-43bf-93c2-13609f4dcb9d admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:30.245183 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45133b4-2d2e-43bf-93c2-13609f4dcb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:30.245458 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45133b4-2d2e-43bf-93c2-13609f4dcb9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:30.246209 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45133b4-2d2e-43bf-93c2-13609f4dcb9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:30.248079 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45133b4-2d2e-43bf-93c2-13609f4dcb9d admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:30.260644 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1327/2651] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:44:30.264968 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046bb712-9092-48c7-97f7-831e10be881e admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:30.275558 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046bb712-9092-48c7-97f7-831e10be881e admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:30.280285 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0885cc8c-f548-4fed-a864-dc6c7002c5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:30.280940 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885cc8c-f548-4fed-a864-dc6c7002c5ca admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:30.281218 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885cc8c-f548-4fed-a864-dc6c7002c5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:30.281493 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885cc8c-f548-4fed-a864-dc6c7002c5ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:30.282206 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0885cc8c-f548-4fed-a864-dc6c7002c5ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:30.283789 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0885cc8c-f548-4fed-a864-dc6c7002c5ca admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:30.294586 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1325/2652] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:44:30.298764 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45133b4-2d2e-43bf-93c2-13609f4dcb9d admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:30.309048 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45133b4-2d2e-43bf-93c2-13609f4dcb9d admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:30.319071 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635de83-4d7c-4686-92cb-64cca3acca7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:30.319892 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635de83-4d7c-4686-92cb-64cca3acca7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:30.320168 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635de83-4d7c-4686-92cb-64cca3acca7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:30.320480 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635de83-4d7c-4686-92cb-64cca3acca7c admin admin] PATH_INFO: `/v3/projects/4df3b50a0f4743f5bf4ea5f62339171c/users/a3fd511296b9468f98c9b909c0d200eb/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:30.336335 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2635de83-4d7c-4686-92cb-64cca3acca7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4df3b50a0f4743f5bf4ea5f62339171c, user_id=a3fd511296b9468f98c9b909c0d200eb, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:30.339568 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2635de83-4d7c-4686-92cb-64cca3acca7c admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:30.412035 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1328/2653] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:44:30 2022] PUT /identity/v3/projects/4df3b50a0f4743f5bf4ea5f62339171c/users/a3fd511296b9468f98c9b909c0d200eb/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:44:30.424961 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d826b-e398-4469-9e8f-c576b49d2ad4 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:30.425469 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d826b-e398-4469-9e8f-c576b49d2ad4 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:30.425963 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d826b-e398-4469-9e8f-c576b49d2ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:30.455528 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-3b7d826b-e398-4469-9e8f-c576b49d2ad4 None None] MFA Rules not processed for user `a3fd511296b9468f98c9b909c0d200eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:44:30.456775 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-3b7d826b-e398-4469-9e8f-c576b49d2ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:30.508716 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:30.525745 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1326/2654] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:44:30 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:44:30.530478 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635de83-4d7c-4686-92cb-64cca3acca7c admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:30.553153 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:30.595496 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635de83-4d7c-4686-92cb-64cca3acca7c admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:30.600450 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b54b5e-59c3-4e7f-853b-a29b745ee80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:30.605156 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b54b5e-59c3-4e7f-853b-a29b745ee80c admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:30.605156 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b54b5e-59c3-4e7f-853b-a29b745ee80c admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:30.605156 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b54b5e-59c3-4e7f-853b-a29b745ee80c admin admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:30.605156 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b54b5e-59c3-4e7f-853b-a29b745ee80c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:30.605156 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b54b5e-59c3-4e7f-853b-a29b745ee80c admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:30.670166 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1329/2655] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:44:30 2022] POST /identity/v3/projects => generated 365 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:44:30.674598 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d826b-e398-4469-9e8f-c576b49d2ad4 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:30.685805 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d826b-e398-4469-9e8f-c576b49d2ad4 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:30.746445 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ec1b93-ca5d-4bae-93ab-53561b4e0bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:30.747120 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec1b93-ca5d-4bae-93ab-53561b4e0bbb admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:30.747407 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec1b93-ca5d-4bae-93ab-53561b4e0bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:30.747687 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec1b93-ca5d-4bae-93ab-53561b4e0bbb admin admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:30.748413 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ec1b93-ca5d-4bae-93ab-53561b4e0bbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:30.750341 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ec1b93-ca5d-4bae-93ab-53561b4e0bbb admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:30.828796 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1327/2656] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:44:30 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:44:30.834451 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b54b5e-59c3-4e7f-853b-a29b745ee80c admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:30.846504 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b54b5e-59c3-4e7f-853b-a29b745ee80c admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:30.851773 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c145f-f858-4c8a-baec-882d49d3de43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:30.852475 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c145f-f858-4c8a-baec-882d49d3de43 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:30.852785 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c145f-f858-4c8a-baec-882d49d3de43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:30.853061 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c145f-f858-4c8a-baec-882d49d3de43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:30.853788 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c145f-f858-4c8a-baec-882d49d3de43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:30.855459 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c145f-f858-4c8a-baec-882d49d3de43 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:30.866176 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1330/2657] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:44:30.870722 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ec1b93-ca5d-4bae-93ab-53561b4e0bbb admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:30.881615 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ec1b93-ca5d-4bae-93ab-53561b4e0bbb admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:30.887091 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020559c-8528-4b9b-bdea-38900db872ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:30.892925 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020559c-8528-4b9b-bdea-38900db872ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:30.892925 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020559c-8528-4b9b-bdea-38900db872ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:30.892925 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020559c-8528-4b9b-bdea-38900db872ac admin admin] PATH_INFO: `/v3/projects/9812bf26472c4808b05c2739dd054d33/users/c8037b8d18364faaa36c50daf98e2fe1/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:30.903913 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b020559c-8528-4b9b-bdea-38900db872ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=9812bf26472c4808b05c2739dd054d33, user_id=c8037b8d18364faaa36c50daf98e2fe1, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:30.906701 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b020559c-8528-4b9b-bdea-38900db872ac admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:31.017476 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1328/2658] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:44:30 2022] PUT /identity/v3/projects/9812bf26472c4808b05c2739dd054d33/users/c8037b8d18364faaa36c50daf98e2fe1/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:44:31.021423 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c145f-f858-4c8a-baec-882d49d3de43 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:31.031587 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c145f-f858-4c8a-baec-882d49d3de43 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:31.090317 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fcc089-45bf-4935-b553-4223714963aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:31.091090 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fcc089-45bf-4935-b553-4223714963aa admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:31.091277 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fcc089-45bf-4935-b553-4223714963aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:31.091589 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fcc089-45bf-4935-b553-4223714963aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:31.092344 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fcc089-45bf-4935-b553-4223714963aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:31.093981 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fcc089-45bf-4935-b553-4223714963aa admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:31.104725 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1331/2659] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:44:31 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:44:31.108806 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020559c-8528-4b9b-bdea-38900db872ac admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:31.119986 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020559c-8528-4b9b-bdea-38900db872ac admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:31.124726 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e527d0d-aef3-4d5a-b934-1547a2dd9e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:31.125612 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e527d0d-aef3-4d5a-b934-1547a2dd9e78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:31.125896 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e527d0d-aef3-4d5a-b934-1547a2dd9e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:31.126175 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e527d0d-aef3-4d5a-b934-1547a2dd9e78 admin admin] PATH_INFO: `/v3/projects/9812bf26472c4808b05c2739dd054d33/users/c8037b8d18364faaa36c50daf98e2fe1/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:31.128405 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e527d0d-aef3-4d5a-b934-1547a2dd9e78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9812bf26472c4808b05c2739dd054d33, user_id=c8037b8d18364faaa36c50daf98e2fe1, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:31.131490 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e527d0d-aef3-4d5a-b934-1547a2dd9e78 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:31.144345 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1329/2660] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:44:31 2022] PUT /identity/v3/projects/9812bf26472c4808b05c2739dd054d33/users/c8037b8d18364faaa36c50daf98e2fe1/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:44:31.154469 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8934c-edfc-4356-83e9-329da73a9544 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:31.154755 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8934c-edfc-4356-83e9-329da73a9544 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:31.155031 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8934c-edfc-4356-83e9-329da73a9544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:31.184785 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-44f8934c-edfc-4356-83e9-329da73a9544 None None] MFA Rules not processed for user `c8037b8d18364faaa36c50daf98e2fe1`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:44:31.186010 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-44f8934c-edfc-4356-83e9-329da73a9544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:31.256274 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1332/2661] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:44:31 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:44:31.271046 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e527d0d-aef3-4d5a-b934-1547a2dd9e78 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:31.272842 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-3e527d0d-aef3-4d5a-b934-1547a2dd9e78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:31.334171 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e527d0d-aef3-4d5a-b934-1547a2dd9e78 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:31.337952 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe4f69a-0895-4ac6-9c5d-f0b9fbd59fd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:31.338605 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4f69a-0895-4ac6-9c5d-f0b9fbd59fd0 service cinder] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:31.338887 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4f69a-0895-4ac6-9c5d-f0b9fbd59fd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:31.339158 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4f69a-0895-4ac6-9c5d-f0b9fbd59fd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:31.349012 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe4f69a-0895-4ac6-9c5d-f0b9fbd59fd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:31.350466 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe4f69a-0895-4ac6-9c5d-f0b9fbd59fd0 service cinder] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:31.361781 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1330/2662] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:44:31 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:44:31.561238 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8934c-edfc-4356-83e9-329da73a9544 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:31.571661 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8934c-edfc-4356-83e9-329da73a9544 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:31.575346 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68524e46-9f26-4c5b-af88-6d7a7111d6b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:31.575986 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68524e46-9f26-4c5b-af88-6d7a7111d6b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:31.576299 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68524e46-9f26-4c5b-af88-6d7a7111d6b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:31.576576 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68524e46-9f26-4c5b-af88-6d7a7111d6b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:31.591866 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:31.639976 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68524e46-9f26-4c5b-af88-6d7a7111d6b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:31.641454 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68524e46-9f26-4c5b-af88-6d7a7111d6b5 service cinder] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:31.651026 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1333/2663] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:44:31 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:44:41.357719 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=74,keystone:INSERT=5 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:41.572585 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe4f69a-0895-4ac6-9c5d-f0b9fbd59fd0 service cinder] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:41.634593 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe4f69a-0895-4ac6-9c5d-f0b9fbd59fd0 service cinder] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:41.639044 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7af6a9-5350-4d70-9a94-8ad5144b2214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:41.639923 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7af6a9-5350-4d70-9a94-8ad5144b2214 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:41.640215 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7af6a9-5350-4d70-9a94-8ad5144b2214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:41.640495 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7af6a9-5350-4d70-9a94-8ad5144b2214 admin admin] PATH_INFO: `/v3/users/a3fd511296b9468f98c9b909c0d200eb` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:41.641665 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7af6a9-5350-4d70-9a94-8ad5144b2214 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3fd511296b9468f98c9b909c0d200eb)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:41.643588 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7af6a9-5350-4d70-9a94-8ad5144b2214 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:41.665072 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=21 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:41.822176 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-7d7af6a9-5350-4d70-9a94-8ad5144b2214 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3fd511296b9468f98c9b909c0d200eb'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:41.822888 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-7d7af6a9-5350-4d70-9a94-8ad5144b2214 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3fd511296b9468f98c9b909c0d200eb'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:41.905728 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-7d7af6a9-5350-4d70-9a94-8ad5144b2214 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3fd511296b9468f98c9b909c0d200eb'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:41.906278 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-7d7af6a9-5350-4d70-9a94-8ad5144b2214 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3fd511296b9468f98c9b909c0d200eb'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:41.913898 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-7d7af6a9-5350-4d70-9a94-8ad5144b2214 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3fd511296b9468f98c9b909c0d200eb'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:41.931729 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1331/2664] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:44:41 2022] DELETE /identity/v3/users/a3fd511296b9468f98c9b909c0d200eb => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:44:41.936499 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34c7c5-da14-435a-ac87-e7761bbf936d None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:41.936774 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34c7c5-da14-435a-ac87-e7761bbf936d None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:41.937057 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34c7c5-da14-435a-ac87-e7761bbf936d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:41.954320 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-4f34c7c5-da14-435a-ac87-e7761bbf936d None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:44:41.955543 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-4f34c7c5-da14-435a-ac87-e7761bbf936d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:42.020400 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1334/2665] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:44:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:44:42.030860 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7af6a9-5350-4d70-9a94-8ad5144b2214 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:42.032295 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-7d7af6a9-5350-4d70-9a94-8ad5144b2214 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:42.096570 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7af6a9-5350-4d70-9a94-8ad5144b2214 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:42.100702 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4763c-74b3-4b0f-9f78-ddbff96958ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:42.101637 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4763c-74b3-4b0f-9f78-ddbff96958ea service neutron] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:42.101921 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4763c-74b3-4b0f-9f78-ddbff96958ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:42.102199 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4763c-74b3-4b0f-9f78-ddbff96958ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:42.112068 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e4763c-74b3-4b0f-9f78-ddbff96958ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:42.113568 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e4763c-74b3-4b0f-9f78-ddbff96958ea service neutron] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:42.123997 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1332/2666] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:44:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:44:42.598636 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34c7c5-da14-435a-ac87-e7761bbf936d None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:42.600286 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-4f34c7c5-da14-435a-ac87-e7761bbf936d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:42.613138 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34c7c5-da14-435a-ac87-e7761bbf936d None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:42.618268 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c5a7d-0b01-47e1-9f9d-0311afd6d3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:42.619166 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c5a7d-0b01-47e1-9f9d-0311afd6d3f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:42.619572 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c5a7d-0b01-47e1-9f9d-0311afd6d3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:42.619856 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c5a7d-0b01-47e1-9f9d-0311afd6d3f4 admin admin] PATH_INFO: `/v3/projects/4df3b50a0f4743f5bf4ea5f62339171c` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:42.621673 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c5a7d-0b01-47e1-9f9d-0311afd6d3f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4df3b50a0f4743f5bf4ea5f62339171c)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:42.623659 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c5a7d-0b01-47e1-9f9d-0311afd6d3f4 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:42.753742 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-770c5a7d-0b01-47e1-9f9d-0311afd6d3f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4df3b50a0f4743f5bf4ea5f62339171c', 'request_id': 'req-770c5a7d-0b01-47e1-9f9d-0311afd6d3f4'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:42.833482 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-770c5a7d-0b01-47e1-9f9d-0311afd6d3f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4df3b50a0f4743f5bf4ea5f62339171c', 'request_id': 'req-770c5a7d-0b01-47e1-9f9d-0311afd6d3f4'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:42.839532 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-770c5a7d-0b01-47e1-9f9d-0311afd6d3f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4df3b50a0f4743f5bf4ea5f62339171c', 'request_id': 'req-770c5a7d-0b01-47e1-9f9d-0311afd6d3f4'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:42.851756 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-770c5a7d-0b01-47e1-9f9d-0311afd6d3f4 admin admin] The token cache is being invalidate because project 4df3b50a0f4743f5bf4ea5f62339171c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:44:42.851974 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-770c5a7d-0b01-47e1-9f9d-0311afd6d3f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:42.852680 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-770c5a7d-0b01-47e1-9f9d-0311afd6d3f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:42.854225 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1335/2667] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:44:42 2022] DELETE /identity/v3/projects/4df3b50a0f4743f5bf4ea5f62339171c => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:44:42.858354 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4763c-74b3-4b0f-9f78-ddbff96958ea service neutron] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:42.869009 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4763c-74b3-4b0f-9f78-ddbff96958ea service neutron] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:42.888393 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:42.926116 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6ac8e-e89d-4d3b-9193-38b499b98a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:42.927037 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6ac8e-e89d-4d3b-9193-38b499b98a63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:42.927319 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6ac8e-e89d-4d3b-9193-38b499b98a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:42.927596 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6ac8e-e89d-4d3b-9193-38b499b98a63 admin admin] PATH_INFO: `/v3/users/c8037b8d18364faaa36c50daf98e2fe1` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:42.928828 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b6ac8e-e89d-4d3b-9193-38b499b98a63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8037b8d18364faaa36c50daf98e2fe1)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:42.930751 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b6ac8e-e89d-4d3b-9193-38b499b98a63 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:43.079614 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-37b6ac8e-e89d-4d3b-9193-38b499b98a63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8037b8d18364faaa36c50daf98e2fe1'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:43.080317 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-37b6ac8e-e89d-4d3b-9193-38b499b98a63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8037b8d18364faaa36c50daf98e2fe1'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:43.156817 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-37b6ac8e-e89d-4d3b-9193-38b499b98a63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8037b8d18364faaa36c50daf98e2fe1'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:43.157437 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-37b6ac8e-e89d-4d3b-9193-38b499b98a63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8037b8d18364faaa36c50daf98e2fe1'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:43.165232 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-37b6ac8e-e89d-4d3b-9193-38b499b98a63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8037b8d18364faaa36c50daf98e2fe1'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:43.182718 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1333/2668] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:44:42 2022] DELETE /identity/v3/users/c8037b8d18364faaa36c50daf98e2fe1 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:44:43.574974 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c5a7d-0b01-47e1-9f9d-0311afd6d3f4 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:43.576525 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-770c5a7d-0b01-47e1-9f9d-0311afd6d3f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:43.589437 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c5a7d-0b01-47e1-9f9d-0311afd6d3f4 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:43.646399 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944687ab-d490-496f-82a5-c3edf719ea46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:43.647201 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944687ab-d490-496f-82a5-c3edf719ea46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:43.647465 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944687ab-d490-496f-82a5-c3edf719ea46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:43.647741 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944687ab-d490-496f-82a5-c3edf719ea46 admin admin] PATH_INFO: `/v3/projects/9812bf26472c4808b05c2739dd054d33` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:43.648954 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944687ab-d490-496f-82a5-c3edf719ea46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9812bf26472c4808b05c2739dd054d33)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:43.650869 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944687ab-d490-496f-82a5-c3edf719ea46 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:43.741088 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:43.757787 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-944687ab-d490-496f-82a5-c3edf719ea46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9812bf26472c4808b05c2739dd054d33', 'request_id': 'req-944687ab-d490-496f-82a5-c3edf719ea46'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:43.819086 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-944687ab-d490-496f-82a5-c3edf719ea46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9812bf26472c4808b05c2739dd054d33', 'request_id': 'req-944687ab-d490-496f-82a5-c3edf719ea46'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:43.824995 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-944687ab-d490-496f-82a5-c3edf719ea46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9812bf26472c4808b05c2739dd054d33', 'request_id': 'req-944687ab-d490-496f-82a5-c3edf719ea46'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:43.836764 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-944687ab-d490-496f-82a5-c3edf719ea46 admin admin] The token cache is being invalidate because project 9812bf26472c4808b05c2739dd054d33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:44:43.837056 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-944687ab-d490-496f-82a5-c3edf719ea46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:43.837700 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-944687ab-d490-496f-82a5-c3edf719ea46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:43.839231 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1336/2669] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:44:43 2022] DELETE /identity/v3/projects/9812bf26472c4808b05c2739dd054d33 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:44:43.844731 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b991c26-7031-4e19-a664-41922af42466 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:43.845021 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b991c26-7031-4e19-a664-41922af42466 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:43.845328 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b991c26-7031-4e19-a664-41922af42466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:43.864353 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-9b991c26-7031-4e19-a664-41922af42466 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:44:43.865562 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-9b991c26-7031-4e19-a664-41922af42466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:43.924318 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1334/2670] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:44:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:44:43.932099 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3904740-ec5b-4a16-8d67-6771ee0e9676 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:43.932419 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3904740-ec5b-4a16-8d67-6771ee0e9676 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:43.932703 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3904740-ec5b-4a16-8d67-6771ee0e9676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:43.951621 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-f3904740-ec5b-4a16-8d67-6771ee0e9676 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:44:43.952949 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-f3904740-ec5b-4a16-8d67-6771ee0e9676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:43.961076 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1337/2671] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:44:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:44:43.965063 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b991c26-7031-4e19-a664-41922af42466 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:43.975444 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b991c26-7031-4e19-a664-41922af42466 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:43.980300 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f1a681-7fc1-420e-90e4-a9e9c7f7cc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:43.980961 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1a681-7fc1-420e-90e4-a9e9c7f7cc0a admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:43.981243 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1a681-7fc1-420e-90e4-a9e9c7f7cc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:43.981518 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1a681-7fc1-420e-90e4-a9e9c7f7cc0a admin admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:43.982254 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f1a681-7fc1-420e-90e4-a9e9c7f7cc0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:44:43.982564 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f1a681-7fc1-420e-90e4-a9e9c7f7cc0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:43.984165 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f1a681-7fc1-420e-90e4-a9e9c7f7cc0a admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:43.997282 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1335/2672] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:44:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:44:44.001698 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3904740-ec5b-4a16-8d67-6771ee0e9676 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:44.011033 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3904740-ec5b-4a16-8d67-6771ee0e9676 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:44.016434 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3b87b-6bfa-45b0-b520-ffbc406d3b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:44.017080 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3b87b-6bfa-45b0-b520-ffbc406d3b00 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:44.017361 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3b87b-6bfa-45b0-b520-ffbc406d3b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:44.017638 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3b87b-6bfa-45b0-b520-ffbc406d3b00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:44.018328 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe3b87b-6bfa-45b0-b520-ffbc406d3b00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:44.020235 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe3b87b-6bfa-45b0-b520-ffbc406d3b00 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:44.126921 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1338/2673] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:44:44 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:44:44.131111 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f1a681-7fc1-420e-90e4-a9e9c7f7cc0a admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:44.141988 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f1a681-7fc1-420e-90e4-a9e9c7f7cc0a admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:44.168667 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:44.198058 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e3cc3-feef-4f0f-8796-95d2a4254afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:44.198654 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e3cc3-feef-4f0f-8796-95d2a4254afc admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:44.198939 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e3cc3-feef-4f0f-8796-95d2a4254afc admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:44.199214 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e3cc3-feef-4f0f-8796-95d2a4254afc admin admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:44.199932 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741e3cc3-feef-4f0f-8796-95d2a4254afc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:44.202452 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741e3cc3-feef-4f0f-8796-95d2a4254afc admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:44.290949 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1336/2674] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:44:44 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:44:44.295054 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3b87b-6bfa-45b0-b520-ffbc406d3b00 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:44.305311 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3b87b-6bfa-45b0-b520-ffbc406d3b00 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:44.309907 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be2200-19ad-4c02-9d94-6e1dfda0d9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:44.310552 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be2200-19ad-4c02-9d94-6e1dfda0d9d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:44.310832 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be2200-19ad-4c02-9d94-6e1dfda0d9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:44.311106 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be2200-19ad-4c02-9d94-6e1dfda0d9d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:44.311835 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be2200-19ad-4c02-9d94-6e1dfda0d9d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:44.313457 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be2200-19ad-4c02-9d94-6e1dfda0d9d8 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:44.325078 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1339/2675] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:44:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 09:44:44.330826 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e3cc3-feef-4f0f-8796-95d2a4254afc admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:44.341565 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e3cc3-feef-4f0f-8796-95d2a4254afc admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:44.346456 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41492af8-b3ac-495b-adfd-cb34318f7c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:44.347307 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41492af8-b3ac-495b-adfd-cb34318f7c7e admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:44.347761 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41492af8-b3ac-495b-adfd-cb34318f7c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:44.348439 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41492af8-b3ac-495b-adfd-cb34318f7c7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:44.349160 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41492af8-b3ac-495b-adfd-cb34318f7c7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:44.351037 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41492af8-b3ac-495b-adfd-cb34318f7c7e admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:44.361082 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1337/2676] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:44:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:44:44.365286 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be2200-19ad-4c02-9d94-6e1dfda0d9d8 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:44.375693 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be2200-19ad-4c02-9d94-6e1dfda0d9d8 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:44.381310 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb36e5e-9af4-40ee-9d53-880a85a58381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:44.382175 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb36e5e-9af4-40ee-9d53-880a85a58381 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:44.382455 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb36e5e-9af4-40ee-9d53-880a85a58381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:44.382726 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb36e5e-9af4-40ee-9d53-880a85a58381 admin admin] PATH_INFO: `/v3/projects/92c935d665d84336abe017b8877b3e74/users/568c50b2ebb845bb95745910ce1da1e4/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:44.397956 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb36e5e-9af4-40ee-9d53-880a85a58381 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92c935d665d84336abe017b8877b3e74, user_id=568c50b2ebb845bb95745910ce1da1e4, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:44.400689 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb36e5e-9af4-40ee-9d53-880a85a58381 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:44.486427 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1340/2677] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:44:44 2022] PUT /identity/v3/projects/92c935d665d84336abe017b8877b3e74/users/568c50b2ebb845bb95745910ce1da1e4/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:44:44.498310 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e4cc3-7fa7-4210-be7f-9ca99b6248de None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:44.498597 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e4cc3-7fa7-4210-be7f-9ca99b6248de None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:44.498874 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e4cc3-7fa7-4210-be7f-9ca99b6248de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:44.525616 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-4d0e4cc3-7fa7-4210-be7f-9ca99b6248de None None] MFA Rules not processed for user `568c50b2ebb845bb95745910ce1da1e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:44:44.526830 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-4d0e4cc3-7fa7-4210-be7f-9ca99b6248de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:44.592414 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1338/2678] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:44:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:44:44.596960 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb36e5e-9af4-40ee-9d53-880a85a58381 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:44.658166 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb36e5e-9af4-40ee-9d53-880a85a58381 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:44.662820 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53667e92-eee7-4e1a-8285-db4c9331df73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:44.663471 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53667e92-eee7-4e1a-8285-db4c9331df73 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:44.663756 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53667e92-eee7-4e1a-8285-db4c9331df73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:44.664032 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53667e92-eee7-4e1a-8285-db4c9331df73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:44.664833 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53667e92-eee7-4e1a-8285-db4c9331df73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:44.666732 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53667e92-eee7-4e1a-8285-db4c9331df73 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:44.749106 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1341/2679] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:44:44 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:44:44.753249 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e4cc3-7fa7-4210-be7f-9ca99b6248de None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:44.764812 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e4cc3-7fa7-4210-be7f-9ca99b6248de None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:44.821636 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d3b4b-5d87-48ea-850b-e4594e515f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:44.822917 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d3b4b-5d87-48ea-850b-e4594e515f29 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:44.823202 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d3b4b-5d87-48ea-850b-e4594e515f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:44.823483 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d3b4b-5d87-48ea-850b-e4594e515f29 admin admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:44.824174 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2d3b4b-5d87-48ea-850b-e4594e515f29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:44.826656 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2d3b4b-5d87-48ea-850b-e4594e515f29 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:44.924670 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1339/2680] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:44:44 2022] POST /identity/v3/users => generated 299 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:44:44.928612 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53667e92-eee7-4e1a-8285-db4c9331df73 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:44.938989 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53667e92-eee7-4e1a-8285-db4c9331df73 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:44.943693 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb2583-7142-4fdb-85f3-2f8566910c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:44.944382 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb2583-7142-4fdb-85f3-2f8566910c06 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:44.944673 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb2583-7142-4fdb-85f3-2f8566910c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:44.944949 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb2583-7142-4fdb-85f3-2f8566910c06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:44.945672 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fb2583-7142-4fdb-85f3-2f8566910c06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:44.947336 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fb2583-7142-4fdb-85f3-2f8566910c06 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:44.958625 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1342/2681] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:44:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:44:44.962833 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d3b4b-5d87-48ea-850b-e4594e515f29 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:44.973865 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d3b4b-5d87-48ea-850b-e4594e515f29 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:44.978835 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac0c58-c398-4069-860f-74d456884169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:44.979711 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac0c58-c398-4069-860f-74d456884169 admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:44.979989 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac0c58-c398-4069-860f-74d456884169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:44.980295 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac0c58-c398-4069-860f-74d456884169 admin admin] PATH_INFO: `/v3/projects/3f1d227206bf459eb5b1dbaded454380/users/673044df201344f3b36044ba6c547040/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:44.995415 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac0c58-c398-4069-860f-74d456884169 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f1d227206bf459eb5b1dbaded454380, user_id=673044df201344f3b36044ba6c547040, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:44.998110 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac0c58-c398-4069-860f-74d456884169 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:45.091891 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1340/2682] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:44:44 2022] PUT /identity/v3/projects/3f1d227206bf459eb5b1dbaded454380/users/673044df201344f3b36044ba6c547040/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:44:45.095830 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb2583-7142-4fdb-85f3-2f8566910c06 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:45.106262 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb2583-7142-4fdb-85f3-2f8566910c06 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:45.128173 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:45.164226 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f82ca3-c600-4c90-89eb-bee4a70724e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:45.164900 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f82ca3-c600-4c90-89eb-bee4a70724e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:45.165184 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f82ca3-c600-4c90-89eb-bee4a70724e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:45.165518 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f82ca3-c600-4c90-89eb-bee4a70724e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:45.166226 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f82ca3-c600-4c90-89eb-bee4a70724e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:45.167821 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f82ca3-c600-4c90-89eb-bee4a70724e0 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:45.178103 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1343/2683] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:44:45.182386 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac0c58-c398-4069-860f-74d456884169 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:45.188759 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:45.194312 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac0c58-c398-4069-860f-74d456884169 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:45.199036 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c5aa5-93d0-4b77-b532-a14396cac96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:45.199911 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c5aa5-93d0-4b77-b532-a14396cac96d admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:45.200834 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c5aa5-93d0-4b77-b532-a14396cac96d admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:45.201134 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c5aa5-93d0-4b77-b532-a14396cac96d admin admin] PATH_INFO: `/v3/projects/3f1d227206bf459eb5b1dbaded454380/users/673044df201344f3b36044ba6c547040/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:45.203140 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799c5aa5-93d0-4b77-b532-a14396cac96d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f1d227206bf459eb5b1dbaded454380, user_id=673044df201344f3b36044ba6c547040, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:45.205818 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799c5aa5-93d0-4b77-b532-a14396cac96d admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:45.216561 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1341/2684] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:44:45 2022] PUT /identity/v3/projects/3f1d227206bf459eb5b1dbaded454380/users/673044df201344f3b36044ba6c547040/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:44:45.227213 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54bf405-ea6f-4337-9d1b-25ab48ae416f None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:45.227499 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54bf405-ea6f-4337-9d1b-25ab48ae416f None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:45.227774 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54bf405-ea6f-4337-9d1b-25ab48ae416f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:45.254670 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-a54bf405-ea6f-4337-9d1b-25ab48ae416f None None] MFA Rules not processed for user `673044df201344f3b36044ba6c547040`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:44:45.255929 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-a54bf405-ea6f-4337-9d1b-25ab48ae416f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:45.322932 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1344/2685] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:44:45 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:44:45.334708 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c5aa5-93d0-4b77-b532-a14396cac96d admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:45.336583 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-799c5aa5-93d0-4b77-b532-a14396cac96d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:45.393982 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c5aa5-93d0-4b77-b532-a14396cac96d admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:45.397634 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4d0a9b-b68b-47c8-82b4-fa622fa748ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:45.398271 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d0a9b-b68b-47c8-82b4-fa622fa748ad service cinder] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:45.398549 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d0a9b-b68b-47c8-82b4-fa622fa748ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:45.398821 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d0a9b-b68b-47c8-82b4-fa622fa748ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:45.408888 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4d0a9b-b68b-47c8-82b4-fa622fa748ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:45.410452 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4d0a9b-b68b-47c8-82b4-fa622fa748ad service cinder] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:45.420744 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1342/2686] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:44:45 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:44:45.448748 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54bf405-ea6f-4337-9d1b-25ab48ae416f None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:45.512456 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54bf405-ea6f-4337-9d1b-25ab48ae416f None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:45.518046 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25aa39e-8d06-45c9-999d-26b4a3ad8e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:45.518926 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25aa39e-8d06-45c9-999d-26b4a3ad8e64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:45.519210 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25aa39e-8d06-45c9-999d-26b4a3ad8e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:45.519495 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25aa39e-8d06-45c9-999d-26b4a3ad8e64 admin admin] PATH_INFO: `/v3/users/568c50b2ebb845bb95745910ce1da1e4` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:45.520831 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25aa39e-8d06-45c9-999d-26b4a3ad8e64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=568c50b2ebb845bb95745910ce1da1e4)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:45.522719 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25aa39e-8d06-45c9-999d-26b4a3ad8e64 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:45.759552 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-b25aa39e-8d06-45c9-999d-26b4a3ad8e64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '568c50b2ebb845bb95745910ce1da1e4'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:45.760756 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:45.767692 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-b25aa39e-8d06-45c9-999d-26b4a3ad8e64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '568c50b2ebb845bb95745910ce1da1e4'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:45.859378 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-b25aa39e-8d06-45c9-999d-26b4a3ad8e64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '568c50b2ebb845bb95745910ce1da1e4'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:45.860030 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-b25aa39e-8d06-45c9-999d-26b4a3ad8e64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '568c50b2ebb845bb95745910ce1da1e4'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:45.875217 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-b25aa39e-8d06-45c9-999d-26b4a3ad8e64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '568c50b2ebb845bb95745910ce1da1e4'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:45.881546 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1345/2687] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:44:45 2022] DELETE /identity/v3/users/568c50b2ebb845bb95745910ce1da1e4 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:44:45.890943 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf8c06-caed-43a7-8e3d-68bde589cc2d None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:45.890943 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf8c06-caed-43a7-8e3d-68bde589cc2d None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:45.890943 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf8c06-caed-43a7-8e3d-68bde589cc2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:45.906231 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-fdaf8c06-caed-43a7-8e3d-68bde589cc2d None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:44:45.907428 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-fdaf8c06-caed-43a7-8e3d-68bde589cc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:45.967621 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1343/2688] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:44:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:44:45.982613 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25aa39e-8d06-45c9-999d-26b4a3ad8e64 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:45.982613 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-b25aa39e-8d06-45c9-999d-26b4a3ad8e64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:46.037854 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25aa39e-8d06-45c9-999d-26b4a3ad8e64 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:46.041553 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dcc5aa-4d45-4f63-97fa-9f0cfa571709 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:46.042178 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcc5aa-4d45-4f63-97fa-9f0cfa571709 service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:46.042453 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcc5aa-4d45-4f63-97fa-9f0cfa571709 service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:46.042725 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcc5aa-4d45-4f63-97fa-9f0cfa571709 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:46.053296 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dcc5aa-4d45-4f63-97fa-9f0cfa571709 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:46.054533 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dcc5aa-4d45-4f63-97fa-9f0cfa571709 service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:46.064024 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1346/2689] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:44:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:44:46.747055 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf8c06-caed-43a7-8e3d-68bde589cc2d None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:46.748525 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-fdaf8c06-caed-43a7-8e3d-68bde589cc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:46.762175 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf8c06-caed-43a7-8e3d-68bde589cc2d None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:46.766951 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db469f7-7a0d-473d-bc98-84ccbe8936c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:46.767817 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db469f7-7a0d-473d-bc98-84ccbe8936c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:46.768096 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db469f7-7a0d-473d-bc98-84ccbe8936c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:46.768402 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db469f7-7a0d-473d-bc98-84ccbe8936c2 admin admin] PATH_INFO: `/v3/projects/92c935d665d84336abe017b8877b3e74` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:46.770563 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db469f7-7a0d-473d-bc98-84ccbe8936c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92c935d665d84336abe017b8877b3e74)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:46.772596 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db469f7-7a0d-473d-bc98-84ccbe8936c2 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:46.885313 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-8db469f7-7a0d-473d-bc98-84ccbe8936c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92c935d665d84336abe017b8877b3e74', 'request_id': 'req-8db469f7-7a0d-473d-bc98-84ccbe8936c2'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:46.968003 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-8db469f7-7a0d-473d-bc98-84ccbe8936c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92c935d665d84336abe017b8877b3e74', 'request_id': 'req-8db469f7-7a0d-473d-bc98-84ccbe8936c2'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:46.974152 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-8db469f7-7a0d-473d-bc98-84ccbe8936c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92c935d665d84336abe017b8877b3e74', 'request_id': 'req-8db469f7-7a0d-473d-bc98-84ccbe8936c2'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:46.985805 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-8db469f7-7a0d-473d-bc98-84ccbe8936c2 admin admin] The token cache is being invalidate because project 92c935d665d84336abe017b8877b3e74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:44:46.986091 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-8db469f7-7a0d-473d-bc98-84ccbe8936c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:46.986734 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-8db469f7-7a0d-473d-bc98-84ccbe8936c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:46.988307 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1344/2690] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:44:46 2022] DELETE /identity/v3/projects/92c935d665d84336abe017b8877b3e74 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:44:46.992364 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dcc5aa-4d45-4f63-97fa-9f0cfa571709 service neutron] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:47.002259 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dcc5aa-4d45-4f63-97fa-9f0cfa571709 service neutron] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:47.059233 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a970dbd-89e8-4a5d-9ee0-733c9b04cf0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:47.060091 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a970dbd-89e8-4a5d-9ee0-733c9b04cf0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:47.060407 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a970dbd-89e8-4a5d-9ee0-733c9b04cf0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:47.060688 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a970dbd-89e8-4a5d-9ee0-733c9b04cf0c admin admin] PATH_INFO: `/v3/users/673044df201344f3b36044ba6c547040` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:47.061995 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a970dbd-89e8-4a5d-9ee0-733c9b04cf0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=673044df201344f3b36044ba6c547040)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:47.063907 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a970dbd-89e8-4a5d-9ee0-733c9b04cf0c admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:47.241309 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-6a970dbd-89e8-4a5d-9ee0-733c9b04cf0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '673044df201344f3b36044ba6c547040'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:47.248493 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-6a970dbd-89e8-4a5d-9ee0-733c9b04cf0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '673044df201344f3b36044ba6c547040'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:47.347296 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-6a970dbd-89e8-4a5d-9ee0-733c9b04cf0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '673044df201344f3b36044ba6c547040'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:47.347924 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-6a970dbd-89e8-4a5d-9ee0-733c9b04cf0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '673044df201344f3b36044ba6c547040'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:47.353960 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:47.361165 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-6a970dbd-89e8-4a5d-9ee0-733c9b04cf0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '673044df201344f3b36044ba6c547040'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:47.367162 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1347/2691] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:44:46 2022] DELETE /identity/v3/users/673044df201344f3b36044ba6c547040 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:44:47.810214 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db469f7-7a0d-473d-bc98-84ccbe8936c2 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:47.811754 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-8db469f7-7a0d-473d-bc98-84ccbe8936c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:47.824949 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db469f7-7a0d-473d-bc98-84ccbe8936c2 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:47.838603 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:47.884437 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403305f-f531-4993-8b7d-98b391ed2970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:47.885299 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403305f-f531-4993-8b7d-98b391ed2970 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:47.885608 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403305f-f531-4993-8b7d-98b391ed2970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:47.885884 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403305f-f531-4993-8b7d-98b391ed2970 admin admin] PATH_INFO: `/v3/projects/3f1d227206bf459eb5b1dbaded454380` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:47.887141 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b403305f-f531-4993-8b7d-98b391ed2970 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f1d227206bf459eb5b1dbaded454380)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:47.889607 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b403305f-f531-4993-8b7d-98b391ed2970 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:47.982883 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-b403305f-f531-4993-8b7d-98b391ed2970 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f1d227206bf459eb5b1dbaded454380', 'request_id': 'req-b403305f-f531-4993-8b7d-98b391ed2970'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:48.062217 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-b403305f-f531-4993-8b7d-98b391ed2970 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f1d227206bf459eb5b1dbaded454380', 'request_id': 'req-b403305f-f531-4993-8b7d-98b391ed2970'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:48.068813 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-b403305f-f531-4993-8b7d-98b391ed2970 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f1d227206bf459eb5b1dbaded454380', 'request_id': 'req-b403305f-f531-4993-8b7d-98b391ed2970'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:48.082118 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-b403305f-f531-4993-8b7d-98b391ed2970 admin admin] The token cache is being invalidate because project 3f1d227206bf459eb5b1dbaded454380 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:44:48.082464 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-b403305f-f531-4993-8b7d-98b391ed2970 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:48.083178 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-b403305f-f531-4993-8b7d-98b391ed2970 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:48.085007 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1345/2692] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:44:47 2022] DELETE /identity/v3/projects/3f1d227206bf459eb5b1dbaded454380 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:44:48.090329 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9d884-10fd-4d20-9eee-293aaa68f284 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:48.091385 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9d884-10fd-4d20-9eee-293aaa68f284 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:48.091485 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9d884-10fd-4d20-9eee-293aaa68f284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:48.112828 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-c8a9d884-10fd-4d20-9eee-293aaa68f284 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:44:48.114048 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-c8a9d884-10fd-4d20-9eee-293aaa68f284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:48.178743 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1348/2693] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:44:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 09:44:48.186635 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c713870-b7d6-4024-bea8-54a1b2a8d49d None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:48.186922 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c713870-b7d6-4024-bea8-54a1b2a8d49d None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:48.187217 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c713870-b7d6-4024-bea8-54a1b2a8d49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:48.205663 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-9c713870-b7d6-4024-bea8-54a1b2a8d49d None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:44:48.206869 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-9c713870-b7d6-4024-bea8-54a1b2a8d49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:48.214894 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1346/2694] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:44:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 09:44:48.219773 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9d884-10fd-4d20-9eee-293aaa68f284 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:48.229921 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9d884-10fd-4d20-9eee-293aaa68f284 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:48.235142 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b984292-30f5-4999-93f2-9b94ce0b2758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:48.235796 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b984292-30f5-4999-93f2-9b94ce0b2758 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:48.236079 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b984292-30f5-4999-93f2-9b94ce0b2758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:48.236390 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b984292-30f5-4999-93f2-9b94ce0b2758 admin admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:48.237124 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b984292-30f5-4999-93f2-9b94ce0b2758 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:44:48.237451 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b984292-30f5-4999-93f2-9b94ce0b2758 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:48.239062 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b984292-30f5-4999-93f2-9b94ce0b2758 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:48.254056 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1349/2695] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:44:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:44:48.255438 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c713870-b7d6-4024-bea8-54a1b2a8d49d None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:48.265078 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c713870-b7d6-4024-bea8-54a1b2a8d49d None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:48.269879 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a6c925-015b-4532-b9b6-a614028ad3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:48.270533 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6c925-015b-4532-b9b6-a614028ad3f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:48.270820 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6c925-015b-4532-b9b6-a614028ad3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:48.271095 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6c925-015b-4532-b9b6-a614028ad3f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:48.271787 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a6c925-015b-4532-b9b6-a614028ad3f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:48.273724 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a6c925-015b-4532-b9b6-a614028ad3f0 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:48.352355 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1347/2696] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:44:48 2022] POST /identity/v3/projects => generated 399 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:44:48.356245 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b984292-30f5-4999-93f2-9b94ce0b2758 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:48.367736 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b984292-30f5-4999-93f2-9b94ce0b2758 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:48.426564 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40fe5d2-a697-481d-b9f3-547f4a7d623c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:48.427249 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40fe5d2-a697-481d-b9f3-547f4a7d623c admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:48.427526 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40fe5d2-a697-481d-b9f3-547f4a7d623c admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:48.427796 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40fe5d2-a697-481d-b9f3-547f4a7d623c admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:48.428528 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40fe5d2-a697-481d-b9f3-547f4a7d623c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:48.430439 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40fe5d2-a697-481d-b9f3-547f4a7d623c admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:48.549139 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1350/2697] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:44:48 2022] POST /identity/v3/users => generated 300 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:44:48.553328 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a6c925-015b-4532-b9b6-a614028ad3f0 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:48.563858 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a6c925-015b-4532-b9b6-a614028ad3f0 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:48.568458 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d729ef3-f50d-402d-8a24-4991e2f5214b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:48.569120 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d729ef3-f50d-402d-8a24-4991e2f5214b admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:48.569443 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d729ef3-f50d-402d-8a24-4991e2f5214b admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:48.569726 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d729ef3-f50d-402d-8a24-4991e2f5214b admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:48.570448 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d729ef3-f50d-402d-8a24-4991e2f5214b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:48.572064 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d729ef3-f50d-402d-8a24-4991e2f5214b admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:48.583146 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1348/2698] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:44:48.587171 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40fe5d2-a697-481d-b9f3-547f4a7d623c admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:48.597751 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40fe5d2-a697-481d-b9f3-547f4a7d623c admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:48.603007 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c756e6-a003-42c7-8e00-2013e4f8bddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:48.603600 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c756e6-a003-42c7-8e00-2013e4f8bddf admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:48.603888 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c756e6-a003-42c7-8e00-2013e4f8bddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:48.604214 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c756e6-a003-42c7-8e00-2013e4f8bddf admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:48.604954 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c756e6-a003-42c7-8e00-2013e4f8bddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:48.606549 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c756e6-a003-42c7-8e00-2013e4f8bddf admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:48.616522 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1351/2699] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:44:48.620489 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d729ef3-f50d-402d-8a24-4991e2f5214b admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:48.630368 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d729ef3-f50d-402d-8a24-4991e2f5214b admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:48.634899 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd0b3b-dc64-42b6-8d62-f07a99941e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:48.635767 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd0b3b-dc64-42b6-8d62-f07a99941e76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:48.636050 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd0b3b-dc64-42b6-8d62-f07a99941e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:48.636364 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd0b3b-dc64-42b6-8d62-f07a99941e76 admin admin] PATH_INFO: `/v3/projects/939fe1ce316d4d5aa4ff6aa6787a9889/users/697a6feb6cab4df59107b5bc18e1f20b/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:48.651554 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bd0b3b-dc64-42b6-8d62-f07a99941e76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=939fe1ce316d4d5aa4ff6aa6787a9889, user_id=697a6feb6cab4df59107b5bc18e1f20b, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:48.654843 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bd0b3b-dc64-42b6-8d62-f07a99941e76 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:48.730773 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1349/2700] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:44:48 2022] PUT /identity/v3/projects/939fe1ce316d4d5aa4ff6aa6787a9889/users/697a6feb6cab4df59107b5bc18e1f20b/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:44:48.742005 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835f66b-9fa3-436a-96e5-fc432416bc7f None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:48.742373 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835f66b-9fa3-436a-96e5-fc432416bc7f None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:48.742652 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835f66b-9fa3-436a-96e5-fc432416bc7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:48.769295 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-2835f66b-9fa3-436a-96e5-fc432416bc7f None None] MFA Rules not processed for user `697a6feb6cab4df59107b5bc18e1f20b`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:44:48.770672 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-2835f66b-9fa3-436a-96e5-fc432416bc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:48.811019 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:48.833323 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1352/2701] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:44:48 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:44:48.837830 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd0b3b-dc64-42b6-8d62-f07a99941e76 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:48.885495 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:48.902889 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd0b3b-dc64-42b6-8d62-f07a99941e76 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:48.907606 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d659bef-2b18-463b-86ea-ad6b5c0ebaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:48.908324 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d659bef-2b18-463b-86ea-ad6b5c0ebaf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:48.908614 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d659bef-2b18-463b-86ea-ad6b5c0ebaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:48.908894 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d659bef-2b18-463b-86ea-ad6b5c0ebaf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:48.909578 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d659bef-2b18-463b-86ea-ad6b5c0ebaf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:48.911478 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d659bef-2b18-463b-86ea-ad6b5c0ebaf7 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:49.022864 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1350/2702] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:44:48 2022] POST /identity/v3/projects => generated 397 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:44:49.027055 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2835f66b-9fa3-436a-96e5-fc432416bc7f None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:49.037854 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2835f66b-9fa3-436a-96e5-fc432416bc7f None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:49.094068 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc6244-d7a5-4ca7-8b6d-b61d181e9bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:49.094779 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc6244-d7a5-4ca7-8b6d-b61d181e9bcd admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:49.095004 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc6244-d7a5-4ca7-8b6d-b61d181e9bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:49.095277 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc6244-d7a5-4ca7-8b6d-b61d181e9bcd admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:49.095956 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc6244-d7a5-4ca7-8b6d-b61d181e9bcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:49.097929 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc6244-d7a5-4ca7-8b6d-b61d181e9bcd admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:49.211469 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1353/2703] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:44:49 2022] POST /identity/v3/users => generated 305 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:44:49.215366 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d659bef-2b18-463b-86ea-ad6b5c0ebaf7 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:49.226084 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d659bef-2b18-463b-86ea-ad6b5c0ebaf7 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:49.230789 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa8ba3-04cf-42ae-b345-6220d82b9de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:49.232094 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa8ba3-04cf-42ae-b345-6220d82b9de9 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:49.232405 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa8ba3-04cf-42ae-b345-6220d82b9de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:49.232684 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa8ba3-04cf-42ae-b345-6220d82b9de9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:49.233412 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa8ba3-04cf-42ae-b345-6220d82b9de9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:49.235003 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa8ba3-04cf-42ae-b345-6220d82b9de9 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:49.245665 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1351/2704] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:44:49.252503 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc6244-d7a5-4ca7-8b6d-b61d181e9bcd admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:49.262865 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc6244-d7a5-4ca7-8b6d-b61d181e9bcd admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:49.267735 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187d5b8-2333-4b4b-9524-a5ef613384e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:49.268632 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187d5b8-2333-4b4b-9524-a5ef613384e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:49.268931 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187d5b8-2333-4b4b-9524-a5ef613384e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:49.269182 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187d5b8-2333-4b4b-9524-a5ef613384e6 admin admin] PATH_INFO: `/v3/projects/fd7cf38be8ad4803b727c721dd7b9e2b/users/a3b643a6d6a74339a624105001f38e86/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:49.284669 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f187d5b8-2333-4b4b-9524-a5ef613384e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd7cf38be8ad4803b727c721dd7b9e2b, user_id=a3b643a6d6a74339a624105001f38e86, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:49.287306 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f187d5b8-2333-4b4b-9524-a5ef613384e6 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:49.368054 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1354/2705] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:44:49 2022] PUT /identity/v3/projects/fd7cf38be8ad4803b727c721dd7b9e2b/users/a3b643a6d6a74339a624105001f38e86/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:44:49.372866 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa8ba3-04cf-42ae-b345-6220d82b9de9 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:49.382847 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa8ba3-04cf-42ae-b345-6220d82b9de9 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:49.441953 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6b030-d01d-4669-95f8-432d58794069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:49.442630 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6b030-d01d-4669-95f8-432d58794069 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:49.442907 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6b030-d01d-4669-95f8-432d58794069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:49.443182 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6b030-d01d-4669-95f8-432d58794069 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:49.443910 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e6b030-d01d-4669-95f8-432d58794069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:49.445521 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e6b030-d01d-4669-95f8-432d58794069 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:49.455718 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1352/2706] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 09:44:49.459916 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187d5b8-2333-4b4b-9524-a5ef613384e6 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:49.470914 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187d5b8-2333-4b4b-9524-a5ef613384e6 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:49.475550 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ce009-6a46-4411-a65e-9b92b86ea83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:49.480932 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ce009-6a46-4411-a65e-9b92b86ea83b admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:49.480932 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ce009-6a46-4411-a65e-9b92b86ea83b admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:49.480932 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ce009-6a46-4411-a65e-9b92b86ea83b admin admin] PATH_INFO: `/v3/projects/fd7cf38be8ad4803b727c721dd7b9e2b/users/a3b643a6d6a74339a624105001f38e86/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:49.480932 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9ce009-6a46-4411-a65e-9b92b86ea83b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd7cf38be8ad4803b727c721dd7b9e2b, user_id=a3b643a6d6a74339a624105001f38e86, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:49.482730 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9ce009-6a46-4411-a65e-9b92b86ea83b admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:49.493220 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1355/2707] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:44:49 2022] PUT /identity/v3/projects/fd7cf38be8ad4803b727c721dd7b9e2b/users/a3b643a6d6a74339a624105001f38e86/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:44:49.504118 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9321349-cfd3-4f3a-abee-33ecb72ee902 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:49.504447 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9321349-cfd3-4f3a-abee-33ecb72ee902 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:49.504721 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9321349-cfd3-4f3a-abee-33ecb72ee902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:49.532298 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-b9321349-cfd3-4f3a-abee-33ecb72ee902 None None] MFA Rules not processed for user `a3b643a6d6a74339a624105001f38e86`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:44:49.533506 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-b9321349-cfd3-4f3a-abee-33ecb72ee902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:49.601546 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1353/2708] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:44:49 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:44:49.612518 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ce009-6a46-4411-a65e-9b92b86ea83b admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:49.614426 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-4e9ce009-6a46-4411-a65e-9b92b86ea83b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:49.672522 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ce009-6a46-4411-a65e-9b92b86ea83b admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:49.676260 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6c4f1-d226-4a47-9e7a-21efd61a4a93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:49.676904 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6c4f1-d226-4a47-9e7a-21efd61a4a93 service cinder] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:49.677186 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6c4f1-d226-4a47-9e7a-21efd61a4a93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:49.677462 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6c4f1-d226-4a47-9e7a-21efd61a4a93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:49.687264 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f6c4f1-d226-4a47-9e7a-21efd61a4a93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:49.688732 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f6c4f1-d226-4a47-9e7a-21efd61a4a93 service cinder] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:49.698338 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1356/2709] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:44:49 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:44:49.894246 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9321349-cfd3-4f3a-abee-33ecb72ee902 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:49.903973 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9321349-cfd3-4f3a-abee-33ecb72ee902 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:49.907587 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2cf99d-73d6-4bdf-8620-b52c07fa18d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:49.908249 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2cf99d-73d6-4bdf-8620-b52c07fa18d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:49.908534 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2cf99d-73d6-4bdf-8620-b52c07fa18d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:49.908808 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2cf99d-73d6-4bdf-8620-b52c07fa18d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:49.942562 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:49.966949 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2cf99d-73d6-4bdf-8620-b52c07fa18d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:49.968420 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2cf99d-73d6-4bdf-8620-b52c07fa18d8 service cinder] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:49.977688 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1354/2710] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:44:49 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:44:56.094829 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6c4f1-d226-4a47-9e7a-21efd61a4a93 service cinder] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:56.137793 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:56.158176 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6c4f1-d226-4a47-9e7a-21efd61a4a93 service cinder] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:56.162709 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde31ed-054c-47cb-90b9-ab0d331d0ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:56.163567 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde31ed-054c-47cb-90b9-ab0d331d0ba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:56.163847 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde31ed-054c-47cb-90b9-ab0d331d0ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:56.164121 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde31ed-054c-47cb-90b9-ab0d331d0ba5 admin admin] PATH_INFO: `/v3/users/697a6feb6cab4df59107b5bc18e1f20b` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:56.165373 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fde31ed-054c-47cb-90b9-ab0d331d0ba5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=697a6feb6cab4df59107b5bc18e1f20b)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:56.167298 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fde31ed-054c-47cb-90b9-ab0d331d0ba5 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:56.358744 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-7fde31ed-054c-47cb-90b9-ab0d331d0ba5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '697a6feb6cab4df59107b5bc18e1f20b'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:56.365880 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-7fde31ed-054c-47cb-90b9-ab0d331d0ba5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '697a6feb6cab4df59107b5bc18e1f20b'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:56.467500 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-7fde31ed-054c-47cb-90b9-ab0d331d0ba5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '697a6feb6cab4df59107b5bc18e1f20b'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:56.468137 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-7fde31ed-054c-47cb-90b9-ab0d331d0ba5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '697a6feb6cab4df59107b5bc18e1f20b'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:56.480926 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-7fde31ed-054c-47cb-90b9-ab0d331d0ba5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '697a6feb6cab4df59107b5bc18e1f20b'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:56.487557 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1357/2711] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:44:56 2022] DELETE /identity/v3/users/697a6feb6cab4df59107b5bc18e1f20b => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:44:56.492084 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8a6ae-8ff5-4f9a-8a5b-766bb236e545 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:56.492627 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8a6ae-8ff5-4f9a-8a5b-766bb236e545 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:56.492739 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8a6ae-8ff5-4f9a-8a5b-766bb236e545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:56.510180 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-84d8a6ae-8ff5-4f9a-8a5b-766bb236e545 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:44:56.512860 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-84d8a6ae-8ff5-4f9a-8a5b-766bb236e545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:56.569155 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1355/2712] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:44:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:44:56.578899 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde31ed-054c-47cb-90b9-ab0d331d0ba5 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:56.580673 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-7fde31ed-054c-47cb-90b9-ab0d331d0ba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:56.643906 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde31ed-054c-47cb-90b9-ab0d331d0ba5 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:56.647499 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f87f4-99a3-44fb-afcb-b7c2ebc2aa6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:56.648137 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f87f4-99a3-44fb-afcb-b7c2ebc2aa6e service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:56.648452 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f87f4-99a3-44fb-afcb-b7c2ebc2aa6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:56.648752 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f87f4-99a3-44fb-afcb-b7c2ebc2aa6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:56.658386 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f87f4-99a3-44fb-afcb-b7c2ebc2aa6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:56.659803 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f87f4-99a3-44fb-afcb-b7c2ebc2aa6e service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:56.669268 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1358/2713] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:44:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:44:57.063002 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8a6ae-8ff5-4f9a-8a5b-766bb236e545 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:57.064569 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-84d8a6ae-8ff5-4f9a-8a5b-766bb236e545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:57.084558 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8a6ae-8ff5-4f9a-8a5b-766bb236e545 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:57.084558 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4a9dc-7e9a-4d40-a10f-6bcb7cc56ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:57.084558 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4a9dc-7e9a-4d40-a10f-6bcb7cc56ab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:57.084558 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4a9dc-7e9a-4d40-a10f-6bcb7cc56ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:57.084928 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4a9dc-7e9a-4d40-a10f-6bcb7cc56ab0 admin admin] PATH_INFO: `/v3/projects/939fe1ce316d4d5aa4ff6aa6787a9889` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:57.084928 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c4a9dc-7e9a-4d40-a10f-6bcb7cc56ab0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=939fe1ce316d4d5aa4ff6aa6787a9889)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:57.086608 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c4a9dc-7e9a-4d40-a10f-6bcb7cc56ab0 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:57.197480 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-31c4a9dc-7e9a-4d40-a10f-6bcb7cc56ab0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '939fe1ce316d4d5aa4ff6aa6787a9889', 'request_id': 'req-31c4a9dc-7e9a-4d40-a10f-6bcb7cc56ab0'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:57.264837 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-31c4a9dc-7e9a-4d40-a10f-6bcb7cc56ab0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '939fe1ce316d4d5aa4ff6aa6787a9889', 'request_id': 'req-31c4a9dc-7e9a-4d40-a10f-6bcb7cc56ab0'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:57.270870 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-31c4a9dc-7e9a-4d40-a10f-6bcb7cc56ab0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '939fe1ce316d4d5aa4ff6aa6787a9889', 'request_id': 'req-31c4a9dc-7e9a-4d40-a10f-6bcb7cc56ab0'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:57.282998 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-31c4a9dc-7e9a-4d40-a10f-6bcb7cc56ab0 admin admin] The token cache is being invalidate because project 939fe1ce316d4d5aa4ff6aa6787a9889 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:44:57.283283 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-31c4a9dc-7e9a-4d40-a10f-6bcb7cc56ab0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:57.283922 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-31c4a9dc-7e9a-4d40-a10f-6bcb7cc56ab0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:57.285483 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1356/2714] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:44:57 2022] DELETE /identity/v3/projects/939fe1ce316d4d5aa4ff6aa6787a9889 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:44:57.289508 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f87f4-99a3-44fb-afcb-b7c2ebc2aa6e service neutron] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:57.299842 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f87f4-99a3-44fb-afcb-b7c2ebc2aa6e service neutron] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:57.355668 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b4125-1609-46e4-bcac-acac010e94aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:57.356558 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b4125-1609-46e4-bcac-acac010e94aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:57.356844 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b4125-1609-46e4-bcac-acac010e94aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:57.357124 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b4125-1609-46e4-bcac-acac010e94aa admin admin] PATH_INFO: `/v3/users/a3b643a6d6a74339a624105001f38e86` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:57.358859 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b4125-1609-46e4-bcac-acac010e94aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3b643a6d6a74339a624105001f38e86)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:57.360838 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b4125-1609-46e4-bcac-acac010e94aa admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:57.362295 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:57.578444 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-912b4125-1609-46e4-bcac-acac010e94aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3b643a6d6a74339a624105001f38e86'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:57.586202 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-912b4125-1609-46e4-bcac-acac010e94aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3b643a6d6a74339a624105001f38e86'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:57.704311 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-912b4125-1609-46e4-bcac-acac010e94aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3b643a6d6a74339a624105001f38e86'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:57.707761 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-912b4125-1609-46e4-bcac-acac010e94aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3b643a6d6a74339a624105001f38e86'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:57.718363 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-912b4125-1609-46e4-bcac-acac010e94aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3b643a6d6a74339a624105001f38e86'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:57.724644 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1359/2715] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:44:57 2022] DELETE /identity/v3/users/a3b643a6d6a74339a624105001f38e86 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:44:58.160492 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4a9dc-7e9a-4d40-a10f-6bcb7cc56ab0 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:58.161985 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-31c4a9dc-7e9a-4d40-a10f-6bcb7cc56ab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:58.176251 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4a9dc-7e9a-4d40-a10f-6bcb7cc56ab0 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:58.235854 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f8e73-73f6-4e9d-9bcb-a007ff1ed691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:58.236770 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f8e73-73f6-4e9d-9bcb-a007ff1ed691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:58.237067 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f8e73-73f6-4e9d-9bcb-a007ff1ed691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:58.241414 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f8e73-73f6-4e9d-9bcb-a007ff1ed691 admin admin] PATH_INFO: `/v3/projects/fd7cf38be8ad4803b727c721dd7b9e2b` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:58.241414 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9f8e73-73f6-4e9d-9bcb-a007ff1ed691 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd7cf38be8ad4803b727c721dd7b9e2b)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:58.241414 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9f8e73-73f6-4e9d-9bcb-a007ff1ed691 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:58.242031 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:58.354456 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-de9f8e73-73f6-4e9d-9bcb-a007ff1ed691 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd7cf38be8ad4803b727c721dd7b9e2b', 'request_id': 'req-de9f8e73-73f6-4e9d-9bcb-a007ff1ed691'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:58.448456 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-de9f8e73-73f6-4e9d-9bcb-a007ff1ed691 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd7cf38be8ad4803b727c721dd7b9e2b', 'request_id': 'req-de9f8e73-73f6-4e9d-9bcb-a007ff1ed691'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:58.454757 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-de9f8e73-73f6-4e9d-9bcb-a007ff1ed691 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd7cf38be8ad4803b727c721dd7b9e2b', 'request_id': 'req-de9f8e73-73f6-4e9d-9bcb-a007ff1ed691'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:58.465988 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-de9f8e73-73f6-4e9d-9bcb-a007ff1ed691 admin admin] The token cache is being invalidate because project fd7cf38be8ad4803b727c721dd7b9e2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:44:58.466272 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-de9f8e73-73f6-4e9d-9bcb-a007ff1ed691 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:58.466914 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-de9f8e73-73f6-4e9d-9bcb-a007ff1ed691 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:44:58.468505 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1357/2716] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:44:58 2022] DELETE /identity/v3/projects/fd7cf38be8ad4803b727c721dd7b9e2b => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:44:58.473544 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6259e-5255-4cbe-94c4-372cd4f92dee None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:58.474017 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6259e-5255-4cbe-94c4-372cd4f92dee None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:58.474115 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6259e-5255-4cbe-94c4-372cd4f92dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:58.492388 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-4ed6259e-5255-4cbe-94c4-372cd4f92dee None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:44:58.493598 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-4ed6259e-5255-4cbe-94c4-372cd4f92dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:58.555134 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1360/2717] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:44:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:44:58.564169 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e83526-35b2-4509-a4d1-3a590770c901 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:58.564496 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e83526-35b2-4509-a4d1-3a590770c901 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:58.564865 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e83526-35b2-4509-a4d1-3a590770c901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:58.584362 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-83e83526-35b2-4509-a4d1-3a590770c901 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:44:58.585599 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-83e83526-35b2-4509-a4d1-3a590770c901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:58.594271 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1358/2718] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:44:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:44:58.598461 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6259e-5255-4cbe-94c4-372cd4f92dee None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:58.609079 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6259e-5255-4cbe-94c4-372cd4f92dee None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:58.613680 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2425218d-6af2-4716-8488-e6a7fe9ad332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:58.614331 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425218d-6af2-4716-8488-e6a7fe9ad332 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:58.614616 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425218d-6af2-4716-8488-e6a7fe9ad332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:58.614897 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425218d-6af2-4716-8488-e6a7fe9ad332 admin admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:58.615632 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2425218d-6af2-4716-8488-e6a7fe9ad332 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:44:58.615943 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2425218d-6af2-4716-8488-e6a7fe9ad332 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:58.617660 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2425218d-6af2-4716-8488-e6a7fe9ad332 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:58.629395 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1361/2719] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:44:58.633823 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e83526-35b2-4509-a4d1-3a590770c901 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:58.643140 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e83526-35b2-4509-a4d1-3a590770c901 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:58.647902 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c810f-a8a9-4075-94ba-ea9c4af7a5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:58.648576 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c810f-a8a9-4075-94ba-ea9c4af7a5f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:58.648856 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c810f-a8a9-4075-94ba-ea9c4af7a5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:58.649131 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c810f-a8a9-4075-94ba-ea9c4af7a5f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:58.649830 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c810f-a8a9-4075-94ba-ea9c4af7a5f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:58.651732 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c810f-a8a9-4075-94ba-ea9c4af7a5f0 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:58.789013 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1359/2720] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:44:58 2022] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:44:58.793256 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2425218d-6af2-4716-8488-e6a7fe9ad332 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:58.804186 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2425218d-6af2-4716-8488-e6a7fe9ad332 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:58.862696 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc121233-500a-498d-a97c-ce90eaee5071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:58.863438 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc121233-500a-498d-a97c-ce90eaee5071 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:58.863718 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc121233-500a-498d-a97c-ce90eaee5071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:58.863993 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc121233-500a-498d-a97c-ce90eaee5071 admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:58.864725 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc121233-500a-498d-a97c-ce90eaee5071 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:58.866625 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc121233-500a-498d-a97c-ce90eaee5071 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:58.876359 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:59.038775 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1362/2721] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:44:58 2022] POST /identity/v3/users => generated 293 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:44:59.047511 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c810f-a8a9-4075-94ba-ea9c4af7a5f0 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:59.057525 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c810f-a8a9-4075-94ba-ea9c4af7a5f0 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:59.062140 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730dc14-3f54-403a-9766-e8446dd34e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:59.062786 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730dc14-3f54-403a-9766-e8446dd34e96 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:59.063064 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730dc14-3f54-403a-9766-e8446dd34e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:59.063336 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730dc14-3f54-403a-9766-e8446dd34e96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:59.064054 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a730dc14-3f54-403a-9766-e8446dd34e96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:59.065710 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a730dc14-3f54-403a-9766-e8446dd34e96 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:59.077296 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1360/2722] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:44:59.080602 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc121233-500a-498d-a97c-ce90eaee5071 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:59.090411 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc121233-500a-498d-a97c-ce90eaee5071 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:59.095623 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f44fba6-d2cd-4e84-9efb-b64f0fc61dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:59.096305 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44fba6-d2cd-4e84-9efb-b64f0fc61dcb admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:59.096615 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44fba6-d2cd-4e84-9efb-b64f0fc61dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:59.096889 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44fba6-d2cd-4e84-9efb-b64f0fc61dcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:59.097626 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f44fba6-d2cd-4e84-9efb-b64f0fc61dcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:59.099181 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f44fba6-d2cd-4e84-9efb-b64f0fc61dcb admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:59.111083 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1363/2723] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:44:59.115215 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730dc14-3f54-403a-9766-e8446dd34e96 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:59.125658 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730dc14-3f54-403a-9766-e8446dd34e96 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:59.130356 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a46a3-c19a-41c5-8837-718330881637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:59.131226 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a46a3-c19a-41c5-8837-718330881637 admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:59.131508 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a46a3-c19a-41c5-8837-718330881637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:59.131778 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a46a3-c19a-41c5-8837-718330881637 admin admin] PATH_INFO: `/v3/projects/6e89e392c71c4ce4a52b0953362b6a5b/users/81091b4e052b4550b2d8193c58bf3bea/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:59.147344 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314a46a3-c19a-41c5-8837-718330881637 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e89e392c71c4ce4a52b0953362b6a5b, user_id=81091b4e052b4550b2d8193c58bf3bea, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:59.150026 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314a46a3-c19a-41c5-8837-718330881637 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:59.226085 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1361/2724] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:44:59 2022] PUT /identity/v3/projects/6e89e392c71c4ce4a52b0953362b6a5b/users/81091b4e052b4550b2d8193c58bf3bea/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:44:59.238354 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4451d86-dc94-4bdd-8b94-20e5f1484cf3 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:59.238642 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4451d86-dc94-4bdd-8b94-20e5f1484cf3 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:59.238924 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4451d86-dc94-4bdd-8b94-20e5f1484cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:59.270164 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-f4451d86-dc94-4bdd-8b94-20e5f1484cf3 None None] MFA Rules not processed for user `81091b4e052b4550b2d8193c58bf3bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:44:59.271404 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-f4451d86-dc94-4bdd-8b94-20e5f1484cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:44:59.334847 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1364/2725] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:44:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:44:59.342699 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a46a3-c19a-41c5-8837-718330881637 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:59.406590 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a46a3-c19a-41c5-8837-718330881637 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:59.412432 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6de8d-e420-48e8-b8d7-14f423eec760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:59.413101 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6de8d-e420-48e8-b8d7-14f423eec760 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:59.413416 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6de8d-e420-48e8-b8d7-14f423eec760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:59.413692 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6de8d-e420-48e8-b8d7-14f423eec760 admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:59.414379 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df6de8d-e420-48e8-b8d7-14f423eec760 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:59.416566 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df6de8d-e420-48e8-b8d7-14f423eec760 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:59.632255 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1362/2726] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:44:59 2022] POST /identity/v3/projects => generated 383 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:44:59.636141 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4451d86-dc94-4bdd-8b94-20e5f1484cf3 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:59.647011 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4451d86-dc94-4bdd-8b94-20e5f1484cf3 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:59.704598 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa241dc4-f756-4cc1-bd08-ad2d0f355434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:59.705577 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa241dc4-f756-4cc1-bd08-ad2d0f355434 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:59.705991 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa241dc4-f756-4cc1-bd08-ad2d0f355434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:59.706395 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa241dc4-f756-4cc1-bd08-ad2d0f355434 admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:59.707427 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa241dc4-f756-4cc1-bd08-ad2d0f355434 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:59.710293 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa241dc4-f756-4cc1-bd08-ad2d0f355434 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:59.779322 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1365/2727] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:44:59 2022] POST /identity/v3/users => generated 292 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:44:59.783283 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6de8d-e420-48e8-b8d7-14f423eec760 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:59.793552 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6de8d-e420-48e8-b8d7-14f423eec760 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:59.798567 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be1658-3ac1-4eb5-a0d6-68cd5278978e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:59.799210 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be1658-3ac1-4eb5-a0d6-68cd5278978e admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:59.799491 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be1658-3ac1-4eb5-a0d6-68cd5278978e admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:59.799792 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be1658-3ac1-4eb5-a0d6-68cd5278978e admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:59.800584 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be1658-3ac1-4eb5-a0d6-68cd5278978e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:59.802156 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be1658-3ac1-4eb5-a0d6-68cd5278978e admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:59.807401 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:59.813580 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1363/2728] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:44:59.817561 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa241dc4-f756-4cc1-bd08-ad2d0f355434 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:59.827682 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa241dc4-f756-4cc1-bd08-ad2d0f355434 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:59.832406 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d4e8b-2d19-4ec3-b4e2-422513f4ffc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:59.833055 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d4e8b-2d19-4ec3-b4e2-422513f4ffc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:59.833338 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d4e8b-2d19-4ec3-b4e2-422513f4ffc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:59.833617 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d4e8b-2d19-4ec3-b4e2-422513f4ffc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:59.834385 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40d4e8b-2d19-4ec3-b4e2-422513f4ffc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:59.835972 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40d4e8b-2d19-4ec3-b4e2-422513f4ffc1 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:59.846121 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1366/2729] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:44:59.850625 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be1658-3ac1-4eb5-a0d6-68cd5278978e admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:44:59.861939 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be1658-3ac1-4eb5-a0d6-68cd5278978e admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:44:59.866641 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9bddf-a70c-4128-b595-651a7378d460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:44:59.867528 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9bddf-a70c-4128-b595-651a7378d460 admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:44:59.867810 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9bddf-a70c-4128-b595-651a7378d460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:44:59.868083 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9bddf-a70c-4128-b595-651a7378d460 admin admin] PATH_INFO: `/v3/projects/18a9f60a7e27457b90af1ba656170767/users/5d33146c30bc409a98e892fd2c69a315/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:44:59.884221 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac9bddf-a70c-4128-b595-651a7378d460 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18a9f60a7e27457b90af1ba656170767, user_id=5d33146c30bc409a98e892fd2c69a315, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:44:59.886895 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac9bddf-a70c-4128-b595-651a7378d460 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:44:59.993418 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1364/2730] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:44:59 2022] PUT /identity/v3/projects/18a9f60a7e27457b90af1ba656170767/users/5d33146c30bc409a98e892fd2c69a315/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:45:00.004530 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dca5c2-7ab4-4254-a2d6-f3c053d44ac5 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:00.004815 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dca5c2-7ab4-4254-a2d6-f3c053d44ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:00.005090 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dca5c2-7ab4-4254-a2d6-f3c053d44ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:00.033475 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-84dca5c2-7ab4-4254-a2d6-f3c053d44ac5 None None] MFA Rules not processed for user `5d33146c30bc409a98e892fd2c69a315`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:45:00.034697 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-84dca5c2-7ab4-4254-a2d6-f3c053d44ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:00.078159 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:45:00.100745 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1367/2731] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:45:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:45:00.105291 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9bddf-a70c-4128-b595-651a7378d460 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:00.168837 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9bddf-a70c-4128-b595-651a7378d460 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:00.176699 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55caec72-84eb-4636-970f-a7ed10d939c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:00.177368 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55caec72-84eb-4636-970f-a7ed10d939c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:00.177646 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55caec72-84eb-4636-970f-a7ed10d939c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:00.177919 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55caec72-84eb-4636-970f-a7ed10d939c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:00.178632 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55caec72-84eb-4636-970f-a7ed10d939c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:00.180612 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55caec72-84eb-4636-970f-a7ed10d939c8 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:00.255242 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1365/2732] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:45:00 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 09:45:00.259415 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dca5c2-7ab4-4254-a2d6-f3c053d44ac5 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:00.270948 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dca5c2-7ab4-4254-a2d6-f3c053d44ac5 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:00.276528 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55caec72-84eb-4636-970f-a7ed10d939c8 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:00.278214 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-55caec72-84eb-4636-970f-a7ed10d939c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:00.334223 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6af0d6-0e4d-4a7d-8a91-3d17d390d82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:00.334891 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6af0d6-0e4d-4a7d-8a91-3d17d390d82c admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:00.335176 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6af0d6-0e4d-4a7d-8a91-3d17d390d82c admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:00.335572 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6af0d6-0e4d-4a7d-8a91-3d17d390d82c admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:00.336292 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6af0d6-0e4d-4a7d-8a91-3d17d390d82c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:00.338222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6af0d6-0e4d-4a7d-8a91-3d17d390d82c admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:00.343754 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55caec72-84eb-4636-970f-a7ed10d939c8 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:00.348459 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5136c-44d9-4de6-98aa-1eacea835165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:00.349326 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5136c-44d9-4de6-98aa-1eacea835165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:00.349599 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5136c-44d9-4de6-98aa-1eacea835165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:00.349869 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5136c-44d9-4de6-98aa-1eacea835165 admin admin] PATH_INFO: `/v3/users/f79907ce56b94895b32e26795b60a5f7` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:00.351321 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e5136c-44d9-4de6-98aa-1eacea835165 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f79907ce56b94895b32e26795b60a5f7)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:00.353251 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e5136c-44d9-4de6-98aa-1eacea835165 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:00.457236 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1368/2733] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:45:00 2022] POST /identity/v3/users => generated 298 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:45:00.460709 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6af0d6-0e4d-4a7d-8a91-3d17d390d82c admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:00.471233 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6af0d6-0e4d-4a7d-8a91-3d17d390d82c admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:00.476342 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88030434-a8d9-45f0-b06c-b3a5ee07c6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:00.476991 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88030434-a8d9-45f0-b06c-b3a5ee07c6fd admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:00.477274 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88030434-a8d9-45f0-b06c-b3a5ee07c6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:00.477580 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88030434-a8d9-45f0-b06c-b3a5ee07c6fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:00.478299 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88030434-a8d9-45f0-b06c-b3a5ee07c6fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:00.479893 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88030434-a8d9-45f0-b06c-b3a5ee07c6fd admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:00.490008 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1369/2734] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 09:45:00.494276 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88030434-a8d9-45f0-b06c-b3a5ee07c6fd admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:00.504036 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88030434-a8d9-45f0-b06c-b3a5ee07c6fd admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:00.508737 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430edd9-e340-463d-8e62-ba0d59086b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:00.510862 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430edd9-e340-463d-8e62-ba0d59086b08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:00.511143 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430edd9-e340-463d-8e62-ba0d59086b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:00.511415 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430edd9-e340-463d-8e62-ba0d59086b08 admin admin] PATH_INFO: `/v3/projects/bbd6fb262ecd490790fcc765bbb9230c/users/100c67cdbc5b49908e9836a5386d8e72/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:00.526624 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0430edd9-e340-463d-8e62-ba0d59086b08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbd6fb262ecd490790fcc765bbb9230c, user_id=100c67cdbc5b49908e9836a5386d8e72, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:00.529926 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0430edd9-e340-463d-8e62-ba0d59086b08 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:00.555119 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-28e5136c-44d9-4de6-98aa-1eacea835165 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f79907ce56b94895b32e26795b60a5f7'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:00.555795 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-28e5136c-44d9-4de6-98aa-1eacea835165 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f79907ce56b94895b32e26795b60a5f7'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:00.616129 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1370/2735] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:45:00 2022] PUT /identity/v3/projects/bbd6fb262ecd490790fcc765bbb9230c/users/100c67cdbc5b49908e9836a5386d8e72/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:45:00.620034 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430edd9-e340-463d-8e62-ba0d59086b08 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:00.636173 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-28e5136c-44d9-4de6-98aa-1eacea835165 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f79907ce56b94895b32e26795b60a5f7'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:00.636867 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-28e5136c-44d9-4de6-98aa-1eacea835165 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f79907ce56b94895b32e26795b60a5f7'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:00.645086 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-28e5136c-44d9-4de6-98aa-1eacea835165 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f79907ce56b94895b32e26795b60a5f7'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:00.646985 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:45:00.664484 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1366/2736] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:45:00 2022] DELETE /identity/v3/users/f79907ce56b94895b32e26795b60a5f7 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:45:00.669110 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfb3ba-ac77-4a38-b20b-c7ab348fbf41 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:00.671649 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfb3ba-ac77-4a38-b20b-c7ab348fbf41 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:00.671649 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfb3ba-ac77-4a38-b20b-c7ab348fbf41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:00.682270 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430edd9-e340-463d-8e62-ba0d59086b08 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:00.687220 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-9ddfb3ba-ac77-4a38-b20b-c7ab348fbf41 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:45:00.688512 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-9ddfb3ba-ac77-4a38-b20b-c7ab348fbf41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:00.727302 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:45:00.743088 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4216ac3-f29a-4e30-9b1c-b61a6ab0fc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:00.743753 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4216ac3-f29a-4e30-9b1c-b61a6ab0fc56 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:00.744036 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4216ac3-f29a-4e30-9b1c-b61a6ab0fc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:00.744349 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4216ac3-f29a-4e30-9b1c-b61a6ab0fc56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:00.745136 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4216ac3-f29a-4e30-9b1c-b61a6ab0fc56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:00.746669 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4216ac3-f29a-4e30-9b1c-b61a6ab0fc56 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:00.752656 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1367/2737] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:45:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 09:45:00.760121 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1371/2738] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 09:45:00.761404 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddfb3ba-ac77-4a38-b20b-c7ab348fbf41 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:00.762081 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4216ac3-f29a-4e30-9b1c-b61a6ab0fc56 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:00.762778 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-9ddfb3ba-ac77-4a38-b20b-c7ab348fbf41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:00.764555 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-f4216ac3-f29a-4e30-9b1c-b61a6ab0fc56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:00.775416 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddfb3ba-ac77-4a38-b20b-c7ab348fbf41 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:00.780961 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43979ed9-4ac5-4b4c-a6fa-dc0d110b9ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:00.781848 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43979ed9-4ac5-4b4c-a6fa-dc0d110b9ae4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:00.782127 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43979ed9-4ac5-4b4c-a6fa-dc0d110b9ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:00.782397 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43979ed9-4ac5-4b4c-a6fa-dc0d110b9ae4 admin admin] PATH_INFO: `/v3/projects/bbd6fb262ecd490790fcc765bbb9230c/users/100c67cdbc5b49908e9836a5386d8e72/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:00.784439 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43979ed9-4ac5-4b4c-a6fa-dc0d110b9ae4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbd6fb262ecd490790fcc765bbb9230c, user_id=100c67cdbc5b49908e9836a5386d8e72, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:00.787109 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43979ed9-4ac5-4b4c-a6fa-dc0d110b9ae4 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:00.798290 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1368/2739] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:45:00 2022] PUT /identity/v3/projects/bbd6fb262ecd490790fcc765bbb9230c/users/100c67cdbc5b49908e9836a5386d8e72/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:45:00.825613 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4216ac3-f29a-4e30-9b1c-b61a6ab0fc56 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:00.864447 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a1750-c8c0-48bb-9465-2a47590be110 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:00.864745 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a1750-c8c0-48bb-9465-2a47590be110 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:00.865028 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a1750-c8c0-48bb-9465-2a47590be110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:00.881495 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2861ae-215f-4a90-ad80-f58ec90620d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:00.882137 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2861ae-215f-4a90-ad80-f58ec90620d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:00.882413 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2861ae-215f-4a90-ad80-f58ec90620d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:00.882703 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2861ae-215f-4a90-ad80-f58ec90620d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:00.893452 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-2d6a1750-c8c0-48bb-9465-2a47590be110 None None] MFA Rules not processed for user `100c67cdbc5b49908e9836a5386d8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:45:00.895297 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-2d6a1750-c8c0-48bb-9465-2a47590be110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:00.945504 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2861ae-215f-4a90-ad80-f58ec90620d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:00.946981 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2861ae-215f-4a90-ad80-f58ec90620d4 service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:00.961020 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1372/2740] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:45:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 09:45:00.973957 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1369/2741] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:45:00 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 09:45:00.985324 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2861ae-215f-4a90-ad80-f58ec90620d4 service neutron] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:00.986791 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-bd2861ae-215f-4a90-ad80-f58ec90620d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:01.041346 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:45:01.046766 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2861ae-215f-4a90-ad80-f58ec90620d4 service neutron] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:01.050746 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc4b12-924a-4347-a6f4-4ff988f9472b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:01.051152 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc4b12-924a-4347-a6f4-4ff988f9472b service cinder] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:01.051424 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc4b12-924a-4347-a6f4-4ff988f9472b service cinder] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:01.051717 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc4b12-924a-4347-a6f4-4ff988f9472b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:01.053527 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-93dc4b12-924a-4347-a6f4-4ff988f9472b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:01.114182 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc4b12-924a-4347-a6f4-4ff988f9472b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:01.115632 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc4b12-924a-4347-a6f4-4ff988f9472b service cinder] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:01.125631 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1373/2742] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:45:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:45:01.382745 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a1750-c8c0-48bb-9465-2a47590be110 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:01.385402 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-2d6a1750-c8c0-48bb-9465-2a47590be110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:01.398956 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a1750-c8c0-48bb-9465-2a47590be110 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:01.412069 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf79714-eb47-41b7-9589-f62e13d5592b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:01.412981 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf79714-eb47-41b7-9589-f62e13d5592b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:01.414056 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf79714-eb47-41b7-9589-f62e13d5592b admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:01.414056 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf79714-eb47-41b7-9589-f62e13d5592b admin admin] PATH_INFO: `/v3/projects/bb24e5e90c854d6eb9ac1450337c5314` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:01.414850 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf79714-eb47-41b7-9589-f62e13d5592b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb24e5e90c854d6eb9ac1450337c5314)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:01.416828 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf79714-eb47-41b7-9589-f62e13d5592b admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:01.539079 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:45:01.540474 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-adf79714-eb47-41b7-9589-f62e13d5592b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb24e5e90c854d6eb9ac1450337c5314', 'request_id': 'req-adf79714-eb47-41b7-9589-f62e13d5592b'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:01.653197 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-adf79714-eb47-41b7-9589-f62e13d5592b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb24e5e90c854d6eb9ac1450337c5314', 'request_id': 'req-adf79714-eb47-41b7-9589-f62e13d5592b'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:01.659693 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-adf79714-eb47-41b7-9589-f62e13d5592b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb24e5e90c854d6eb9ac1450337c5314', 'request_id': 'req-adf79714-eb47-41b7-9589-f62e13d5592b'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:01.671900 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-adf79714-eb47-41b7-9589-f62e13d5592b admin admin] The token cache is being invalidate because project bb24e5e90c854d6eb9ac1450337c5314 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:45:01.672783 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-adf79714-eb47-41b7-9589-f62e13d5592b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:01.672908 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-adf79714-eb47-41b7-9589-f62e13d5592b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:01.674399 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1370/2743] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:45:01 2022] DELETE /identity/v3/projects/bb24e5e90c854d6eb9ac1450337c5314 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:45:03.124453 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc4b12-924a-4347-a6f4-4ff988f9472b service cinder] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:03.125850 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-93dc4b12-924a-4347-a6f4-4ff988f9472b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:03.136872 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc4b12-924a-4347-a6f4-4ff988f9472b service cinder] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:03.185162 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab47cab-6b85-405d-9b01-2acff6b325e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:03.186345 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab47cab-6b85-405d-9b01-2acff6b325e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:03.186624 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab47cab-6b85-405d-9b01-2acff6b325e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:03.186907 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab47cab-6b85-405d-9b01-2acff6b325e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:03.188742 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-fab47cab-6b85-405d-9b01-2acff6b325e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:03.247097 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab47cab-6b85-405d-9b01-2acff6b325e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:03.249088 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab47cab-6b85-405d-9b01-2acff6b325e0 service cinder] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:03.257956 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1374/2744] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:45:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:45:04.640609 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf79714-eb47-41b7-9589-f62e13d5592b admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:04.642023 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-adf79714-eb47-41b7-9589-f62e13d5592b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:04.653998 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf79714-eb47-41b7-9589-f62e13d5592b admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:04.657629 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5fb05-e98a-4b14-9aa0-a42ff97dacda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:04.658259 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5fb05-e98a-4b14-9aa0-a42ff97dacda service cinder] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:04.658542 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5fb05-e98a-4b14-9aa0-a42ff97dacda service cinder] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:04.658816 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5fb05-e98a-4b14-9aa0-a42ff97dacda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:04.660557 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-4ae5fb05-e98a-4b14-9aa0-a42ff97dacda service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:04.723144 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5fb05-e98a-4b14-9aa0-a42ff97dacda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:04.724616 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5fb05-e98a-4b14-9aa0-a42ff97dacda service cinder] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:04.734375 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1371/2745] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:45:04 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:45:08.120279 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab47cab-6b85-405d-9b01-2acff6b325e0 service cinder] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:08.121672 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-fab47cab-6b85-405d-9b01-2acff6b325e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:08.183282 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab47cab-6b85-405d-9b01-2acff6b325e0 service cinder] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:08.186944 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c9a604-d060-4e8c-8caa-21aa4c4a7441 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:08.187586 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9a604-d060-4e8c-8caa-21aa4c4a7441 service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:08.187870 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9a604-d060-4e8c-8caa-21aa4c4a7441 service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:08.188143 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9a604-d060-4e8c-8caa-21aa4c4a7441 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:08.190745 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-a8c9a604-d060-4e8c-8caa-21aa4c4a7441 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:08.201464 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:45:08.271551 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c9a604-d060-4e8c-8caa-21aa4c4a7441 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:08.273024 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c9a604-d060-4e8c-8caa-21aa4c4a7441 service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:08.283979 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1375/2746] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:45:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:45:09.318461 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5fb05-e98a-4b14-9aa0-a42ff97dacda service cinder] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:09.319892 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-4ae5fb05-e98a-4b14-9aa0-a42ff97dacda service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:09.386592 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5fb05-e98a-4b14-9aa0-a42ff97dacda service cinder] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:09.391312 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a95aa-db3f-43d1-a468-c8e685dd75cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:09.401170 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a95aa-db3f-43d1-a468-c8e685dd75cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:09.401170 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a95aa-db3f-43d1-a468-c8e685dd75cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:09.401170 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a95aa-db3f-43d1-a468-c8e685dd75cc admin admin] PATH_INFO: `/v3/users/81091b4e052b4550b2d8193c58bf3bea` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:09.401170 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a95aa-db3f-43d1-a468-c8e685dd75cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=81091b4e052b4550b2d8193c58bf3bea)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:09.401170 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a95aa-db3f-43d1-a468-c8e685dd75cc admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:09.469408 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c9a604-d060-4e8c-8caa-21aa4c4a7441 service neutron] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:09.478447 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c9a604-d060-4e8c-8caa-21aa4c4a7441 service neutron] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:09.482063 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6277e-41d5-4e85-80b9-94b4acede674 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:09.482700 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6277e-41d5-4e85-80b9-94b4acede674 service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:09.482983 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6277e-41d5-4e85-80b9-94b4acede674 service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:09.483258 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6277e-41d5-4e85-80b9-94b4acede674 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:09.485409 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-90c6277e-41d5-4e85-80b9-94b4acede674 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:09.499382 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c6277e-41d5-4e85-80b9-94b4acede674 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:09.500837 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c6277e-41d5-4e85-80b9-94b4acede674 service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:09.512472 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1376/2747] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:45:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 09:45:09.573675 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-442a95aa-db3f-43d1-a468-c8e685dd75cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81091b4e052b4550b2d8193c58bf3bea'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:09.574614 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-442a95aa-db3f-43d1-a468-c8e685dd75cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81091b4e052b4550b2d8193c58bf3bea'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:09.666840 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-442a95aa-db3f-43d1-a468-c8e685dd75cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81091b4e052b4550b2d8193c58bf3bea'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:09.667406 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-442a95aa-db3f-43d1-a468-c8e685dd75cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81091b4e052b4550b2d8193c58bf3bea'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:09.675744 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-442a95aa-db3f-43d1-a468-c8e685dd75cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81091b4e052b4550b2d8193c58bf3bea'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:09.683025 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:45:09.693904 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1372/2748] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:45:09 2022] DELETE /identity/v3/users/81091b4e052b4550b2d8193c58bf3bea => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:45:09.698709 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076289d3-ffc7-4575-b06e-58ce06b5edc0 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:09.698996 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076289d3-ffc7-4575-b06e-58ce06b5edc0 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:09.699271 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076289d3-ffc7-4575-b06e-58ce06b5edc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:09.717972 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-076289d3-ffc7-4575-b06e-58ce06b5edc0 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:45:09.719219 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-076289d3-ffc7-4575-b06e-58ce06b5edc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:09.781959 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1377/2749] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:45:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:45:09.792238 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a95aa-db3f-43d1-a468-c8e685dd75cc admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:09.793745 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-442a95aa-db3f-43d1-a468-c8e685dd75cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:09.857764 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a95aa-db3f-43d1-a468-c8e685dd75cc admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:09.861715 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12c51e-739f-4ffa-9e71-d5cd64c306b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:09.863063 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12c51e-739f-4ffa-9e71-d5cd64c306b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:09.863367 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12c51e-739f-4ffa-9e71-d5cd64c306b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:09.863640 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12c51e-739f-4ffa-9e71-d5cd64c306b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:09.873440 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f12c51e-739f-4ffa-9e71-d5cd64c306b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:09.874886 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f12c51e-739f-4ffa-9e71-d5cd64c306b5 service neutron] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:09.885242 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1373/2750] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:45:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:45:10.420404 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076289d3-ffc7-4575-b06e-58ce06b5edc0 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:10.428951 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-076289d3-ffc7-4575-b06e-58ce06b5edc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:10.435671 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076289d3-ffc7-4575-b06e-58ce06b5edc0 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:10.443319 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109fa98-770f-497d-9e48-56531f23c5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:10.444223 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109fa98-770f-497d-9e48-56531f23c5da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:10.444533 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109fa98-770f-497d-9e48-56531f23c5da admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:10.444814 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109fa98-770f-497d-9e48-56531f23c5da admin admin] PATH_INFO: `/v3/projects/6e89e392c71c4ce4a52b0953362b6a5b` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:10.446043 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f109fa98-770f-497d-9e48-56531f23c5da admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e89e392c71c4ce4a52b0953362b6a5b)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:10.448438 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f109fa98-770f-497d-9e48-56531f23c5da admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:10.574088 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-f109fa98-770f-497d-9e48-56531f23c5da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e89e392c71c4ce4a52b0953362b6a5b', 'request_id': 'req-f109fa98-770f-497d-9e48-56531f23c5da'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:10.678207 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-f109fa98-770f-497d-9e48-56531f23c5da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e89e392c71c4ce4a52b0953362b6a5b', 'request_id': 'req-f109fa98-770f-497d-9e48-56531f23c5da'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:10.685552 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-f109fa98-770f-497d-9e48-56531f23c5da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e89e392c71c4ce4a52b0953362b6a5b', 'request_id': 'req-f109fa98-770f-497d-9e48-56531f23c5da'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:10.698808 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-f109fa98-770f-497d-9e48-56531f23c5da admin admin] The token cache is being invalidate because project 6e89e392c71c4ce4a52b0953362b6a5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:45:10.699121 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-f109fa98-770f-497d-9e48-56531f23c5da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:10.699808 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-f109fa98-770f-497d-9e48-56531f23c5da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:10.701775 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1378/2751] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:45:10 2022] DELETE /identity/v3/projects/6e89e392c71c4ce4a52b0953362b6a5b => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:45:10.705535 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12c51e-739f-4ffa-9e71-d5cd64c306b5 service neutron] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:10.716158 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12c51e-739f-4ffa-9e71-d5cd64c306b5 service neutron] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:10.789000 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109fa98-770f-497d-9e48-56531f23c5da admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:10.790520 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-f109fa98-770f-497d-9e48-56531f23c5da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:10.805023 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:45:10.820235 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc39b2c-5c3a-438f-a7b6-1eb527e6aacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:10.825427 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc39b2c-5c3a-438f-a7b6-1eb527e6aacb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:10.825427 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc39b2c-5c3a-438f-a7b6-1eb527e6aacb admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:10.825427 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc39b2c-5c3a-438f-a7b6-1eb527e6aacb admin admin] PATH_INFO: `/v3/users/5d33146c30bc409a98e892fd2c69a315` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:10.827080 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc39b2c-5c3a-438f-a7b6-1eb527e6aacb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d33146c30bc409a98e892fd2c69a315)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:10.829404 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc39b2c-5c3a-438f-a7b6-1eb527e6aacb admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:10.898613 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109fa98-770f-497d-9e48-56531f23c5da admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:10.904513 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd3679-cb6e-4a1d-839f-7fb256439d2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:10.905270 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd3679-cb6e-4a1d-839f-7fb256439d2d service nova] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:10.906103 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd3679-cb6e-4a1d-839f-7fb256439d2d service nova] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:10.906103 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd3679-cb6e-4a1d-839f-7fb256439d2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:10.908080 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-b9cd3679-cb6e-4a1d-839f-7fb256439d2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:10.921448 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cd3679-cb6e-4a1d-839f-7fb256439d2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:10.923295 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cd3679-cb6e-4a1d-839f-7fb256439d2d service nova] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:10.936281 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1379/2752] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:45:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 09:45:11.028293 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-6dc39b2c-5c3a-438f-a7b6-1eb527e6aacb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d33146c30bc409a98e892fd2c69a315'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:11.029781 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-6dc39b2c-5c3a-438f-a7b6-1eb527e6aacb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d33146c30bc409a98e892fd2c69a315'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:11.124369 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-6dc39b2c-5c3a-438f-a7b6-1eb527e6aacb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d33146c30bc409a98e892fd2c69a315'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:11.124369 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-6dc39b2c-5c3a-438f-a7b6-1eb527e6aacb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d33146c30bc409a98e892fd2c69a315'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:11.134540 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-6dc39b2c-5c3a-438f-a7b6-1eb527e6aacb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d33146c30bc409a98e892fd2c69a315'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:11.154922 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1374/2753] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:45:10 2022] DELETE /identity/v3/users/5d33146c30bc409a98e892fd2c69a315 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:45:11.560341 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd3679-cb6e-4a1d-839f-7fb256439d2d service nova] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:11.562007 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-b9cd3679-cb6e-4a1d-839f-7fb256439d2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:11.576233 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd3679-cb6e-4a1d-839f-7fb256439d2d service nova] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:11.640517 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e31710-e4eb-445f-a81a-7e9ec736824d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:11.641390 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e31710-e4eb-445f-a81a-7e9ec736824d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:11.641666 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e31710-e4eb-445f-a81a-7e9ec736824d admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:11.641936 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e31710-e4eb-445f-a81a-7e9ec736824d admin admin] PATH_INFO: `/v3/projects/18a9f60a7e27457b90af1ba656170767` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:11.645489 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e31710-e4eb-445f-a81a-7e9ec736824d admin admin] RBAC: Authorizing `identity:delete_project(project_id=18a9f60a7e27457b90af1ba656170767)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:11.647494 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e31710-e4eb-445f-a81a-7e9ec736824d admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:11.762418 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-b6e31710-e4eb-445f-a81a-7e9ec736824d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18a9f60a7e27457b90af1ba656170767', 'request_id': 'req-b6e31710-e4eb-445f-a81a-7e9ec736824d'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:11.859069 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-b6e31710-e4eb-445f-a81a-7e9ec736824d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18a9f60a7e27457b90af1ba656170767', 'request_id': 'req-b6e31710-e4eb-445f-a81a-7e9ec736824d'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:11.865406 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-b6e31710-e4eb-445f-a81a-7e9ec736824d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18a9f60a7e27457b90af1ba656170767', 'request_id': 'req-b6e31710-e4eb-445f-a81a-7e9ec736824d'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:11.876945 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-b6e31710-e4eb-445f-a81a-7e9ec736824d admin admin] The token cache is being invalidate because project 18a9f60a7e27457b90af1ba656170767 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:45:11.877251 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-b6e31710-e4eb-445f-a81a-7e9ec736824d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:11.877921 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-b6e31710-e4eb-445f-a81a-7e9ec736824d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:11.879551 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1380/2754] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:45:11 2022] DELETE /identity/v3/projects/18a9f60a7e27457b90af1ba656170767 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:45:11.883591 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc39b2c-5c3a-438f-a7b6-1eb527e6aacb admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:11.885082 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-6dc39b2c-5c3a-438f-a7b6-1eb527e6aacb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:11.899354 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc39b2c-5c3a-438f-a7b6-1eb527e6aacb admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:11.908051 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:45:11.958099 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120ea3d-59d0-4927-af43-04eb8cf41a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:11.958970 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120ea3d-59d0-4927-af43-04eb8cf41a31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:11.959251 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120ea3d-59d0-4927-af43-04eb8cf41a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:11.959523 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120ea3d-59d0-4927-af43-04eb8cf41a31 admin admin] PATH_INFO: `/v3/users/100c67cdbc5b49908e9836a5386d8e72` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:11.960759 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b120ea3d-59d0-4927-af43-04eb8cf41a31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=100c67cdbc5b49908e9836a5386d8e72)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:11.966138 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b120ea3d-59d0-4927-af43-04eb8cf41a31 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:12.125391 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-b120ea3d-59d0-4927-af43-04eb8cf41a31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '100c67cdbc5b49908e9836a5386d8e72'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:12.126172 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-b120ea3d-59d0-4927-af43-04eb8cf41a31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '100c67cdbc5b49908e9836a5386d8e72'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:12.198062 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-b120ea3d-59d0-4927-af43-04eb8cf41a31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '100c67cdbc5b49908e9836a5386d8e72'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:12.198703 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-b120ea3d-59d0-4927-af43-04eb8cf41a31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '100c67cdbc5b49908e9836a5386d8e72'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:12.206870 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-b120ea3d-59d0-4927-af43-04eb8cf41a31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '100c67cdbc5b49908e9836a5386d8e72'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:12.224678 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1375/2755] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:45:11 2022] DELETE /identity/v3/users/100c67cdbc5b49908e9836a5386d8e72 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:45:12.677779 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e31710-e4eb-445f-a81a-7e9ec736824d admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:12.679350 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-b6e31710-e4eb-445f-a81a-7e9ec736824d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:12.700273 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e31710-e4eb-445f-a81a-7e9ec736824d admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:12.718720 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:45:12.757566 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246f13c-b950-4159-bc80-374e74a6994c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:12.758439 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246f13c-b950-4159-bc80-374e74a6994c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:12.758716 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246f13c-b950-4159-bc80-374e74a6994c admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:12.758988 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246f13c-b950-4159-bc80-374e74a6994c admin admin] PATH_INFO: `/v3/projects/bbd6fb262ecd490790fcc765bbb9230c` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:12.760220 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6246f13c-b950-4159-bc80-374e74a6994c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbd6fb262ecd490790fcc765bbb9230c)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:12.762236 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6246f13c-b950-4159-bc80-374e74a6994c admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:12.901566 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-6246f13c-b950-4159-bc80-374e74a6994c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbd6fb262ecd490790fcc765bbb9230c', 'request_id': 'req-6246f13c-b950-4159-bc80-374e74a6994c'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:13.001450 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-6246f13c-b950-4159-bc80-374e74a6994c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbd6fb262ecd490790fcc765bbb9230c', 'request_id': 'req-6246f13c-b950-4159-bc80-374e74a6994c'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:13.007294 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-6246f13c-b950-4159-bc80-374e74a6994c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbd6fb262ecd490790fcc765bbb9230c', 'request_id': 'req-6246f13c-b950-4159-bc80-374e74a6994c'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:13.018611 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-6246f13c-b950-4159-bc80-374e74a6994c admin admin] The token cache is being invalidate because project bbd6fb262ecd490790fcc765bbb9230c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:45:13.018899 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-6246f13c-b950-4159-bc80-374e74a6994c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:13.020080 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-6246f13c-b950-4159-bc80-374e74a6994c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:13.021656 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1381/2756] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:45:12 2022] DELETE /identity/v3/projects/bbd6fb262ecd490790fcc765bbb9230c => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:45:13.026989 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5d6c2-362d-4e2d-aa8c-cac4f842b15d None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:13.027567 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5d6c2-362d-4e2d-aa8c-cac4f842b15d None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:13.027567 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5d6c2-362d-4e2d-aa8c-cac4f842b15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:13.047697 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-dba5d6c2-362d-4e2d-aa8c-cac4f842b15d None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:45:13.049053 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-dba5d6c2-362d-4e2d-aa8c-cac4f842b15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:13.117090 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1376/2757] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:45:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:45:13.125108 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c169ee9-1316-403c-9415-ef46373a4d73 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:13.125250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c169ee9-1316-403c-9415-ef46373a4d73 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:13.125516 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c169ee9-1316-403c-9415-ef46373a4d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:13.145551 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-6c169ee9-1316-403c-9415-ef46373a4d73 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:45:13.146804 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-6c169ee9-1316-403c-9415-ef46373a4d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:13.155086 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1382/2758] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:45:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:45:13.159373 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5d6c2-362d-4e2d-aa8c-cac4f842b15d None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:13.169592 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5d6c2-362d-4e2d-aa8c-cac4f842b15d None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:13.175497 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f61e2-6918-4adb-9e32-e623ad68dd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:13.176242 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f61e2-6918-4adb-9e32-e623ad68dd94 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:13.176554 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f61e2-6918-4adb-9e32-e623ad68dd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:13.176834 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f61e2-6918-4adb-9e32-e623ad68dd94 admin admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:13.177567 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898f61e2-6918-4adb-9e32-e623ad68dd94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:45:13.177878 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898f61e2-6918-4adb-9e32-e623ad68dd94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:13.179525 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898f61e2-6918-4adb-9e32-e623ad68dd94 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:13.191546 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1377/2759] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:45:13.195937 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c169ee9-1316-403c-9415-ef46373a4d73 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:13.205459 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c169ee9-1316-403c-9415-ef46373a4d73 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:13.211020 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacdae23-4755-4ec9-8d2a-e33c213c356a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:13.211669 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacdae23-4755-4ec9-8d2a-e33c213c356a admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:13.211953 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacdae23-4755-4ec9-8d2a-e33c213c356a admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:13.212250 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacdae23-4755-4ec9-8d2a-e33c213c356a admin admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:13.212937 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacdae23-4755-4ec9-8d2a-e33c213c356a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:13.214926 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacdae23-4755-4ec9-8d2a-e33c213c356a admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:13.333086 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1383/2760] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:45:13 2022] POST /identity/v3/projects => generated 399 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:45:13.334437 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f61e2-6918-4adb-9e32-e623ad68dd94 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:13.344748 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f61e2-6918-4adb-9e32-e623ad68dd94 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:13.358928 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:45:13.411979 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b4121-3426-4589-bd9f-f0bd6dff3a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:13.412695 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b4121-3426-4589-bd9f-f0bd6dff3a27 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:13.412979 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b4121-3426-4589-bd9f-f0bd6dff3a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:13.413256 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b4121-3426-4589-bd9f-f0bd6dff3a27 admin admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:13.413956 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b4121-3426-4589-bd9f-f0bd6dff3a27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:13.415928 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b4121-3426-4589-bd9f-f0bd6dff3a27 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:13.525460 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1378/2761] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:45:13 2022] POST /identity/v3/users => generated 300 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:45:13.526725 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacdae23-4755-4ec9-8d2a-e33c213c356a admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:13.537334 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacdae23-4755-4ec9-8d2a-e33c213c356a admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:13.542124 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97edb6bb-9588-4732-9c21-1555c2fb8199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:13.542797 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97edb6bb-9588-4732-9c21-1555c2fb8199 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:13.543078 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97edb6bb-9588-4732-9c21-1555c2fb8199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:13.543354 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97edb6bb-9588-4732-9c21-1555c2fb8199 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:13.544113 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97edb6bb-9588-4732-9c21-1555c2fb8199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:13.545742 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97edb6bb-9588-4732-9c21-1555c2fb8199 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:13.556608 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1384/2762] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:45:13.560638 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b4121-3426-4589-bd9f-f0bd6dff3a27 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:13.571666 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b4121-3426-4589-bd9f-f0bd6dff3a27 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:13.576866 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea96f7-cb4a-4c94-b08b-d4457eb49ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:13.579491 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea96f7-cb4a-4c94-b08b-d4457eb49ada admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:13.579491 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea96f7-cb4a-4c94-b08b-d4457eb49ada admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:13.579491 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea96f7-cb4a-4c94-b08b-d4457eb49ada admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:13.579491 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea96f7-cb4a-4c94-b08b-d4457eb49ada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:13.580519 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea96f7-cb4a-4c94-b08b-d4457eb49ada admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:13.592009 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1379/2763] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:45:13.595534 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97edb6bb-9588-4732-9c21-1555c2fb8199 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:13.605914 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97edb6bb-9588-4732-9c21-1555c2fb8199 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:13.610537 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12bac1e-6dd6-4e3b-8f2c-7999d2c37eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:13.611412 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bac1e-6dd6-4e3b-8f2c-7999d2c37eb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:13.611687 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bac1e-6dd6-4e3b-8f2c-7999d2c37eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:13.611957 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bac1e-6dd6-4e3b-8f2c-7999d2c37eb6 admin admin] PATH_INFO: `/v3/projects/6321c58fc4a24c5c9fb23eb0bbc0320b/users/5f7e64e8d31b4e6ab26fb858ba446883/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:13.627008 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12bac1e-6dd6-4e3b-8f2c-7999d2c37eb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6321c58fc4a24c5c9fb23eb0bbc0320b, user_id=5f7e64e8d31b4e6ab26fb858ba446883, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:13.630246 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12bac1e-6dd6-4e3b-8f2c-7999d2c37eb6 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:13.735604 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1385/2764] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:45:13 2022] PUT /identity/v3/projects/6321c58fc4a24c5c9fb23eb0bbc0320b/users/5f7e64e8d31b4e6ab26fb858ba446883/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:45:13.747150 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bb130-16ca-45cf-92fc-82044b73453c None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:13.747442 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bb130-16ca-45cf-92fc-82044b73453c None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:13.747719 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bb130-16ca-45cf-92fc-82044b73453c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:13.779238 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-b97bb130-16ca-45cf-92fc-82044b73453c None None] MFA Rules not processed for user `5f7e64e8d31b4e6ab26fb858ba446883`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:45:13.780617 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-b97bb130-16ca-45cf-92fc-82044b73453c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:13.850469 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1380/2765] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:45:13 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:45:13.858907 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12bac1e-6dd6-4e3b-8f2c-7999d2c37eb6 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:13.862262 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-d12bac1e-6dd6-4e3b-8f2c-7999d2c37eb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:13.924267 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:45:13.928775 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12bac1e-6dd6-4e3b-8f2c-7999d2c37eb6 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:13.932531 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca73bb-a85d-4d2a-81b9-06d40f073e13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:13.933174 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca73bb-a85d-4d2a-81b9-06d40f073e13 service cinder] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:13.933454 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca73bb-a85d-4d2a-81b9-06d40f073e13 service cinder] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:13.933728 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca73bb-a85d-4d2a-81b9-06d40f073e13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:13.942722 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ca73bb-a85d-4d2a-81b9-06d40f073e13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:13.944148 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ca73bb-a85d-4d2a-81b9-06d40f073e13 service cinder] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:13.953108 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1386/2766] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:45:13 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:45:16.550077 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97bb130-16ca-45cf-92fc-82044b73453c None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:16.552175 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-b97bb130-16ca-45cf-92fc-82044b73453c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:16.609738 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97bb130-16ca-45cf-92fc-82044b73453c None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:16.613594 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba36b2-0d0b-4262-bb3c-8f811802fdce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:16.614891 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba36b2-0d0b-4262-bb3c-8f811802fdce service neutron] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:16.615174 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba36b2-0d0b-4262-bb3c-8f811802fdce service neutron] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:16.615449 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba36b2-0d0b-4262-bb3c-8f811802fdce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:16.617337 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-e5ba36b2-0d0b-4262-bb3c-8f811802fdce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:16.657863 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:45:16.680640 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba36b2-0d0b-4262-bb3c-8f811802fdce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:16.682085 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba36b2-0d0b-4262-bb3c-8f811802fdce service neutron] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:16.692441 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1381/2767] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:45:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:45:19.789375 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca73bb-a85d-4d2a-81b9-06d40f073e13 service cinder] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:19.804612 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca73bb-a85d-4d2a-81b9-06d40f073e13 service cinder] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:19.810153 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7a977a-f293-4b7d-83d2-075404918a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:19.811181 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a977a-f293-4b7d-83d2-075404918a57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:19.811470 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a977a-f293-4b7d-83d2-075404918a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:19.811747 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a977a-f293-4b7d-83d2-075404918a57 admin admin] PATH_INFO: `/v3/users/5f7e64e8d31b4e6ab26fb858ba446883` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:19.813604 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7a977a-f293-4b7d-83d2-075404918a57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f7e64e8d31b4e6ab26fb858ba446883)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:19.815568 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7a977a-f293-4b7d-83d2-075404918a57 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:20.147051 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-0f7a977a-f293-4b7d-83d2-075404918a57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f7e64e8d31b4e6ab26fb858ba446883'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:20.164309 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-0f7a977a-f293-4b7d-83d2-075404918a57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f7e64e8d31b4e6ab26fb858ba446883'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:20.226889 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-0f7a977a-f293-4b7d-83d2-075404918a57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f7e64e8d31b4e6ab26fb858ba446883'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:20.230101 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-0f7a977a-f293-4b7d-83d2-075404918a57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f7e64e8d31b4e6ab26fb858ba446883'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:20.246668 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-0f7a977a-f293-4b7d-83d2-075404918a57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f7e64e8d31b4e6ab26fb858ba446883'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:20.257017 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1387/2768] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:45:19 2022] DELETE /identity/v3/users/5f7e64e8d31b4e6ab26fb858ba446883 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:45:20.265467 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2a9cd-bfbe-46d6-bb3d-64ad8b71d2b9 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:20.266138 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2a9cd-bfbe-46d6-bb3d-64ad8b71d2b9 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:20.266138 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2a9cd-bfbe-46d6-bb3d-64ad8b71d2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:20.285289 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-17c2a9cd-bfbe-46d6-bb3d-64ad8b71d2b9 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:45:20.286829 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-17c2a9cd-bfbe-46d6-bb3d-64ad8b71d2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:20.355373 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1382/2769] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:45:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:45:20.362037 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7a977a-f293-4b7d-83d2-075404918a57 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:20.363476 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-0f7a977a-f293-4b7d-83d2-075404918a57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:20.427968 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7a977a-f293-4b7d-83d2-075404918a57 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:20.431600 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b6a009-ad87-41cc-aa2f-249f1e6ceb42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:20.432256 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6a009-ad87-41cc-aa2f-249f1e6ceb42 service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:20.432542 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6a009-ad87-41cc-aa2f-249f1e6ceb42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:20.432807 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6a009-ad87-41cc-aa2f-249f1e6ceb42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:20.442005 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b6a009-ad87-41cc-aa2f-249f1e6ceb42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:20.443455 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b6a009-ad87-41cc-aa2f-249f1e6ceb42 service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:20.452842 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1388/2770] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:45:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:45:20.481178 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c2a9cd-bfbe-46d6-bb3d-64ad8b71d2b9 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:20.482840 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-17c2a9cd-bfbe-46d6-bb3d-64ad8b71d2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:20.497534 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c2a9cd-bfbe-46d6-bb3d-64ad8b71d2b9 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:20.502689 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71e5af-e6c3-4da5-975d-1385d07a407a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:20.503570 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71e5af-e6c3-4da5-975d-1385d07a407a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:20.504034 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71e5af-e6c3-4da5-975d-1385d07a407a admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:20.504349 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71e5af-e6c3-4da5-975d-1385d07a407a admin admin] PATH_INFO: `/v3/users/2def17c362a347c2baf8b42ceb0383f8` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:20.505691 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d71e5af-e6c3-4da5-975d-1385d07a407a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2def17c362a347c2baf8b42ceb0383f8)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:20.507714 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d71e5af-e6c3-4da5-975d-1385d07a407a admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:20.696765 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-6d71e5af-e6c3-4da5-975d-1385d07a407a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2def17c362a347c2baf8b42ceb0383f8'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:20.697426 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-6d71e5af-e6c3-4da5-975d-1385d07a407a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2def17c362a347c2baf8b42ceb0383f8'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:20.764431 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-6d71e5af-e6c3-4da5-975d-1385d07a407a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2def17c362a347c2baf8b42ceb0383f8'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:20.765182 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-6d71e5af-e6c3-4da5-975d-1385d07a407a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2def17c362a347c2baf8b42ceb0383f8'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:20.773711 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-6d71e5af-e6c3-4da5-975d-1385d07a407a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2def17c362a347c2baf8b42ceb0383f8'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:20.791544 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1383/2771] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:45:20 2022] DELETE /identity/v3/users/2def17c362a347c2baf8b42ceb0383f8 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:45:20.890268 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b6a009-ad87-41cc-aa2f-249f1e6ceb42 service neutron] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:20.892115 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-36b6a009-ad87-41cc-aa2f-249f1e6ceb42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:20.907437 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b6a009-ad87-41cc-aa2f-249f1e6ceb42 service neutron] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:20.982432 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96327f7a-abeb-4ac4-beb4-23f8b4e4c097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:20.983319 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96327f7a-abeb-4ac4-beb4-23f8b4e4c097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:20.983596 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96327f7a-abeb-4ac4-beb4-23f8b4e4c097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:20.983870 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96327f7a-abeb-4ac4-beb4-23f8b4e4c097 admin admin] PATH_INFO: `/v3/projects/6321c58fc4a24c5c9fb23eb0bbc0320b` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:20.985111 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96327f7a-abeb-4ac4-beb4-23f8b4e4c097 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6321c58fc4a24c5c9fb23eb0bbc0320b)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:20.987017 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96327f7a-abeb-4ac4-beb4-23f8b4e4c097 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:20.996173 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:45:21.033642 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71e5af-e6c3-4da5-975d-1385d07a407a admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:21.035151 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-6d71e5af-e6c3-4da5-975d-1385d07a407a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:21.051507 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71e5af-e6c3-4da5-975d-1385d07a407a admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:21.061148 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44024d3c-0dc7-4ae5-a9c3-e92a649800c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:21.061148 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44024d3c-0dc7-4ae5-a9c3-e92a649800c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:21.061148 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44024d3c-0dc7-4ae5-a9c3-e92a649800c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:21.061148 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44024d3c-0dc7-4ae5-a9c3-e92a649800c7 admin admin] PATH_INFO: `/v3/projects/d877497d5bd94ed493e560ae004522c5` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:21.061979 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44024d3c-0dc7-4ae5-a9c3-e92a649800c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d877497d5bd94ed493e560ae004522c5)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:21.062657 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44024d3c-0dc7-4ae5-a9c3-e92a649800c7 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:21.090451 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-96327f7a-abeb-4ac4-beb4-23f8b4e4c097 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6321c58fc4a24c5c9fb23eb0bbc0320b', 'request_id': 'req-96327f7a-abeb-4ac4-beb4-23f8b4e4c097'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:21.155791 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-96327f7a-abeb-4ac4-beb4-23f8b4e4c097 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6321c58fc4a24c5c9fb23eb0bbc0320b', 'request_id': 'req-96327f7a-abeb-4ac4-beb4-23f8b4e4c097'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:21.162506 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-96327f7a-abeb-4ac4-beb4-23f8b4e4c097 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6321c58fc4a24c5c9fb23eb0bbc0320b', 'request_id': 'req-96327f7a-abeb-4ac4-beb4-23f8b4e4c097'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:21.171425 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:45:21.173763 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-96327f7a-abeb-4ac4-beb4-23f8b4e4c097 admin admin] The token cache is being invalidate because project 6321c58fc4a24c5c9fb23eb0bbc0320b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:45:21.174047 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-96327f7a-abeb-4ac4-beb4-23f8b4e4c097 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:21.174718 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-96327f7a-abeb-4ac4-beb4-23f8b4e4c097 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:21.175367 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-44024d3c-0dc7-4ae5-a9c3-e92a649800c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd877497d5bd94ed493e560ae004522c5', 'request_id': 'req-44024d3c-0dc7-4ae5-a9c3-e92a649800c7'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:21.176286 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1389/2772] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:45:20 2022] DELETE /identity/v3/projects/6321c58fc4a24c5c9fb23eb0bbc0320b => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:45:21.247591 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-44024d3c-0dc7-4ae5-a9c3-e92a649800c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd877497d5bd94ed493e560ae004522c5', 'request_id': 'req-44024d3c-0dc7-4ae5-a9c3-e92a649800c7'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:21.255376 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-44024d3c-0dc7-4ae5-a9c3-e92a649800c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd877497d5bd94ed493e560ae004522c5', 'request_id': 'req-44024d3c-0dc7-4ae5-a9c3-e92a649800c7'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:21.268015 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-44024d3c-0dc7-4ae5-a9c3-e92a649800c7 admin admin] The token cache is being invalidate because project d877497d5bd94ed493e560ae004522c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:45:21.268754 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-44024d3c-0dc7-4ae5-a9c3-e92a649800c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:21.269034 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-44024d3c-0dc7-4ae5-a9c3-e92a649800c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:21.271163 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1384/2773] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:45:21 2022] DELETE /identity/v3/projects/d877497d5bd94ed493e560ae004522c5 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:45:21.276897 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca7269-afe6-4163-b228-6ed44ce3803b None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:21.277191 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca7269-afe6-4163-b228-6ed44ce3803b None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:21.277475 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca7269-afe6-4163-b228-6ed44ce3803b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:21.298253 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-a3ca7269-afe6-4163-b228-6ed44ce3803b None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:45:21.299486 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-a3ca7269-afe6-4163-b228-6ed44ce3803b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:21.366628 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1390/2774] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:45:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:45:21.374890 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e727515-bd2d-48fe-aa21-768a5b190ae7 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:21.375300 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e727515-bd2d-48fe-aa21-768a5b190ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:21.375662 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e727515-bd2d-48fe-aa21-768a5b190ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:21.395604 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-0e727515-bd2d-48fe-aa21-768a5b190ae7 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:45:21.396953 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-0e727515-bd2d-48fe-aa21-768a5b190ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:21.408968 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1385/2775] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:45:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:45:21.413458 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca7269-afe6-4163-b228-6ed44ce3803b None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:21.423797 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca7269-afe6-4163-b228-6ed44ce3803b None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:21.429787 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ddf362-db91-48ce-a1e0-30b0d169aadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:21.430457 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddf362-db91-48ce-a1e0-30b0d169aadd admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:21.430737 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddf362-db91-48ce-a1e0-30b0d169aadd admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:21.431010 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddf362-db91-48ce-a1e0-30b0d169aadd admin admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:21.431747 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ddf362-db91-48ce-a1e0-30b0d169aadd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:45:21.432056 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ddf362-db91-48ce-a1e0-30b0d169aadd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:21.433774 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ddf362-db91-48ce-a1e0-30b0d169aadd admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:21.448376 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1391/2776] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:45:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:45:21.452788 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e727515-bd2d-48fe-aa21-768a5b190ae7 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:21.462805 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e727515-bd2d-48fe-aa21-768a5b190ae7 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:21.467406 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23cae07-fb47-4fd4-8ced-3695a0795e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:21.468053 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23cae07-fb47-4fd4-8ced-3695a0795e19 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:21.468364 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23cae07-fb47-4fd4-8ced-3695a0795e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:21.468639 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23cae07-fb47-4fd4-8ced-3695a0795e19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:21.469324 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23cae07-fb47-4fd4-8ced-3695a0795e19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:21.471284 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23cae07-fb47-4fd4-8ced-3695a0795e19 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:21.581553 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1386/2777] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:45:21 2022] POST /identity/v3/projects => generated 357 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:45:21.584696 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ddf362-db91-48ce-a1e0-30b0d169aadd admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:21.594650 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ddf362-db91-48ce-a1e0-30b0d169aadd admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:21.654596 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c317e-9aea-4b54-ac88-3eea6c0b7416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:21.655177 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c317e-9aea-4b54-ac88-3eea6c0b7416 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:21.655459 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c317e-9aea-4b54-ac88-3eea6c0b7416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:21.655730 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c317e-9aea-4b54-ac88-3eea6c0b7416 admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:21.656526 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c317e-9aea-4b54-ac88-3eea6c0b7416 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:21.658486 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c317e-9aea-4b54-ac88-3eea6c0b7416 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:21.781990 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1392/2778] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:45:21 2022] POST /identity/v3/users => generated 279 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:45:21.787126 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23cae07-fb47-4fd4-8ced-3695a0795e19 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:21.797956 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23cae07-fb47-4fd4-8ced-3695a0795e19 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:21.803136 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae8fa3-c6fe-4dc9-b961-285d3c96eb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:21.803820 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae8fa3-c6fe-4dc9-b961-285d3c96eb0b admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:21.804097 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae8fa3-c6fe-4dc9-b961-285d3c96eb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:21.804404 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae8fa3-c6fe-4dc9-b961-285d3c96eb0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:21.805127 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae8fa3-c6fe-4dc9-b961-285d3c96eb0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:21.806800 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae8fa3-c6fe-4dc9-b961-285d3c96eb0b admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:21.823168 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1387/2779] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:45:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:45:21.827283 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c317e-9aea-4b54-ac88-3eea6c0b7416 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:21.837870 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c317e-9aea-4b54-ac88-3eea6c0b7416 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:21.842902 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78bbe15-ef26-41d7-a8e2-89f4072cc563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:21.843553 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78bbe15-ef26-41d7-a8e2-89f4072cc563 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:21.843838 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78bbe15-ef26-41d7-a8e2-89f4072cc563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:21.844119 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78bbe15-ef26-41d7-a8e2-89f4072cc563 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:21.844878 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78bbe15-ef26-41d7-a8e2-89f4072cc563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:21.846469 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78bbe15-ef26-41d7-a8e2-89f4072cc563 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:21.857324 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1393/2780] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:45:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:45:21.861541 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae8fa3-c6fe-4dc9-b961-285d3c96eb0b admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:21.872486 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae8fa3-c6fe-4dc9-b961-285d3c96eb0b admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:21.877129 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef161f4f-45ed-421b-b202-1cf91b9a7b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:21.878005 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef161f4f-45ed-421b-b202-1cf91b9a7b68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:21.878289 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef161f4f-45ed-421b-b202-1cf91b9a7b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:21.879643 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef161f4f-45ed-421b-b202-1cf91b9a7b68 admin admin] PATH_INFO: `/v3/projects/5a90d960c4a2451e9dcbab5e289af1b7/users/0ffe9409940a4c9fa7b230e3a05aea1d/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:21.893794 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef161f4f-45ed-421b-b202-1cf91b9a7b68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a90d960c4a2451e9dcbab5e289af1b7, user_id=0ffe9409940a4c9fa7b230e3a05aea1d, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:21.897082 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef161f4f-45ed-421b-b202-1cf91b9a7b68 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:22.021216 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1388/2781] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:45:21 2022] PUT /identity/v3/projects/5a90d960c4a2451e9dcbab5e289af1b7/users/0ffe9409940a4c9fa7b230e3a05aea1d/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:45:22.031281 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68e76e-1ea5-4413-ac82-2d2fa497f7b4 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:22.031782 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68e76e-1ea5-4413-ac82-2d2fa497f7b4 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:22.031923 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68e76e-1ea5-4413-ac82-2d2fa497f7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:22.037981 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:45:22.060413 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-5d68e76e-1ea5-4413-ac82-2d2fa497f7b4 None None] MFA Rules not processed for user `0ffe9409940a4c9fa7b230e3a05aea1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:45:22.061671 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-5d68e76e-1ea5-4413-ac82-2d2fa497f7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:22.128142 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1394/2782] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:45:22 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 09:45:22.133467 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef161f4f-45ed-421b-b202-1cf91b9a7b68 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:22.205594 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef161f4f-45ed-421b-b202-1cf91b9a7b68 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:22.210851 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3043352-da7f-498a-bfdd-ab57c6f2a5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:22.211511 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3043352-da7f-498a-bfdd-ab57c6f2a5ba admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:22.211791 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3043352-da7f-498a-bfdd-ab57c6f2a5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:22.212071 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3043352-da7f-498a-bfdd-ab57c6f2a5ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:22.212810 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3043352-da7f-498a-bfdd-ab57c6f2a5ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:22.214716 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3043352-da7f-498a-bfdd-ab57c6f2a5ba admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:22.297029 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1389/2783] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:45:22 2022] POST /identity/v3/projects => generated 355 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:45:22.301162 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d68e76e-1ea5-4413-ac82-2d2fa497f7b4 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:22.312113 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d68e76e-1ea5-4413-ac82-2d2fa497f7b4 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:22.368385 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec271da-5f49-46e2-a1f7-30da124ffd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:22.369051 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec271da-5f49-46e2-a1f7-30da124ffd2b admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:22.369337 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec271da-5f49-46e2-a1f7-30da124ffd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:22.369615 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec271da-5f49-46e2-a1f7-30da124ffd2b admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:22.370308 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec271da-5f49-46e2-a1f7-30da124ffd2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:22.372280 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec271da-5f49-46e2-a1f7-30da124ffd2b admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:22.478912 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1395/2784] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:45:22 2022] POST /identity/v3/users => generated 284 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 09:45:22.483007 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3043352-da7f-498a-bfdd-ab57c6f2a5ba admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:22.494416 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3043352-da7f-498a-bfdd-ab57c6f2a5ba admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:22.499125 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90eebb5-0fd1-42e7-8759-08d18c81e328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:22.499796 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90eebb5-0fd1-42e7-8759-08d18c81e328 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:22.500070 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90eebb5-0fd1-42e7-8759-08d18c81e328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:22.500377 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90eebb5-0fd1-42e7-8759-08d18c81e328 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:22.501111 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90eebb5-0fd1-42e7-8759-08d18c81e328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:22.502715 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90eebb5-0fd1-42e7-8759-08d18c81e328 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:22.513519 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1390/2785] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:45:22.517730 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec271da-5f49-46e2-a1f7-30da124ffd2b admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:22.527893 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec271da-5f49-46e2-a1f7-30da124ffd2b admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:22.532516 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e65a82-e63b-432a-a861-c1ca73b0eeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:22.533383 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e65a82-e63b-432a-a861-c1ca73b0eeb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:22.533663 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e65a82-e63b-432a-a861-c1ca73b0eeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:22.533935 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e65a82-e63b-432a-a861-c1ca73b0eeb2 admin admin] PATH_INFO: `/v3/projects/5c61551477f04689b03aaa51662e62aa/users/f7659432187f4138aa830cc84b8561c1/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:22.550122 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e65a82-e63b-432a-a861-c1ca73b0eeb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c61551477f04689b03aaa51662e62aa, user_id=f7659432187f4138aa830cc84b8561c1, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:22.553382 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e65a82-e63b-432a-a861-c1ca73b0eeb2 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:22.638302 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1396/2786] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:45:22 2022] PUT /identity/v3/projects/5c61551477f04689b03aaa51662e62aa/users/f7659432187f4138aa830cc84b8561c1/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:45:22.642514 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90eebb5-0fd1-42e7-8759-08d18c81e328 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:22.652633 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90eebb5-0fd1-42e7-8759-08d18c81e328 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:22.693894 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:45:22.710351 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea46b5-d887-41d6-b4f4-bec4cb0d0a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:22.711017 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea46b5-d887-41d6-b4f4-bec4cb0d0a94 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:22.711294 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea46b5-d887-41d6-b4f4-bec4cb0d0a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:22.711566 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea46b5-d887-41d6-b4f4-bec4cb0d0a94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:22.712321 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea46b5-d887-41d6-b4f4-bec4cb0d0a94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:22.713910 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea46b5-d887-41d6-b4f4-bec4cb0d0a94 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:22.724649 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1391/2787] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:45:22.729231 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e65a82-e63b-432a-a861-c1ca73b0eeb2 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:22.740089 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e65a82-e63b-432a-a861-c1ca73b0eeb2 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:22.744933 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65829b4e-3287-49fa-aac7-03fcce5763b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:22.745851 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65829b4e-3287-49fa-aac7-03fcce5763b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:22.746130 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65829b4e-3287-49fa-aac7-03fcce5763b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:22.746403 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65829b4e-3287-49fa-aac7-03fcce5763b7 admin admin] PATH_INFO: `/v3/projects/5c61551477f04689b03aaa51662e62aa/users/f7659432187f4138aa830cc84b8561c1/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:22.748422 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65829b4e-3287-49fa-aac7-03fcce5763b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c61551477f04689b03aaa51662e62aa, user_id=f7659432187f4138aa830cc84b8561c1, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:22.751258 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65829b4e-3287-49fa-aac7-03fcce5763b7 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:22.762746 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1397/2788] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:45:22 2022] PUT /identity/v3/projects/5c61551477f04689b03aaa51662e62aa/users/f7659432187f4138aa830cc84b8561c1/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:45:22.774275 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7f88e-a5e5-4ecd-9bf8-63d95d1307d0 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:22.774565 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7f88e-a5e5-4ecd-9bf8-63d95d1307d0 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:22.774846 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7f88e-a5e5-4ecd-9bf8-63d95d1307d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:22.803528 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-52d7f88e-a5e5-4ecd-9bf8-63d95d1307d0 None None] MFA Rules not processed for user `f7659432187f4138aa830cc84b8561c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:45:22.804754 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-52d7f88e-a5e5-4ecd-9bf8-63d95d1307d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:22.873851 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1392/2789] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:45:22 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:45:22.885858 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65829b4e-3287-49fa-aac7-03fcce5763b7 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:22.887610 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-65829b4e-3287-49fa-aac7-03fcce5763b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:22.933529 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:45:22.944780 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65829b4e-3287-49fa-aac7-03fcce5763b7 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:22.948450 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba63ca5-f3c3-4b53-a96b-d2be547e5096 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:22.949185 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba63ca5-f3c3-4b53-a96b-d2be547e5096 service cinder] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:22.949464 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba63ca5-f3c3-4b53-a96b-d2be547e5096 service cinder] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:22.949739 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba63ca5-f3c3-4b53-a96b-d2be547e5096 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:22.959042 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba63ca5-f3c3-4b53-a96b-d2be547e5096 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:22.960500 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba63ca5-f3c3-4b53-a96b-d2be547e5096 service cinder] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:22.969871 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1398/2790] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:45:22 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:45:23.154865 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7f88e-a5e5-4ecd-9bf8-63d95d1307d0 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:23.164470 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7f88e-a5e5-4ecd-9bf8-63d95d1307d0 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:23.168003 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35d9b0-b3f2-434e-8f97-c7d559b37ca2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:23.168708 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35d9b0-b3f2-434e-8f97-c7d559b37ca2 service cinder] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:23.168946 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35d9b0-b3f2-434e-8f97-c7d559b37ca2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:23.169219 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35d9b0-b3f2-434e-8f97-c7d559b37ca2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:23.229784 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df35d9b0-b3f2-434e-8f97-c7d559b37ca2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:23.231230 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df35d9b0-b3f2-434e-8f97-c7d559b37ca2 service cinder] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:23.241815 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1393/2791] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:45:23 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:45:32.992124 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=6 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:45:33.236551 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=72 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:45:41.930984 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba63ca5-f3c3-4b53-a96b-d2be547e5096 service cinder] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:41.993212 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba63ca5-f3c3-4b53-a96b-d2be547e5096 service cinder] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:41.997709 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4612bd49-ea8a-4248-adf3-edbc0d3389ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:41.998566 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612bd49-ea8a-4248-adf3-edbc0d3389ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:41.998842 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612bd49-ea8a-4248-adf3-edbc0d3389ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:41.999112 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612bd49-ea8a-4248-adf3-edbc0d3389ae admin admin] PATH_INFO: `/v3/users/0ffe9409940a4c9fa7b230e3a05aea1d` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:42.000307 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4612bd49-ea8a-4248-adf3-edbc0d3389ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ffe9409940a4c9fa7b230e3a05aea1d)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:42.002197 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4612bd49-ea8a-4248-adf3-edbc0d3389ae admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:42.213062 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-4612bd49-ea8a-4248-adf3-edbc0d3389ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ffe9409940a4c9fa7b230e3a05aea1d'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:42.223154 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-4612bd49-ea8a-4248-adf3-edbc0d3389ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ffe9409940a4c9fa7b230e3a05aea1d'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:42.289332 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-4612bd49-ea8a-4248-adf3-edbc0d3389ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ffe9409940a4c9fa7b230e3a05aea1d'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:42.290134 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-4612bd49-ea8a-4248-adf3-edbc0d3389ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ffe9409940a4c9fa7b230e3a05aea1d'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:42.303652 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-4612bd49-ea8a-4248-adf3-edbc0d3389ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ffe9409940a4c9fa7b230e3a05aea1d'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:42.310041 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1399/2792] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:45:41 2022] DELETE /identity/v3/users/0ffe9409940a4c9fa7b230e3a05aea1d => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:45:42.314788 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d7abe-38aa-482b-a2e6-7106d97cd520 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:42.315296 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d7abe-38aa-482b-a2e6-7106d97cd520 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:42.315404 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d7abe-38aa-482b-a2e6-7106d97cd520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:42.333223 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-356d7abe-38aa-482b-a2e6-7106d97cd520 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:45:42.334992 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-356d7abe-38aa-482b-a2e6-7106d97cd520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:42.396281 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1394/2793] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:45:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:45:42.406688 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4612bd49-ea8a-4248-adf3-edbc0d3389ae admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:42.408171 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-4612bd49-ea8a-4248-adf3-edbc0d3389ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:42.469921 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4612bd49-ea8a-4248-adf3-edbc0d3389ae admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:42.473624 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e2cb3-7229-4941-b91a-5e01861196e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:42.474615 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e2cb3-7229-4941-b91a-5e01861196e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:42.475434 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e2cb3-7229-4941-b91a-5e01861196e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:42.475712 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e2cb3-7229-4941-b91a-5e01861196e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:42.485340 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8e2cb3-7229-4941-b91a-5e01861196e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:42.486768 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8e2cb3-7229-4941-b91a-5e01861196e3 service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:42.496503 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1400/2794] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:45:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:45:42.962934 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d7abe-38aa-482b-a2e6-7106d97cd520 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:42.964390 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-356d7abe-38aa-482b-a2e6-7106d97cd520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:42.976610 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d7abe-38aa-482b-a2e6-7106d97cd520 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:42.981368 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f8332-d3fb-4d32-94dc-0f4128a9b2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:42.982230 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f8332-d3fb-4d32-94dc-0f4128a9b2ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:42.982512 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f8332-d3fb-4d32-94dc-0f4128a9b2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:42.982781 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f8332-d3fb-4d32-94dc-0f4128a9b2ca admin admin] PATH_INFO: `/v3/projects/5a90d960c4a2451e9dcbab5e289af1b7` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:42.984033 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8f8332-d3fb-4d32-94dc-0f4128a9b2ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a90d960c4a2451e9dcbab5e289af1b7)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:42.985965 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8f8332-d3fb-4d32-94dc-0f4128a9b2ca admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:43.106680 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-0b8f8332-d3fb-4d32-94dc-0f4128a9b2ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a90d960c4a2451e9dcbab5e289af1b7', 'request_id': 'req-0b8f8332-d3fb-4d32-94dc-0f4128a9b2ca'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:43.183804 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-0b8f8332-d3fb-4d32-94dc-0f4128a9b2ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a90d960c4a2451e9dcbab5e289af1b7', 'request_id': 'req-0b8f8332-d3fb-4d32-94dc-0f4128a9b2ca'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:43.189988 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-0b8f8332-d3fb-4d32-94dc-0f4128a9b2ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a90d960c4a2451e9dcbab5e289af1b7', 'request_id': 'req-0b8f8332-d3fb-4d32-94dc-0f4128a9b2ca'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:43.202244 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-0b8f8332-d3fb-4d32-94dc-0f4128a9b2ca admin admin] The token cache is being invalidate because project 5a90d960c4a2451e9dcbab5e289af1b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:45:43.202523 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-0b8f8332-d3fb-4d32-94dc-0f4128a9b2ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:43.203201 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-0b8f8332-d3fb-4d32-94dc-0f4128a9b2ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:43.204757 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1395/2795] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:45:42 2022] DELETE /identity/v3/projects/5a90d960c4a2451e9dcbab5e289af1b7 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:45:43.209401 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e2cb3-7229-4941-b91a-5e01861196e3 service neutron] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:43.218996 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e2cb3-7229-4941-b91a-5e01861196e3 service neutron] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:43.237499 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:45:43.276104 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e38b3e-ab47-4a9e-bca5-c11f47260413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:43.276992 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e38b3e-ab47-4a9e-bca5-c11f47260413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:43.277268 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e38b3e-ab47-4a9e-bca5-c11f47260413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:43.277537 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e38b3e-ab47-4a9e-bca5-c11f47260413 admin admin] PATH_INFO: `/v3/users/f7659432187f4138aa830cc84b8561c1` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:43.278704 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e38b3e-ab47-4a9e-bca5-c11f47260413 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7659432187f4138aa830cc84b8561c1)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:43.280673 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e38b3e-ab47-4a9e-bca5-c11f47260413 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:43.440432 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-f8e38b3e-ab47-4a9e-bca5-c11f47260413 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7659432187f4138aa830cc84b8561c1'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:43.447329 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-f8e38b3e-ab47-4a9e-bca5-c11f47260413 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7659432187f4138aa830cc84b8561c1'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:43.528124 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-f8e38b3e-ab47-4a9e-bca5-c11f47260413 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7659432187f4138aa830cc84b8561c1'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:43.528735 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-f8e38b3e-ab47-4a9e-bca5-c11f47260413 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7659432187f4138aa830cc84b8561c1'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:43.542372 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-f8e38b3e-ab47-4a9e-bca5-c11f47260413 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7659432187f4138aa830cc84b8561c1'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:43.548474 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1401/2796] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:45:43 2022] DELETE /identity/v3/users/f7659432187f4138aa830cc84b8561c1 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:45:43.920053 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f8332-d3fb-4d32-94dc-0f4128a9b2ca admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:43.920801 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-0b8f8332-d3fb-4d32-94dc-0f4128a9b2ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:43.934868 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f8332-d3fb-4d32-94dc-0f4128a9b2ca admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:43.999190 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dbeded-9552-44c9-ba0e-1e2c93dd6855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:44.000044 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbeded-9552-44c9-ba0e-1e2c93dd6855 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:44.000360 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbeded-9552-44c9-ba0e-1e2c93dd6855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:44.000637 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbeded-9552-44c9-ba0e-1e2c93dd6855 admin admin] PATH_INFO: `/v3/projects/5c61551477f04689b03aaa51662e62aa` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:44.001807 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dbeded-9552-44c9-ba0e-1e2c93dd6855 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c61551477f04689b03aaa51662e62aa)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:44.003710 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dbeded-9552-44c9-ba0e-1e2c93dd6855 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:44.101947 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:45:44.118794 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-82dbeded-9552-44c9-ba0e-1e2c93dd6855 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c61551477f04689b03aaa51662e62aa', 'request_id': 'req-82dbeded-9552-44c9-ba0e-1e2c93dd6855'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:44.200957 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-82dbeded-9552-44c9-ba0e-1e2c93dd6855 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c61551477f04689b03aaa51662e62aa', 'request_id': 'req-82dbeded-9552-44c9-ba0e-1e2c93dd6855'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:44.207024 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-82dbeded-9552-44c9-ba0e-1e2c93dd6855 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c61551477f04689b03aaa51662e62aa', 'request_id': 'req-82dbeded-9552-44c9-ba0e-1e2c93dd6855'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:44.219486 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-82dbeded-9552-44c9-ba0e-1e2c93dd6855 admin admin] The token cache is being invalidate because project 5c61551477f04689b03aaa51662e62aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:45:44.221357 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-82dbeded-9552-44c9-ba0e-1e2c93dd6855 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:44.221357 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-82dbeded-9552-44c9-ba0e-1e2c93dd6855 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:44.222134 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1396/2797] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:45:43 2022] DELETE /identity/v3/projects/5c61551477f04689b03aaa51662e62aa => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:45:44.228385 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff7fa8-3cd8-4d1a-a9e7-75e3a2784e45 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:44.228897 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff7fa8-3cd8-4d1a-a9e7-75e3a2784e45 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:44.229008 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff7fa8-3cd8-4d1a-a9e7-75e3a2784e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:44.248498 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-98ff7fa8-3cd8-4d1a-a9e7-75e3a2784e45 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:45:44.249992 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-98ff7fa8-3cd8-4d1a-a9e7-75e3a2784e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:44.309752 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1402/2798] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:45:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:45:44.317614 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5af44-a03d-4860-9168-e8ad5cab12ad None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:44.317901 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5af44-a03d-4860-9168-e8ad5cab12ad None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:44.318689 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5af44-a03d-4860-9168-e8ad5cab12ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:44.337458 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-07d5af44-a03d-4860-9168-e8ad5cab12ad None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:45:44.338653 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-07d5af44-a03d-4860-9168-e8ad5cab12ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:44.348273 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1397/2799] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:45:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:45:44.352738 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff7fa8-3cd8-4d1a-a9e7-75e3a2784e45 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:44.362432 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff7fa8-3cd8-4d1a-a9e7-75e3a2784e45 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:44.366992 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7538e281-855e-43eb-a7d3-ddbe1aa9c5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:44.367638 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538e281-855e-43eb-a7d3-ddbe1aa9c5fe admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:44.367927 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538e281-855e-43eb-a7d3-ddbe1aa9c5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:44.368222 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538e281-855e-43eb-a7d3-ddbe1aa9c5fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:44.368955 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7538e281-855e-43eb-a7d3-ddbe1aa9c5fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:45:44.369269 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7538e281-855e-43eb-a7d3-ddbe1aa9c5fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:44.370858 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7538e281-855e-43eb-a7d3-ddbe1aa9c5fe admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:44.382711 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1403/2800] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:45:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:45:44.386940 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d5af44-a03d-4860-9168-e8ad5cab12ad None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:44.396180 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d5af44-a03d-4860-9168-e8ad5cab12ad None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:44.401440 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca229bb-80e0-4131-8464-47a9eba5538c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:44.402096 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca229bb-80e0-4131-8464-47a9eba5538c admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:44.402379 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca229bb-80e0-4131-8464-47a9eba5538c admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:44.402655 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca229bb-80e0-4131-8464-47a9eba5538c admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:44.403342 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca229bb-80e0-4131-8464-47a9eba5538c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:44.405314 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca229bb-80e0-4131-8464-47a9eba5538c admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:44.528925 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1398/2801] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:45:44 2022] POST /identity/v3/projects => generated 379 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:45:44.532827 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7538e281-855e-43eb-a7d3-ddbe1aa9c5fe admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:44.543741 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7538e281-855e-43eb-a7d3-ddbe1aa9c5fe admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:44.570776 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:45:44.601500 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f1523-a6eb-4c0a-8464-d24986912816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:44.602096 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f1523-a6eb-4c0a-8464-d24986912816 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:44.602389 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f1523-a6eb-4c0a-8464-d24986912816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:44.602733 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f1523-a6eb-4c0a-8464-d24986912816 admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:44.603819 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f1523-a6eb-4c0a-8464-d24986912816 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:44.605777 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f1523-a6eb-4c0a-8464-d24986912816 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:44.723116 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1404/2802] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:45:44 2022] POST /identity/v3/users => generated 290 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:45:44.727668 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca229bb-80e0-4131-8464-47a9eba5538c admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:44.738194 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca229bb-80e0-4131-8464-47a9eba5538c admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:44.743413 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653207a-6398-4228-8054-12dcfe37b58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:44.744065 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653207a-6398-4228-8054-12dcfe37b58d admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:44.744477 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653207a-6398-4228-8054-12dcfe37b58d admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:44.744762 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653207a-6398-4228-8054-12dcfe37b58d admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:44.745485 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c653207a-6398-4228-8054-12dcfe37b58d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:44.747075 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c653207a-6398-4228-8054-12dcfe37b58d admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:44.759536 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1399/2803] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:45:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 09:45:44.763709 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f1523-a6eb-4c0a-8464-d24986912816 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:44.773865 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f1523-a6eb-4c0a-8464-d24986912816 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:44.778462 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919ecd2-6feb-4503-a66d-41dd1b233e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:44.779109 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919ecd2-6feb-4503-a66d-41dd1b233e2e admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:44.779391 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919ecd2-6feb-4503-a66d-41dd1b233e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:44.779665 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919ecd2-6feb-4503-a66d-41dd1b233e2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:44.780414 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919ecd2-6feb-4503-a66d-41dd1b233e2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:44.782001 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919ecd2-6feb-4503-a66d-41dd1b233e2e admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:44.791938 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1405/2804] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:45:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:45:44.795945 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653207a-6398-4228-8054-12dcfe37b58d admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:44.806452 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653207a-6398-4228-8054-12dcfe37b58d admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:44.811054 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457891bd-fcdc-4c8c-9137-e4731c9074f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:44.811915 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457891bd-fcdc-4c8c-9137-e4731c9074f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:44.812213 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457891bd-fcdc-4c8c-9137-e4731c9074f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:44.812498 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457891bd-fcdc-4c8c-9137-e4731c9074f4 admin admin] PATH_INFO: `/v3/projects/a1a7f1c49fdc4f47bd86400a3c75b0f0/users/13b2d2314624464ba1f16376c3cd8be3/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:44.949296 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457891bd-fcdc-4c8c-9137-e4731c9074f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1a7f1c49fdc4f47bd86400a3c75b0f0, user_id=13b2d2314624464ba1f16376c3cd8be3, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:44.951836 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457891bd-fcdc-4c8c-9137-e4731c9074f4 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:45.037943 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1400/2805] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:45:44 2022] PUT /identity/v3/projects/a1a7f1c49fdc4f47bd86400a3c75b0f0/users/13b2d2314624464ba1f16376c3cd8be3/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:45:45.049354 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0bc48-7d3b-4470-8c01-cf6dc74c73fb None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:45.049692 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0bc48-7d3b-4470-8c01-cf6dc74c73fb None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:45.049924 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0bc48-7d3b-4470-8c01-cf6dc74c73fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:45.076365 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-06a0bc48-7d3b-4470-8c01-cf6dc74c73fb None None] MFA Rules not processed for user `13b2d2314624464ba1f16376c3cd8be3`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:45:45.077640 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-06a0bc48-7d3b-4470-8c01-cf6dc74c73fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:45.142233 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1406/2806] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:45:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:45:45.146808 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457891bd-fcdc-4c8c-9137-e4731c9074f4 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:45.207863 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457891bd-fcdc-4c8c-9137-e4731c9074f4 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:45.213128 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da6676b-b3b2-445a-a9df-a240bd78b15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:45.213780 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6676b-b3b2-445a-a9df-a240bd78b15e admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:45.214064 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6676b-b3b2-445a-a9df-a240bd78b15e admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:45.214317 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6676b-b3b2-445a-a9df-a240bd78b15e admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:45.215034 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da6676b-b3b2-445a-a9df-a240bd78b15e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:45.216938 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da6676b-b3b2-445a-a9df-a240bd78b15e admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:45.341907 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1401/2807] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:45:45 2022] POST /identity/v3/projects => generated 383 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:45:45.346131 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0bc48-7d3b-4470-8c01-cf6dc74c73fb None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:45.357788 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0bc48-7d3b-4470-8c01-cf6dc74c73fb None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:45.412760 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6baea3-c56a-4429-a3bc-abd42efd3b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:45.413437 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6baea3-c56a-4429-a3bc-abd42efd3b38 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:45.413719 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6baea3-c56a-4429-a3bc-abd42efd3b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:45.413994 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6baea3-c56a-4429-a3bc-abd42efd3b38 admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:45.414696 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6baea3-c56a-4429-a3bc-abd42efd3b38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:45.416642 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6baea3-c56a-4429-a3bc-abd42efd3b38 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:45.500343 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1407/2808] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:45:45 2022] POST /identity/v3/users => generated 298 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 09:45:45.504400 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da6676b-b3b2-445a-a9df-a240bd78b15e admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:45.515176 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da6676b-b3b2-445a-a9df-a240bd78b15e admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:45.519861 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd53dfc-5dfd-4526-91bf-6d4708366b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:45.520587 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd53dfc-5dfd-4526-91bf-6d4708366b2c admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:45.520868 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd53dfc-5dfd-4526-91bf-6d4708366b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:45.521145 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd53dfc-5dfd-4526-91bf-6d4708366b2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:45.522372 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd53dfc-5dfd-4526-91bf-6d4708366b2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:45.523974 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd53dfc-5dfd-4526-91bf-6d4708366b2c admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:45.534538 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1402/2809] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:45:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:45:45.539433 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6baea3-c56a-4429-a3bc-abd42efd3b38 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:45.549568 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6baea3-c56a-4429-a3bc-abd42efd3b38 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:45.554071 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0ddf8-a587-4cb7-beee-d619a9419c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:45.554922 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0ddf8-a587-4cb7-beee-d619a9419c37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:45.555202 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0ddf8-a587-4cb7-beee-d619a9419c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:45.555477 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0ddf8-a587-4cb7-beee-d619a9419c37 admin admin] PATH_INFO: `/v3/projects/60eb0ec9cf8440019990088c845d44a5/users/b9f581eff27a4665a28dd29002f9854f/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:45.570599 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0ddf8-a587-4cb7-beee-d619a9419c37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60eb0ec9cf8440019990088c845d44a5, user_id=b9f581eff27a4665a28dd29002f9854f, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:45.573299 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0ddf8-a587-4cb7-beee-d619a9419c37 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:45.649626 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1408/2810] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:45:45 2022] PUT /identity/v3/projects/60eb0ec9cf8440019990088c845d44a5/users/b9f581eff27a4665a28dd29002f9854f/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:45:45.653780 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd53dfc-5dfd-4526-91bf-6d4708366b2c admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:45.663726 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd53dfc-5dfd-4526-91bf-6d4708366b2c admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:45.683085 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:45:45.719670 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19cbd57-c5b9-4437-9ac3-aca243eefa9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:45.720358 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cbd57-c5b9-4437-9ac3-aca243eefa9c admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:45.720637 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cbd57-c5b9-4437-9ac3-aca243eefa9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:45.720907 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cbd57-c5b9-4437-9ac3-aca243eefa9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:45.721656 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19cbd57-c5b9-4437-9ac3-aca243eefa9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:45.723229 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19cbd57-c5b9-4437-9ac3-aca243eefa9c admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:45.734436 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1403/2811] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:45:45 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:45:45.738640 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0ddf8-a587-4cb7-beee-d619a9419c37 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:45.744255 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:45:45.749694 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0ddf8-a587-4cb7-beee-d619a9419c37 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:45.754505 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfdc0a6-8434-4534-b8e5-1254da3b2fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:45.755384 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfdc0a6-8434-4534-b8e5-1254da3b2fa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:45.756176 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfdc0a6-8434-4534-b8e5-1254da3b2fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:45.756515 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfdc0a6-8434-4534-b8e5-1254da3b2fa1 admin admin] PATH_INFO: `/v3/projects/60eb0ec9cf8440019990088c845d44a5/users/b9f581eff27a4665a28dd29002f9854f/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:45.761777 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfdc0a6-8434-4534-b8e5-1254da3b2fa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60eb0ec9cf8440019990088c845d44a5, user_id=b9f581eff27a4665a28dd29002f9854f, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:45.761777 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfdc0a6-8434-4534-b8e5-1254da3b2fa1 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:45.772473 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1409/2812] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:45:45 2022] PUT /identity/v3/projects/60eb0ec9cf8440019990088c845d44a5/users/b9f581eff27a4665a28dd29002f9854f/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:45:45.785483 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ce9ae-5dd6-45f9-880a-c97740d2cc44 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:45.785768 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ce9ae-5dd6-45f9-880a-c97740d2cc44 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:45.786047 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ce9ae-5dd6-45f9-880a-c97740d2cc44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:45.812061 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-df7ce9ae-5dd6-45f9-880a-c97740d2cc44 None None] MFA Rules not processed for user `b9f581eff27a4665a28dd29002f9854f`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:45:45.814124 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-df7ce9ae-5dd6-45f9-880a-c97740d2cc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:45.882352 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1404/2813] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:45:45 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:45:45.893719 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfdc0a6-8434-4534-b8e5-1254da3b2fa1 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:45.895400 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-5dfdc0a6-8434-4534-b8e5-1254da3b2fa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:45.955716 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfdc0a6-8434-4534-b8e5-1254da3b2fa1 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:45.959477 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe74a91-dfd3-4200-9d8d-c219c8d9b43b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:45.960121 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe74a91-dfd3-4200-9d8d-c219c8d9b43b service cinder] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:45.960435 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe74a91-dfd3-4200-9d8d-c219c8d9b43b service cinder] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:45.960712 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe74a91-dfd3-4200-9d8d-c219c8d9b43b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:45.970155 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe74a91-dfd3-4200-9d8d-c219c8d9b43b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:45.971601 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe74a91-dfd3-4200-9d8d-c219c8d9b43b service cinder] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:45.982107 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1410/2814] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:45:45 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:45:46.165580 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ce9ae-5dd6-45f9-880a-c97740d2cc44 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:46.175595 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ce9ae-5dd6-45f9-880a-c97740d2cc44 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:46.179762 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f08110-8555-439e-8241-8af64d83a1b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:46.180433 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f08110-8555-439e-8241-8af64d83a1b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:46.180731 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f08110-8555-439e-8241-8af64d83a1b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:46.181006 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f08110-8555-439e-8241-8af64d83a1b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:46.238531 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f08110-8555-439e-8241-8af64d83a1b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:46.240573 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f08110-8555-439e-8241-8af64d83a1b1 service cinder] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:46.250227 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1405/2815] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:45:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:45:46.815856 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe74a91-dfd3-4200-9d8d-c219c8d9b43b service cinder] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:46.878201 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe74a91-dfd3-4200-9d8d-c219c8d9b43b service cinder] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:46.882887 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b2cb5-31eb-4e2a-b184-b83c277c4654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:46.883758 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b2cb5-31eb-4e2a-b184-b83c277c4654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:46.884031 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b2cb5-31eb-4e2a-b184-b83c277c4654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:46.884335 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b2cb5-31eb-4e2a-b184-b83c277c4654 admin admin] PATH_INFO: `/v3/users/13b2d2314624464ba1f16376c3cd8be3` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:46.885531 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236b2cb5-31eb-4e2a-b184-b83c277c4654 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13b2d2314624464ba1f16376c3cd8be3)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:46.887452 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236b2cb5-31eb-4e2a-b184-b83c277c4654 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:47.004476 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-236b2cb5-31eb-4e2a-b184-b83c277c4654 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13b2d2314624464ba1f16376c3cd8be3'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:47.011197 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-236b2cb5-31eb-4e2a-b184-b83c277c4654 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13b2d2314624464ba1f16376c3cd8be3'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:47.059770 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-236b2cb5-31eb-4e2a-b184-b83c277c4654 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13b2d2314624464ba1f16376c3cd8be3'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:47.060373 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-236b2cb5-31eb-4e2a-b184-b83c277c4654 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13b2d2314624464ba1f16376c3cd8be3'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:47.072983 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-236b2cb5-31eb-4e2a-b184-b83c277c4654 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13b2d2314624464ba1f16376c3cd8be3'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:47.078952 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1411/2816] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:45:46 2022] DELETE /identity/v3/users/13b2d2314624464ba1f16376c3cd8be3 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:45:47.083675 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734728f-9ebd-4c6c-936a-0760c3dd2a4a None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:47.084622 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734728f-9ebd-4c6c-936a-0760c3dd2a4a None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:47.084894 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734728f-9ebd-4c6c-936a-0760c3dd2a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:47.106605 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-0734728f-9ebd-4c6c-936a-0760c3dd2a4a None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:45:47.106605 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-0734728f-9ebd-4c6c-936a-0760c3dd2a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:47.143179 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:45:47.162157 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1406/2817] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:45:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 09:45:47.172073 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b2cb5-31eb-4e2a-b184-b83c277c4654 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:47.175614 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-236b2cb5-31eb-4e2a-b184-b83c277c4654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:47.187060 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:45:47.231018 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b2cb5-31eb-4e2a-b184-b83c277c4654 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:47.234712 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c593ed-8ffa-46ba-9534-d2b160a8bf65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:47.235351 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c593ed-8ffa-46ba-9534-d2b160a8bf65 service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:47.235640 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c593ed-8ffa-46ba-9534-d2b160a8bf65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:47.235916 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c593ed-8ffa-46ba-9534-d2b160a8bf65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:47.245253 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c593ed-8ffa-46ba-9534-d2b160a8bf65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:47.246691 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c593ed-8ffa-46ba-9534-d2b160a8bf65 service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:47.257485 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1412/2818] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:45:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:45:47.661225 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0734728f-9ebd-4c6c-936a-0760c3dd2a4a None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:47.662772 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-0734728f-9ebd-4c6c-936a-0760c3dd2a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:47.674800 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0734728f-9ebd-4c6c-936a-0760c3dd2a4a None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:47.681446 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94a1b1-66d4-4ac5-8f5c-7ea891b3a9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:47.681446 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94a1b1-66d4-4ac5-8f5c-7ea891b3a9ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:47.681691 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94a1b1-66d4-4ac5-8f5c-7ea891b3a9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:47.681828 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94a1b1-66d4-4ac5-8f5c-7ea891b3a9ac admin admin] PATH_INFO: `/v3/projects/a1a7f1c49fdc4f47bd86400a3c75b0f0` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:47.683090 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94a1b1-66d4-4ac5-8f5c-7ea891b3a9ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1a7f1c49fdc4f47bd86400a3c75b0f0)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:47.685777 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94a1b1-66d4-4ac5-8f5c-7ea891b3a9ac admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:47.833778 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-8d94a1b1-66d4-4ac5-8f5c-7ea891b3a9ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1a7f1c49fdc4f47bd86400a3c75b0f0', 'request_id': 'req-8d94a1b1-66d4-4ac5-8f5c-7ea891b3a9ac'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:47.887982 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-8d94a1b1-66d4-4ac5-8f5c-7ea891b3a9ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1a7f1c49fdc4f47bd86400a3c75b0f0', 'request_id': 'req-8d94a1b1-66d4-4ac5-8f5c-7ea891b3a9ac'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:47.893933 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-8d94a1b1-66d4-4ac5-8f5c-7ea891b3a9ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1a7f1c49fdc4f47bd86400a3c75b0f0', 'request_id': 'req-8d94a1b1-66d4-4ac5-8f5c-7ea891b3a9ac'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:47.905129 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-8d94a1b1-66d4-4ac5-8f5c-7ea891b3a9ac admin admin] The token cache is being invalidate because project a1a7f1c49fdc4f47bd86400a3c75b0f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:45:47.905339 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-8d94a1b1-66d4-4ac5-8f5c-7ea891b3a9ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:47.905972 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-8d94a1b1-66d4-4ac5-8f5c-7ea891b3a9ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:47.907540 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1407/2819] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:45:47 2022] DELETE /identity/v3/projects/a1a7f1c49fdc4f47bd86400a3c75b0f0 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:45:47.911595 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c593ed-8ffa-46ba-9534-d2b160a8bf65 service neutron] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:47.921995 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c593ed-8ffa-46ba-9534-d2b160a8bf65 service neutron] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:47.976918 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8418a322-6957-45b9-b209-78614b318181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:47.977782 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418a322-6957-45b9-b209-78614b318181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:47.978061 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418a322-6957-45b9-b209-78614b318181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:47.978330 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418a322-6957-45b9-b209-78614b318181 admin admin] PATH_INFO: `/v3/users/b9f581eff27a4665a28dd29002f9854f` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:47.979500 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8418a322-6957-45b9-b209-78614b318181 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9f581eff27a4665a28dd29002f9854f)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:47.981442 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8418a322-6957-45b9-b209-78614b318181 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:48.140915 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-8418a322-6957-45b9-b209-78614b318181 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9f581eff27a4665a28dd29002f9854f'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:48.148039 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-8418a322-6957-45b9-b209-78614b318181 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9f581eff27a4665a28dd29002f9854f'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:48.206618 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-8418a322-6957-45b9-b209-78614b318181 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9f581eff27a4665a28dd29002f9854f'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:48.207220 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-8418a322-6957-45b9-b209-78614b318181 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9f581eff27a4665a28dd29002f9854f'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:48.220485 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-8418a322-6957-45b9-b209-78614b318181 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9f581eff27a4665a28dd29002f9854f'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:48.227357 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1413/2820] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:45:47 2022] DELETE /identity/v3/users/b9f581eff27a4665a28dd29002f9854f => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:45:48.718442 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94a1b1-66d4-4ac5-8f5c-7ea891b3a9ac admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:48.722598 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-8d94a1b1-66d4-4ac5-8f5c-7ea891b3a9ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:48.733780 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94a1b1-66d4-4ac5-8f5c-7ea891b3a9ac admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:48.792288 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4834dd-5c86-4924-9e10-aabe684a3477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:48.793106 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4834dd-5c86-4924-9e10-aabe684a3477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:48.793387 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4834dd-5c86-4924-9e10-aabe684a3477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:48.793661 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4834dd-5c86-4924-9e10-aabe684a3477 admin admin] PATH_INFO: `/v3/projects/60eb0ec9cf8440019990088c845d44a5` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:48.794830 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4834dd-5c86-4924-9e10-aabe684a3477 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60eb0ec9cf8440019990088c845d44a5)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:48.796793 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4834dd-5c86-4924-9e10-aabe684a3477 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:48.938171 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-ab4834dd-5c86-4924-9e10-aabe684a3477 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60eb0ec9cf8440019990088c845d44a5', 'request_id': 'req-ab4834dd-5c86-4924-9e10-aabe684a3477'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:49.052975 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-ab4834dd-5c86-4924-9e10-aabe684a3477 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60eb0ec9cf8440019990088c845d44a5', 'request_id': 'req-ab4834dd-5c86-4924-9e10-aabe684a3477'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:49.058986 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-ab4834dd-5c86-4924-9e10-aabe684a3477 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60eb0ec9cf8440019990088c845d44a5', 'request_id': 'req-ab4834dd-5c86-4924-9e10-aabe684a3477'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:49.066070 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:45:49.071075 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-ab4834dd-5c86-4924-9e10-aabe684a3477 admin admin] The token cache is being invalidate because project 60eb0ec9cf8440019990088c845d44a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:45:49.071361 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-ab4834dd-5c86-4924-9e10-aabe684a3477 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:49.071983 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-ab4834dd-5c86-4924-9e10-aabe684a3477 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:49.073549 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1408/2821] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:45:48 2022] DELETE /identity/v3/projects/60eb0ec9cf8440019990088c845d44a5 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:45:49.078563 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc2073-a202-47a9-90bc-96aa52a9a5e9 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:49.079068 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc2073-a202-47a9-90bc-96aa52a9a5e9 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:49.079171 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc2073-a202-47a9-90bc-96aa52a9a5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:49.097112 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-9adc2073-a202-47a9-90bc-96aa52a9a5e9 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:45:49.098313 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-9adc2073-a202-47a9-90bc-96aa52a9a5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:49.128852 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:45:49.158710 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1414/2822] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:45:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 09:45:49.166727 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c4911-d9c1-40cf-a291-573973f340e9 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:49.173075 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c4911-d9c1-40cf-a291-573973f340e9 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:49.173075 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c4911-d9c1-40cf-a291-573973f340e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:49.185613 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-858c4911-d9c1-40cf-a291-573973f340e9 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:45:49.186805 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-858c4911-d9c1-40cf-a291-573973f340e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:49.195488 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1409/2823] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:45:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:45:49.199839 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc2073-a202-47a9-90bc-96aa52a9a5e9 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:49.209713 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc2073-a202-47a9-90bc-96aa52a9a5e9 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:49.215115 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b2f490-5aa3-4df8-b10c-1e25f7c715fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:49.215763 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2f490-5aa3-4df8-b10c-1e25f7c715fa admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:49.216046 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2f490-5aa3-4df8-b10c-1e25f7c715fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:49.216357 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2f490-5aa3-4df8-b10c-1e25f7c715fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:49.217087 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b2f490-5aa3-4df8-b10c-1e25f7c715fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:45:49.217418 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b2f490-5aa3-4df8-b10c-1e25f7c715fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:49.219014 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b2f490-5aa3-4df8-b10c-1e25f7c715fa admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:49.231180 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1415/2824] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:45:49.235396 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c4911-d9c1-40cf-a291-573973f340e9 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:49.245515 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c4911-d9c1-40cf-a291-573973f340e9 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:49.250278 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be909da-9277-4523-b6b2-7909b2a61810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:49.250932 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be909da-9277-4523-b6b2-7909b2a61810 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:49.251212 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be909da-9277-4523-b6b2-7909b2a61810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:49.251487 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be909da-9277-4523-b6b2-7909b2a61810 admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:49.252179 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be909da-9277-4523-b6b2-7909b2a61810 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:49.254162 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be909da-9277-4523-b6b2-7909b2a61810 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:49.345243 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1410/2825] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:45:49 2022] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:45:49.346495 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b2f490-5aa3-4df8-b10c-1e25f7c715fa admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:49.357535 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b2f490-5aa3-4df8-b10c-1e25f7c715fa admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:49.416559 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a5735-7789-4bc5-aad4-b5757487d75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:49.417419 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a5735-7789-4bc5-aad4-b5757487d75a admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:49.417711 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a5735-7789-4bc5-aad4-b5757487d75a admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:49.417988 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a5735-7789-4bc5-aad4-b5757487d75a admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:49.418684 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23a5735-7789-4bc5-aad4-b5757487d75a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:49.420653 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23a5735-7789-4bc5-aad4-b5757487d75a admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:49.539290 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1416/2826] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:45:49 2022] POST /identity/v3/users => generated 288 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:45:49.543484 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be909da-9277-4523-b6b2-7909b2a61810 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:49.554797 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be909da-9277-4523-b6b2-7909b2a61810 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:49.559577 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aceab1-3ad1-48f0-af52-29ba07c612e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:49.560671 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aceab1-3ad1-48f0-af52-29ba07c612e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:49.560671 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aceab1-3ad1-48f0-af52-29ba07c612e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:49.560958 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aceab1-3ad1-48f0-af52-29ba07c612e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:49.561584 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aceab1-3ad1-48f0-af52-29ba07c612e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:49.563172 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aceab1-3ad1-48f0-af52-29ba07c612e7 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:49.573903 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1411/2827] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:45:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:45:49.578072 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a5735-7789-4bc5-aad4-b5757487d75a admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:49.588498 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a5735-7789-4bc5-aad4-b5757487d75a admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:49.593365 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d5e9ac-8c1b-42b7-9c6b-820a4e7f3cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:49.594027 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5e9ac-8c1b-42b7-9c6b-820a4e7f3cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:49.594311 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5e9ac-8c1b-42b7-9c6b-820a4e7f3cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:49.594587 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5e9ac-8c1b-42b7-9c6b-820a4e7f3cd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:49.595368 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d5e9ac-8c1b-42b7-9c6b-820a4e7f3cd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:49.597046 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d5e9ac-8c1b-42b7-9c6b-820a4e7f3cd5 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:49.607873 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1417/2828] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:45:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:45:49.611856 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aceab1-3ad1-48f0-af52-29ba07c612e7 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:49.622442 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aceab1-3ad1-48f0-af52-29ba07c612e7 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:49.626930 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf66df-68c9-43b5-8ad0-e51881b845d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:49.627785 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf66df-68c9-43b5-8ad0-e51881b845d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:49.628064 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf66df-68c9-43b5-8ad0-e51881b845d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:49.628377 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf66df-68c9-43b5-8ad0-e51881b845d3 admin admin] PATH_INFO: `/v3/projects/eb95d0ff26aa4c039e41f6e5334441dc/users/976c192595a04fe7aae4f3ef147da24f/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:49.642304 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf66df-68c9-43b5-8ad0-e51881b845d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb95d0ff26aa4c039e41f6e5334441dc, user_id=976c192595a04fe7aae4f3ef147da24f, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:49.644948 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf66df-68c9-43b5-8ad0-e51881b845d3 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:49.722715 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1412/2829] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:45:49 2022] PUT /identity/v3/projects/eb95d0ff26aa4c039e41f6e5334441dc/users/976c192595a04fe7aae4f3ef147da24f/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:45:49.734958 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41b141-49fc-4451-b86e-027c85a314b1 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:49.735262 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41b141-49fc-4451-b86e-027c85a314b1 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:49.735532 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41b141-49fc-4451-b86e-027c85a314b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:49.762544 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-ff41b141-49fc-4451-b86e-027c85a314b1 None None] MFA Rules not processed for user `976c192595a04fe7aae4f3ef147da24f`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:45:49.763771 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-ff41b141-49fc-4451-b86e-027c85a314b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:49.833376 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1418/2830] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:45:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 09:45:49.838327 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf66df-68c9-43b5-8ad0-e51881b845d3 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:49.899710 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf66df-68c9-43b5-8ad0-e51881b845d3 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:49.904411 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930b52f-97ea-4fc3-8f53-c59063a2bc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:49.909475 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930b52f-97ea-4fc3-8f53-c59063a2bc95 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:49.909475 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930b52f-97ea-4fc3-8f53-c59063a2bc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:49.909475 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930b52f-97ea-4fc3-8f53-c59063a2bc95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:49.909475 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4930b52f-97ea-4fc3-8f53-c59063a2bc95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:49.909475 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4930b52f-97ea-4fc3-8f53-c59063a2bc95 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:50.019668 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1413/2831] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:45:49 2022] POST /identity/v3/projects => generated 373 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:45:50.024232 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff41b141-49fc-4451-b86e-027c85a314b1 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:50.034836 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff41b141-49fc-4451-b86e-027c85a314b1 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:50.060467 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:45:50.092717 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd974f-5b24-4ce6-a1db-417b2fda2da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:50.093704 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd974f-5b24-4ce6-a1db-417b2fda2da3 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:50.094170 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd974f-5b24-4ce6-a1db-417b2fda2da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:50.094441 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd974f-5b24-4ce6-a1db-417b2fda2da3 admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:50.095133 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd974f-5b24-4ce6-a1db-417b2fda2da3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:50.097070 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd974f-5b24-4ce6-a1db-417b2fda2da3 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:50.208656 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1419/2832] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:45:50 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:45:50.213381 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930b52f-97ea-4fc3-8f53-c59063a2bc95 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:50.223662 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930b52f-97ea-4fc3-8f53-c59063a2bc95 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:50.228592 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df74d4-7913-45d4-82fb-1efff686b3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:50.229244 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df74d4-7913-45d4-82fb-1efff686b3a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:50.229563 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df74d4-7913-45d4-82fb-1efff686b3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:50.229842 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df74d4-7913-45d4-82fb-1efff686b3a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:50.230561 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df74d4-7913-45d4-82fb-1efff686b3a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:50.232149 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df74d4-7913-45d4-82fb-1efff686b3a2 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:50.242937 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1414/2833] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:45:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:45:50.246930 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd974f-5b24-4ce6-a1db-417b2fda2da3 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:50.257237 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd974f-5b24-4ce6-a1db-417b2fda2da3 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:50.261727 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe3718-ef9d-460e-b42c-4a80200ba251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:50.262586 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe3718-ef9d-460e-b42c-4a80200ba251 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:50.262862 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe3718-ef9d-460e-b42c-4a80200ba251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:50.263130 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe3718-ef9d-460e-b42c-4a80200ba251 admin admin] PATH_INFO: `/v3/projects/2e90198697ba4ed996012f5a87e88019/users/557b5a31563345179b772fc8bce0f5c4/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:50.279328 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe3718-ef9d-460e-b42c-4a80200ba251 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e90198697ba4ed996012f5a87e88019, user_id=557b5a31563345179b772fc8bce0f5c4, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:50.282033 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe3718-ef9d-460e-b42c-4a80200ba251 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:50.352269 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1420/2834] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:45:50 2022] PUT /identity/v3/projects/2e90198697ba4ed996012f5a87e88019/users/557b5a31563345179b772fc8bce0f5c4/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:45:50.356317 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df74d4-7913-45d4-82fb-1efff686b3a2 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:50.366580 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df74d4-7913-45d4-82fb-1efff686b3a2 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:50.422079 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed1d28-34ab-4d56-8930-2d39b0b044c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:50.422828 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed1d28-34ab-4d56-8930-2d39b0b044c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:50.423057 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed1d28-34ab-4d56-8930-2d39b0b044c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:50.423337 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed1d28-34ab-4d56-8930-2d39b0b044c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:50.424069 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed1d28-34ab-4d56-8930-2d39b0b044c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:50.425701 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed1d28-34ab-4d56-8930-2d39b0b044c0 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:50.436189 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1415/2835] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:45:50 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:45:50.440552 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe3718-ef9d-460e-b42c-4a80200ba251 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:50.451254 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe3718-ef9d-460e-b42c-4a80200ba251 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:50.455807 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0287c7-3ae2-4b3f-bc32-d16247f92593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:50.456711 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0287c7-3ae2-4b3f-bc32-d16247f92593 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:50.456994 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0287c7-3ae2-4b3f-bc32-d16247f92593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:50.457265 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0287c7-3ae2-4b3f-bc32-d16247f92593 admin admin] PATH_INFO: `/v3/projects/2e90198697ba4ed996012f5a87e88019/users/557b5a31563345179b772fc8bce0f5c4/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:50.459315 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0287c7-3ae2-4b3f-bc32-d16247f92593 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e90198697ba4ed996012f5a87e88019, user_id=557b5a31563345179b772fc8bce0f5c4, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:50.461956 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0287c7-3ae2-4b3f-bc32-d16247f92593 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:50.472149 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1421/2836] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:45:50 2022] PUT /identity/v3/projects/2e90198697ba4ed996012f5a87e88019/users/557b5a31563345179b772fc8bce0f5c4/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:45:50.482529 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb491e-6c76-417d-a284-de153a86212e None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:50.482814 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb491e-6c76-417d-a284-de153a86212e None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:50.483093 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb491e-6c76-417d-a284-de153a86212e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:50.489861 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:45:50.509995 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-a7cb491e-6c76-417d-a284-de153a86212e None None] MFA Rules not processed for user `557b5a31563345179b772fc8bce0f5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:45:50.511203 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-a7cb491e-6c76-417d-a284-de153a86212e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:50.578534 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1416/2837] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:45:50 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:45:50.589989 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0287c7-3ae2-4b3f-bc32-d16247f92593 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:50.591674 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-ba0287c7-3ae2-4b3f-bc32-d16247f92593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:50.648826 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0287c7-3ae2-4b3f-bc32-d16247f92593 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:50.652508 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3c019-1ba2-4de5-9bd2-0f7e66082b1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:50.653146 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3c019-1ba2-4de5-9bd2-0f7e66082b1b service cinder] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:50.653441 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3c019-1ba2-4de5-9bd2-0f7e66082b1b service cinder] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:50.653696 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3c019-1ba2-4de5-9bd2-0f7e66082b1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:50.709554 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec3c019-1ba2-4de5-9bd2-0f7e66082b1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:50.710905 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec3c019-1ba2-4de5-9bd2-0f7e66082b1b service cinder] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:50.719859 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1422/2838] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:45:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:45:53.705350 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb491e-6c76-417d-a284-de153a86212e None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:53.767804 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb491e-6c76-417d-a284-de153a86212e None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:53.772791 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207486d1-3a64-4875-91f5-9d258802bcf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:53.773652 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207486d1-3a64-4875-91f5-9d258802bcf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:53.773926 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207486d1-3a64-4875-91f5-9d258802bcf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:53.774193 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207486d1-3a64-4875-91f5-9d258802bcf1 admin admin] PATH_INFO: `/v3/users/976c192595a04fe7aae4f3ef147da24f` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:53.775366 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207486d1-3a64-4875-91f5-9d258802bcf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=976c192595a04fe7aae4f3ef147da24f)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:53.777342 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207486d1-3a64-4875-91f5-9d258802bcf1 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:53.913058 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-207486d1-3a64-4875-91f5-9d258802bcf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '976c192595a04fe7aae4f3ef147da24f'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:53.913663 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-207486d1-3a64-4875-91f5-9d258802bcf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '976c192595a04fe7aae4f3ef147da24f'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:53.979439 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-207486d1-3a64-4875-91f5-9d258802bcf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '976c192595a04fe7aae4f3ef147da24f'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:53.980060 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-207486d1-3a64-4875-91f5-9d258802bcf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '976c192595a04fe7aae4f3ef147da24f'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:53.987335 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-207486d1-3a64-4875-91f5-9d258802bcf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '976c192595a04fe7aae4f3ef147da24f'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:54.004619 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1417/2839] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:45:53 2022] DELETE /identity/v3/users/976c192595a04fe7aae4f3ef147da24f => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:45:54.009762 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa8fc8-5bc6-4c72-98f3-35f4c316a25a None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:54.010274 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa8fc8-5bc6-4c72-98f3-35f4c316a25a None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:54.010378 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa8fc8-5bc6-4c72-98f3-35f4c316a25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:54.028007 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-49fa8fc8-5bc6-4c72-98f3-35f4c316a25a None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:45:54.029256 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-49fa8fc8-5bc6-4c72-98f3-35f4c316a25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:54.058860 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:45:54.088609 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1423/2840] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:45:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:45:54.098400 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207486d1-3a64-4875-91f5-9d258802bcf1 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:54.100090 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-207486d1-3a64-4875-91f5-9d258802bcf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:54.113006 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:45:54.161497 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207486d1-3a64-4875-91f5-9d258802bcf1 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:54.165200 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55465de-1687-478d-a36f-bed55035b984 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:54.165788 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55465de-1687-478d-a36f-bed55035b984 service neutron] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:54.166069 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55465de-1687-478d-a36f-bed55035b984 service neutron] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:54.166346 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55465de-1687-478d-a36f-bed55035b984 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:54.175193 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55465de-1687-478d-a36f-bed55035b984 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:54.176646 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55465de-1687-478d-a36f-bed55035b984 service neutron] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:54.186802 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1418/2841] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:45:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:45:54.564137 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa8fc8-5bc6-4c72-98f3-35f4c316a25a None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:54.565645 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-49fa8fc8-5bc6-4c72-98f3-35f4c316a25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:54.580330 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa8fc8-5bc6-4c72-98f3-35f4c316a25a None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:54.585869 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e599713b-e8e1-49fb-8ff0-585702383b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:54.591746 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599713b-e8e1-49fb-8ff0-585702383b2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:54.591746 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599713b-e8e1-49fb-8ff0-585702383b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:54.591746 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599713b-e8e1-49fb-8ff0-585702383b2d admin admin] PATH_INFO: `/v3/projects/eb95d0ff26aa4c039e41f6e5334441dc` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:54.591746 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e599713b-e8e1-49fb-8ff0-585702383b2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb95d0ff26aa4c039e41f6e5334441dc)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:54.591746 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e599713b-e8e1-49fb-8ff0-585702383b2d admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:54.670716 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-e599713b-e8e1-49fb-8ff0-585702383b2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb95d0ff26aa4c039e41f6e5334441dc', 'request_id': 'req-e599713b-e8e1-49fb-8ff0-585702383b2d'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:54.716682 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-e599713b-e8e1-49fb-8ff0-585702383b2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb95d0ff26aa4c039e41f6e5334441dc', 'request_id': 'req-e599713b-e8e1-49fb-8ff0-585702383b2d'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:54.722454 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-e599713b-e8e1-49fb-8ff0-585702383b2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb95d0ff26aa4c039e41f6e5334441dc', 'request_id': 'req-e599713b-e8e1-49fb-8ff0-585702383b2d'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:54.734364 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-e599713b-e8e1-49fb-8ff0-585702383b2d admin admin] The token cache is being invalidate because project eb95d0ff26aa4c039e41f6e5334441dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:45:54.734654 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-e599713b-e8e1-49fb-8ff0-585702383b2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:54.735367 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-e599713b-e8e1-49fb-8ff0-585702383b2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:54.737437 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1424/2842] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:45:54 2022] DELETE /identity/v3/projects/eb95d0ff26aa4c039e41f6e5334441dc => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:45:54.741794 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55465de-1687-478d-a36f-bed55035b984 service neutron] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:54.751836 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55465de-1687-478d-a36f-bed55035b984 service neutron] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:54.828755 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eef5ae-3c7f-4c62-bf12-531aa59f1ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:54.829639 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eef5ae-3c7f-4c62-bf12-531aa59f1ea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:54.829921 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eef5ae-3c7f-4c62-bf12-531aa59f1ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:54.830196 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eef5ae-3c7f-4c62-bf12-531aa59f1ea5 admin admin] PATH_INFO: `/v3/users/557b5a31563345179b772fc8bce0f5c4` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:54.831818 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eef5ae-3c7f-4c62-bf12-531aa59f1ea5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=557b5a31563345179b772fc8bce0f5c4)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:54.835547 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eef5ae-3c7f-4c62-bf12-531aa59f1ea5 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:55.023287 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-35eef5ae-3c7f-4c62-bf12-531aa59f1ea5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '557b5a31563345179b772fc8bce0f5c4'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:55.023929 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-35eef5ae-3c7f-4c62-bf12-531aa59f1ea5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '557b5a31563345179b772fc8bce0f5c4'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:55.092333 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-35eef5ae-3c7f-4c62-bf12-531aa59f1ea5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '557b5a31563345179b772fc8bce0f5c4'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:55.092979 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-35eef5ae-3c7f-4c62-bf12-531aa59f1ea5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '557b5a31563345179b772fc8bce0f5c4'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:55.100771 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-35eef5ae-3c7f-4c62-bf12-531aa59f1ea5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '557b5a31563345179b772fc8bce0f5c4'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:55.121480 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1419/2843] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:45:54 2022] DELETE /identity/v3/users/557b5a31563345179b772fc8bce0f5c4 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:45:55.546599 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e599713b-e8e1-49fb-8ff0-585702383b2d admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:55.554176 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-e599713b-e8e1-49fb-8ff0-585702383b2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:55.563492 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e599713b-e8e1-49fb-8ff0-585702383b2d admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:55.636564 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1fc645-1fd3-4d85-be73-99dec080c07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:55.637359 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1fc645-1fd3-4d85-be73-99dec080c07b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:55.637644 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1fc645-1fd3-4d85-be73-99dec080c07b admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:55.637919 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1fc645-1fd3-4d85-be73-99dec080c07b admin admin] PATH_INFO: `/v3/projects/2e90198697ba4ed996012f5a87e88019` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:55.639102 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1fc645-1fd3-4d85-be73-99dec080c07b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e90198697ba4ed996012f5a87e88019)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:55.641084 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1fc645-1fd3-4d85-be73-99dec080c07b admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:55.752700 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-5d1fc645-1fd3-4d85-be73-99dec080c07b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e90198697ba4ed996012f5a87e88019', 'request_id': 'req-5d1fc645-1fd3-4d85-be73-99dec080c07b'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:55.831381 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-5d1fc645-1fd3-4d85-be73-99dec080c07b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e90198697ba4ed996012f5a87e88019', 'request_id': 'req-5d1fc645-1fd3-4d85-be73-99dec080c07b'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:55.836325 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:45:55.838508 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-5d1fc645-1fd3-4d85-be73-99dec080c07b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e90198697ba4ed996012f5a87e88019', 'request_id': 'req-5d1fc645-1fd3-4d85-be73-99dec080c07b'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:55.849738 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-5d1fc645-1fd3-4d85-be73-99dec080c07b admin admin] The token cache is being invalidate because project 2e90198697ba4ed996012f5a87e88019 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:45:55.850660 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-5d1fc645-1fd3-4d85-be73-99dec080c07b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:55.851278 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-5d1fc645-1fd3-4d85-be73-99dec080c07b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:45:55.852869 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1425/2844] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:45:55 2022] DELETE /identity/v3/projects/2e90198697ba4ed996012f5a87e88019 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:45:55.858269 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037ea8b-a85e-4a77-ae4c-9ac79f871de1 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:55.858760 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037ea8b-a85e-4a77-ae4c-9ac79f871de1 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:55.858872 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037ea8b-a85e-4a77-ae4c-9ac79f871de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:55.876789 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-3037ea8b-a85e-4a77-ae4c-9ac79f871de1 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:45:55.877995 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-3037ea8b-a85e-4a77-ae4c-9ac79f871de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:55.903993 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:45:55.936975 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1420/2845] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:45:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:45:55.944693 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9c881-755d-4256-b4de-d69c14942e59 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:55.944983 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9c881-755d-4256-b4de-d69c14942e59 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:55.945262 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9c881-755d-4256-b4de-d69c14942e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:55.964164 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-79f9c881-755d-4256-b4de-d69c14942e59 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:45:55.965533 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-79f9c881-755d-4256-b4de-d69c14942e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:55.974352 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1426/2846] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:45:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:45:55.979768 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037ea8b-a85e-4a77-ae4c-9ac79f871de1 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:55.989492 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037ea8b-a85e-4a77-ae4c-9ac79f871de1 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:55.994291 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6f2c3-f8d5-4626-a3ba-9378bc09dd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:55.994940 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6f2c3-f8d5-4626-a3ba-9378bc09dd16 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:55.995274 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6f2c3-f8d5-4626-a3ba-9378bc09dd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:55.995544 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6f2c3-f8d5-4626-a3ba-9378bc09dd16 admin admin] PATH_INFO: `/v3/domains` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:55.996292 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de6f2c3-f8d5-4626-a3ba-9378bc09dd16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:45:55.996594 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de6f2c3-f8d5-4626-a3ba-9378bc09dd16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:55.998211 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de6f2c3-f8d5-4626-a3ba-9378bc09dd16 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:56.010252 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1421/2847] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:45:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 09:45:56.016394 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f9c881-755d-4256-b4de-d69c14942e59 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:56.026221 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f9c881-755d-4256-b4de-d69c14942e59 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:56.031509 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a4162-e2a6-437e-bc75-b8f4f754ba20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:56.032180 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a4162-e2a6-437e-bc75-b8f4f754ba20 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:56.032510 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a4162-e2a6-437e-bc75-b8f4f754ba20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:56.032789 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a4162-e2a6-437e-bc75-b8f4f754ba20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:56.033492 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63a4162-e2a6-437e-bc75-b8f4f754ba20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:56.035422 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63a4162-e2a6-437e-bc75-b8f4f754ba20 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:56.118797 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1427/2848] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:45:56 2022] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:45:56.123027 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6f2c3-f8d5-4626-a3ba-9378bc09dd16 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:56.133910 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6f2c3-f8d5-4626-a3ba-9378bc09dd16 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:56.190460 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7cf01-4cd6-44fb-a01c-f96294e614c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:56.191136 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7cf01-4cd6-44fb-a01c-f96294e614c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:56.191420 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7cf01-4cd6-44fb-a01c-f96294e614c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:56.191694 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7cf01-4cd6-44fb-a01c-f96294e614c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:56.194632 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef7cf01-4cd6-44fb-a01c-f96294e614c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:56.196720 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef7cf01-4cd6-44fb-a01c-f96294e614c3 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:56.322116 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1422/2849] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:45:56 2022] POST /identity/v3/users => generated 288 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:45:56.326488 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a4162-e2a6-437e-bc75-b8f4f754ba20 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:56.337674 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a4162-e2a6-437e-bc75-b8f4f754ba20 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:56.342367 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85becb2-63aa-454f-b850-fab8732ef10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:56.343016 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85becb2-63aa-454f-b850-fab8732ef10e admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:56.343296 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85becb2-63aa-454f-b850-fab8732ef10e admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:56.343570 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85becb2-63aa-454f-b850-fab8732ef10e admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:56.344329 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85becb2-63aa-454f-b850-fab8732ef10e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:56.345926 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85becb2-63aa-454f-b850-fab8732ef10e admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:56.356851 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1428/2850] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:45:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:45:56.361183 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7cf01-4cd6-44fb-a01c-f96294e614c3 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:56.374532 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7cf01-4cd6-44fb-a01c-f96294e614c3 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:56.379508 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056bbb57-bd76-423d-9eeb-547410829e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:56.380157 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bbb57-bd76-423d-9eeb-547410829e73 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:56.380467 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bbb57-bd76-423d-9eeb-547410829e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:56.380765 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bbb57-bd76-423d-9eeb-547410829e73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:56.381988 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056bbb57-bd76-423d-9eeb-547410829e73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:56.383564 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056bbb57-bd76-423d-9eeb-547410829e73 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:56.393750 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1423/2851] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:45:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:45:56.400008 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85becb2-63aa-454f-b850-fab8732ef10e admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:56.410527 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85becb2-63aa-454f-b850-fab8732ef10e admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:56.415077 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a48f22-a5a6-4dec-b240-e34ac5770afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:56.415991 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a48f22-a5a6-4dec-b240-e34ac5770afa admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:56.416306 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a48f22-a5a6-4dec-b240-e34ac5770afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:56.416588 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a48f22-a5a6-4dec-b240-e34ac5770afa admin admin] PATH_INFO: `/v3/projects/ae6446dd17404f688c514bf841289155/users/b4ba0653754f4cefa564c25e1a5f1e70/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:56.432582 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a48f22-a5a6-4dec-b240-e34ac5770afa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae6446dd17404f688c514bf841289155, user_id=b4ba0653754f4cefa564c25e1a5f1e70, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:56.435257 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a48f22-a5a6-4dec-b240-e34ac5770afa admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:56.540190 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1429/2852] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:45:56 2022] PUT /identity/v3/projects/ae6446dd17404f688c514bf841289155/users/b4ba0653754f4cefa564c25e1a5f1e70/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:45:56.551819 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f3bf4-28b7-4fc3-9e79-0a9b4e35282a None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:56.552188 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f3bf4-28b7-4fc3-9e79-0a9b4e35282a None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:56.552561 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f3bf4-28b7-4fc3-9e79-0a9b4e35282a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:56.581554 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-459f3bf4-28b7-4fc3-9e79-0a9b4e35282a None None] MFA Rules not processed for user `b4ba0653754f4cefa564c25e1a5f1e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:45:56.582774 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-459f3bf4-28b7-4fc3-9e79-0a9b4e35282a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:56.649136 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1424/2853] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:45:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:45:56.653834 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a48f22-a5a6-4dec-b240-e34ac5770afa admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:56.717130 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a48f22-a5a6-4dec-b240-e34ac5770afa admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:56.721782 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2191f-59d0-4c53-b125-bb11ce58983c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:56.722469 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2191f-59d0-4c53-b125-bb11ce58983c admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:56.722756 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2191f-59d0-4c53-b125-bb11ce58983c admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:56.723023 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2191f-59d0-4c53-b125-bb11ce58983c admin admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:56.723961 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c2191f-59d0-4c53-b125-bb11ce58983c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:56.725985 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c2191f-59d0-4c53-b125-bb11ce58983c admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:56.821904 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1430/2854] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:45:56 2022] POST /identity/v3/projects => generated 377 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:45:56.825764 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f3bf4-28b7-4fc3-9e79-0a9b4e35282a None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:56.836389 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f3bf4-28b7-4fc3-9e79-0a9b4e35282a None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:56.861550 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:45:56.898621 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a65484-9b8e-4952-86cc-bb2c662ea26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:56.899393 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a65484-9b8e-4952-86cc-bb2c662ea26f admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:56.899600 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a65484-9b8e-4952-86cc-bb2c662ea26f admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:56.899869 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a65484-9b8e-4952-86cc-bb2c662ea26f admin admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:56.900584 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a65484-9b8e-4952-86cc-bb2c662ea26f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:56.902494 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a65484-9b8e-4952-86cc-bb2c662ea26f admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:57.001559 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1425/2855] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:45:56 2022] POST /identity/v3/users => generated 289 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 09:45:57.005486 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2191f-59d0-4c53-b125-bb11ce58983c admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:57.016817 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2191f-59d0-4c53-b125-bb11ce58983c admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:57.021544 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba7a28-80b2-4382-8f6c-58dcd94f8c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:57.022847 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba7a28-80b2-4382-8f6c-58dcd94f8c7e admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:57.023125 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba7a28-80b2-4382-8f6c-58dcd94f8c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:57.023400 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba7a28-80b2-4382-8f6c-58dcd94f8c7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:57.024221 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba7a28-80b2-4382-8f6c-58dcd94f8c7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:57.025819 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba7a28-80b2-4382-8f6c-58dcd94f8c7e admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:57.037399 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1431/2856] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:45:57.041582 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a65484-9b8e-4952-86cc-bb2c662ea26f admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:57.051707 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a65484-9b8e-4952-86cc-bb2c662ea26f admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:57.056546 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5819097-68b0-41c8-9100-dcc79c207beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:57.057218 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5819097-68b0-41c8-9100-dcc79c207beb admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:57.057499 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5819097-68b0-41c8-9100-dcc79c207beb admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:57.058072 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5819097-68b0-41c8-9100-dcc79c207beb admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:57.058504 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5819097-68b0-41c8-9100-dcc79c207beb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:57.060092 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5819097-68b0-41c8-9100-dcc79c207beb admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:57.070980 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1426/2857] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:45:57.075146 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba7a28-80b2-4382-8f6c-58dcd94f8c7e admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:57.086066 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba7a28-80b2-4382-8f6c-58dcd94f8c7e admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:57.091143 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb35c3-6ece-4196-87af-50094a40b5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:57.092059 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb35c3-6ece-4196-87af-50094a40b5a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:57.092384 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb35c3-6ece-4196-87af-50094a40b5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:57.092658 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb35c3-6ece-4196-87af-50094a40b5a8 admin admin] PATH_INFO: `/v3/projects/13d4c1f9add94a4f8e241f7ebc6a3df5/users/6369c253a2d447bd883a81d7a3852ecf/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:57.108066 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb35c3-6ece-4196-87af-50094a40b5a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13d4c1f9add94a4f8e241f7ebc6a3df5, user_id=6369c253a2d447bd883a81d7a3852ecf, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:57.111187 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb35c3-6ece-4196-87af-50094a40b5a8 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:57.221120 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1432/2858] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:45:57 2022] PUT /identity/v3/projects/13d4c1f9add94a4f8e241f7ebc6a3df5/users/6369c253a2d447bd883a81d7a3852ecf/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:45:57.231496 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71709a05-1ae4-43f5-9480-7b4dbdcceea9 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:57.231783 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71709a05-1ae4-43f5-9480-7b4dbdcceea9 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:57.232085 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71709a05-1ae4-43f5-9480-7b4dbdcceea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:57.259034 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-71709a05-1ae4-43f5-9480-7b4dbdcceea9 None None] MFA Rules not processed for user `6369c253a2d447bd883a81d7a3852ecf`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:45:57.260269 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-71709a05-1ae4-43f5-9480-7b4dbdcceea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:57.323475 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1427/2859] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:45:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:45:57.328120 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb35c3-6ece-4196-87af-50094a40b5a8 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:57.366900 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:45:57.389220 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb35c3-6ece-4196-87af-50094a40b5a8 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:57.393888 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117ba85-74e6-4b7e-85c4-5656ffb9304b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:57.394532 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117ba85-74e6-4b7e-85c4-5656ffb9304b admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:57.394816 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117ba85-74e6-4b7e-85c4-5656ffb9304b admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:57.395094 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117ba85-74e6-4b7e-85c4-5656ffb9304b admin admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:57.395774 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5117ba85-74e6-4b7e-85c4-5656ffb9304b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:57.397701 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5117ba85-74e6-4b7e-85c4-5656ffb9304b admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:57.497432 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1433/2860] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:45:57 2022] POST /identity/v3/projects => generated 375 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:45:57.501594 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71709a05-1ae4-43f5-9480-7b4dbdcceea9 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:57.516846 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71709a05-1ae4-43f5-9480-7b4dbdcceea9 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:57.575257 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2639b0a0-5f44-4160-8c0f-a7d549beaa98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:57.575917 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639b0a0-5f44-4160-8c0f-a7d549beaa98 admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:57.576651 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639b0a0-5f44-4160-8c0f-a7d549beaa98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:57.576651 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639b0a0-5f44-4160-8c0f-a7d549beaa98 admin admin] PATH_INFO: `/v3/users` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:57.577149 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2639b0a0-5f44-4160-8c0f-a7d549beaa98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:57.579085 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2639b0a0-5f44-4160-8c0f-a7d549beaa98 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:57.654117 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1428/2861] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:45:57 2022] POST /identity/v3/users => generated 294 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:45:57.658137 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117ba85-74e6-4b7e-85c4-5656ffb9304b admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:57.669149 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117ba85-74e6-4b7e-85c4-5656ffb9304b admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:57.673725 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2db9c-a366-4fb3-acf5-5781192d04ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:57.674373 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2db9c-a366-4fb3-acf5-5781192d04ae admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:57.674651 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2db9c-a366-4fb3-acf5-5781192d04ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:57.674924 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2db9c-a366-4fb3-acf5-5781192d04ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:57.675643 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e2db9c-a366-4fb3-acf5-5781192d04ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:57.677271 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e2db9c-a366-4fb3-acf5-5781192d04ae admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:57.688348 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1434/2862] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:45:57.692369 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2639b0a0-5f44-4160-8c0f-a7d549beaa98 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:57.702391 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2639b0a0-5f44-4160-8c0f-a7d549beaa98 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:57.707023 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44837b82-e283-4d16-b7ad-e1f018c50997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:57.707901 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44837b82-e283-4d16-b7ad-e1f018c50997 admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:57.708180 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44837b82-e283-4d16-b7ad-e1f018c50997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:57.708480 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44837b82-e283-4d16-b7ad-e1f018c50997 admin admin] PATH_INFO: `/v3/projects/04eecdaebf8e4cfda228c6b27818aac6/users/2843e4e19a154767bc8616e49c12de96/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:57.724620 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44837b82-e283-4d16-b7ad-e1f018c50997 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04eecdaebf8e4cfda228c6b27818aac6, user_id=2843e4e19a154767bc8616e49c12de96, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:57.727748 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44837b82-e283-4d16-b7ad-e1f018c50997 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:57.808176 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:45:57.813035 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1429/2863] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:45:57 2022] PUT /identity/v3/projects/04eecdaebf8e4cfda228c6b27818aac6/users/2843e4e19a154767bc8616e49c12de96/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:45:57.817058 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2db9c-a366-4fb3-acf5-5781192d04ae admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:57.827781 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2db9c-a366-4fb3-acf5-5781192d04ae admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:57.883067 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045fc908-c225-4ccc-8642-48b7617fd181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:57.883720 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045fc908-c225-4ccc-8642-48b7617fd181 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:57.884002 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045fc908-c225-4ccc-8642-48b7617fd181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:57.884304 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045fc908-c225-4ccc-8642-48b7617fd181 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:57.885020 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045fc908-c225-4ccc-8642-48b7617fd181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:57.886598 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045fc908-c225-4ccc-8642-48b7617fd181 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:57.896322 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1435/2864] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:45:57.900413 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44837b82-e283-4d16-b7ad-e1f018c50997 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:57.910575 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44837b82-e283-4d16-b7ad-e1f018c50997 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:57.916100 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40702f40-958f-415b-899a-06df66c030e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:57.919828 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40702f40-958f-415b-899a-06df66c030e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:57.919828 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40702f40-958f-415b-899a-06df66c030e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:57.919828 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40702f40-958f-415b-899a-06df66c030e5 admin admin] PATH_INFO: `/v3/projects/04eecdaebf8e4cfda228c6b27818aac6/users/2843e4e19a154767bc8616e49c12de96/roles/91c77942515d45f1ad8189c9fddf4424` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:57.919828 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40702f40-958f-415b-899a-06df66c030e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04eecdaebf8e4cfda228c6b27818aac6, user_id=2843e4e19a154767bc8616e49c12de96, role_id=91c77942515d45f1ad8189c9fddf4424)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:57.922135 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40702f40-958f-415b-899a-06df66c030e5 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:57.933011 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1430/2865] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:45:57 2022] PUT /identity/v3/projects/04eecdaebf8e4cfda228c6b27818aac6/users/2843e4e19a154767bc8616e49c12de96/roles/91c77942515d45f1ad8189c9fddf4424 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:45:57.944343 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6657b7-ccd8-43ba-ae25-a6dc2d91a2f6 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:57.944638 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6657b7-ccd8-43ba-ae25-a6dc2d91a2f6 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:57.944920 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6657b7-ccd8-43ba-ae25-a6dc2d91a2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:57.971611 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-8f6657b7-ccd8-43ba-ae25-a6dc2d91a2f6 None None] MFA Rules not processed for user `2843e4e19a154767bc8616e49c12de96`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:45:57.977122 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-8f6657b7-ccd8-43ba-ae25-a6dc2d91a2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:58.040325 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1436/2866] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:45:57 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:45:58.051541 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40702f40-958f-415b-899a-06df66c030e5 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:45:58.053248 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-40702f40-958f-415b-899a-06df66c030e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:45:58.111868 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40702f40-958f-415b-899a-06df66c030e5 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:45:58.115519 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84232ef6-d6d6-461e-adcf-eff18897ade9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:45:58.116164 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84232ef6-d6d6-461e-adcf-eff18897ade9 service cinder] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:45:58.116469 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84232ef6-d6d6-461e-adcf-eff18897ade9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:45:58.116734 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84232ef6-d6d6-461e-adcf-eff18897ade9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:45:58.171727 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84232ef6-d6d6-461e-adcf-eff18897ade9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:45:58.173225 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84232ef6-d6d6-461e-adcf-eff18897ade9 service cinder] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:45:58.181984 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1431/2867] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:45:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:46:00.123255 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6657b7-ccd8-43ba-ae25-a6dc2d91a2f6 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:46:00.124704 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-8f6657b7-ccd8-43ba-ae25-a6dc2d91a2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:46:00.137105 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6657b7-ccd8-43ba-ae25-a6dc2d91a2f6 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:46:00.141078 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a6f94-3dae-44e9-8180-a486673b32b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:46:00.141714 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a6f94-3dae-44e9-8180-a486673b32b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:46:00.141997 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a6f94-3dae-44e9-8180-a486673b32b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:46:00.142270 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a6f94-3dae-44e9-8180-a486673b32b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:46:00.171533 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:46:00.199290 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a6f94-3dae-44e9-8180-a486673b32b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:46:00.200768 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a6f94-3dae-44e9-8180-a486673b32b8 service cinder] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:46:00.210039 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1437/2868] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:46:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:46:01.827350 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84232ef6-d6d6-461e-adcf-eff18897ade9 service cinder] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:46:01.836415 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84232ef6-d6d6-461e-adcf-eff18897ade9 service cinder] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:46:01.839969 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7942db9-6f76-4c39-90f6-16787509553c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:46:01.840632 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7942db9-6f76-4c39-90f6-16787509553c service cinder] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:46:01.840914 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7942db9-6f76-4c39-90f6-16787509553c service cinder] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:46:01.841187 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7942db9-6f76-4c39-90f6-16787509553c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:46:01.851174 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7942db9-6f76-4c39-90f6-16787509553c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:46:01.852616 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7942db9-6f76-4c39-90f6-16787509553c service cinder] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:46:01.861975 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1432/2869] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:46:01 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:46:06.347535 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a6f94-3dae-44e9-8180-a486673b32b8 service cinder] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:46:06.410067 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a6f94-3dae-44e9-8180-a486673b32b8 service cinder] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:46:06.414965 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f74ee-17cc-46a6-9eca-5cc16918fda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:46:06.415833 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f74ee-17cc-46a6-9eca-5cc16918fda1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:46:06.416110 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f74ee-17cc-46a6-9eca-5cc16918fda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:46:06.416408 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f74ee-17cc-46a6-9eca-5cc16918fda1 admin admin] PATH_INFO: `/v3/users/b4ba0653754f4cefa564c25e1a5f1e70` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:46:06.417590 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1f74ee-17cc-46a6-9eca-5cc16918fda1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4ba0653754f4cefa564c25e1a5f1e70)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:46:06.419492 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1f74ee-17cc-46a6-9eca-5cc16918fda1 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:46:06.643051 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-4b1f74ee-17cc-46a6-9eca-5cc16918fda1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4ba0653754f4cefa564c25e1a5f1e70'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:46:06.650943 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-4b1f74ee-17cc-46a6-9eca-5cc16918fda1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4ba0653754f4cefa564c25e1a5f1e70'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:46:06.727350 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-4b1f74ee-17cc-46a6-9eca-5cc16918fda1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4ba0653754f4cefa564c25e1a5f1e70'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:46:06.728001 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-4b1f74ee-17cc-46a6-9eca-5cc16918fda1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4ba0653754f4cefa564c25e1a5f1e70'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:46:06.740425 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-4b1f74ee-17cc-46a6-9eca-5cc16918fda1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4ba0653754f4cefa564c25e1a5f1e70'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:46:06.746383 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1438/2870] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:46:06 2022] DELETE /identity/v3/users/b4ba0653754f4cefa564c25e1a5f1e70 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:46:06.750971 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64d3de-e1f3-4543-a47a-d0adc4ce51e0 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:46:06.751463 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64d3de-e1f3-4543-a47a-d0adc4ce51e0 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:46:06.751573 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64d3de-e1f3-4543-a47a-d0adc4ce51e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:46:06.769845 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-de64d3de-e1f3-4543-a47a-d0adc4ce51e0 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:46:06.771047 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-de64d3de-e1f3-4543-a47a-d0adc4ce51e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:46:06.828891 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1433/2871] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:46:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:46:06.839095 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f74ee-17cc-46a6-9eca-5cc16918fda1 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:46:06.840532 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-4b1f74ee-17cc-46a6-9eca-5cc16918fda1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:46:06.893844 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:46:06.898659 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f74ee-17cc-46a6-9eca-5cc16918fda1 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:46:06.902361 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff816a-d4d0-44ab-87e5-757918665745 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:46:06.902998 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff816a-d4d0-44ab-87e5-757918665745 service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:46:06.903279 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff816a-d4d0-44ab-87e5-757918665745 service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:46:06.903554 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff816a-d4d0-44ab-87e5-757918665745 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:46:06.912660 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff816a-d4d0-44ab-87e5-757918665745 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:46:06.914084 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff816a-d4d0-44ab-87e5-757918665745 service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:46:06.923370 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1439/2872] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:46:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:46:07.334890 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64d3de-e1f3-4543-a47a-d0adc4ce51e0 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:46:07.336376 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-de64d3de-e1f3-4543-a47a-d0adc4ce51e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:46:07.350755 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64d3de-e1f3-4543-a47a-d0adc4ce51e0 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:46:07.354184 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99470d60-d85b-4d58-9385-06f9812dd3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:46:07.355146 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99470d60-d85b-4d58-9385-06f9812dd3b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:46:07.355423 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99470d60-d85b-4d58-9385-06f9812dd3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:46:07.355700 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99470d60-d85b-4d58-9385-06f9812dd3b1 admin admin] PATH_INFO: `/v3/projects/ae6446dd17404f688c514bf841289155` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:46:07.356946 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99470d60-d85b-4d58-9385-06f9812dd3b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae6446dd17404f688c514bf841289155)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:46:07.358899 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99470d60-d85b-4d58-9385-06f9812dd3b1 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:46:07.385442 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:46:07.471447 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-99470d60-d85b-4d58-9385-06f9812dd3b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae6446dd17404f688c514bf841289155', 'request_id': 'req-99470d60-d85b-4d58-9385-06f9812dd3b1'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:46:07.561877 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-99470d60-d85b-4d58-9385-06f9812dd3b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae6446dd17404f688c514bf841289155', 'request_id': 'req-99470d60-d85b-4d58-9385-06f9812dd3b1'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:46:07.568074 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-99470d60-d85b-4d58-9385-06f9812dd3b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae6446dd17404f688c514bf841289155', 'request_id': 'req-99470d60-d85b-4d58-9385-06f9812dd3b1'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:46:07.579450 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-99470d60-d85b-4d58-9385-06f9812dd3b1 admin admin] The token cache is being invalidate because project ae6446dd17404f688c514bf841289155 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:46:07.579677 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-99470d60-d85b-4d58-9385-06f9812dd3b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:46:07.580930 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-99470d60-d85b-4d58-9385-06f9812dd3b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:46:07.582527 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1434/2873] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:46:07 2022] DELETE /identity/v3/projects/ae6446dd17404f688c514bf841289155 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:46:07.586578 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff816a-d4d0-44ab-87e5-757918665745 service neutron] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:46:07.596380 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff816a-d4d0-44ab-87e5-757918665745 service neutron] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:46:07.654714 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2bc31e-f8c8-40a4-b600-22ea04bbf986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:46:07.655576 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2bc31e-f8c8-40a4-b600-22ea04bbf986 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:46:07.655852 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2bc31e-f8c8-40a4-b600-22ea04bbf986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:46:07.656129 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2bc31e-f8c8-40a4-b600-22ea04bbf986 admin admin] PATH_INFO: `/v3/users/6369c253a2d447bd883a81d7a3852ecf` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:46:07.657332 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2bc31e-f8c8-40a4-b600-22ea04bbf986 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6369c253a2d447bd883a81d7a3852ecf)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:46:07.659237 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2bc31e-f8c8-40a4-b600-22ea04bbf986 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:46:07.850568 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-ca2bc31e-f8c8-40a4-b600-22ea04bbf986 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6369c253a2d447bd883a81d7a3852ecf'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:46:07.862805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-ca2bc31e-f8c8-40a4-b600-22ea04bbf986 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6369c253a2d447bd883a81d7a3852ecf'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:46:07.943546 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-ca2bc31e-f8c8-40a4-b600-22ea04bbf986 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6369c253a2d447bd883a81d7a3852ecf'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:46:07.944174 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-ca2bc31e-f8c8-40a4-b600-22ea04bbf986 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6369c253a2d447bd883a81d7a3852ecf'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:46:07.957072 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-ca2bc31e-f8c8-40a4-b600-22ea04bbf986 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6369c253a2d447bd883a81d7a3852ecf'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:46:07.963541 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1440/2874] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:46:07 2022] DELETE /identity/v3/users/6369c253a2d447bd883a81d7a3852ecf => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 09:46:08.371400 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99470d60-d85b-4d58-9385-06f9812dd3b1 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:46:08.374169 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-99470d60-d85b-4d58-9385-06f9812dd3b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:46:08.388228 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99470d60-d85b-4d58-9385-06f9812dd3b1 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:46:08.449805 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74120b57-1850-407d-a70b-3da01f2dd493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:46:08.450669 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74120b57-1850-407d-a70b-3da01f2dd493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:46:08.450951 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74120b57-1850-407d-a70b-3da01f2dd493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:46:08.451227 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74120b57-1850-407d-a70b-3da01f2dd493 admin admin] PATH_INFO: `/v3/projects/13d4c1f9add94a4f8e241f7ebc6a3df5` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:46:08.452438 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74120b57-1850-407d-a70b-3da01f2dd493 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13d4c1f9add94a4f8e241f7ebc6a3df5)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:46:08.454344 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74120b57-1850-407d-a70b-3da01f2dd493 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:46:08.606744 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-74120b57-1850-407d-a70b-3da01f2dd493 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13d4c1f9add94a4f8e241f7ebc6a3df5', 'request_id': 'req-74120b57-1850-407d-a70b-3da01f2dd493'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:46:08.733424 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-74120b57-1850-407d-a70b-3da01f2dd493 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13d4c1f9add94a4f8e241f7ebc6a3df5', 'request_id': 'req-74120b57-1850-407d-a70b-3da01f2dd493'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:46:08.739653 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-74120b57-1850-407d-a70b-3da01f2dd493 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13d4c1f9add94a4f8e241f7ebc6a3df5', 'request_id': 'req-74120b57-1850-407d-a70b-3da01f2dd493'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:46:08.752002 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-74120b57-1850-407d-a70b-3da01f2dd493 admin admin] The token cache is being invalidate because project 13d4c1f9add94a4f8e241f7ebc6a3df5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:46:08.752313 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-74120b57-1850-407d-a70b-3da01f2dd493 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:46:08.753032 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-74120b57-1850-407d-a70b-3da01f2dd493 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:46:08.754581 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1435/2875] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:46:08 2022] DELETE /identity/v3/projects/13d4c1f9add94a4f8e241f7ebc6a3df5 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:46:08.759352 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2bc31e-f8c8-40a4-b600-22ea04bbf986 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:46:08.760985 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-ca2bc31e-f8c8-40a4-b600-22ea04bbf986 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:46:08.773663 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2bc31e-f8c8-40a4-b600-22ea04bbf986 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:46:08.830016 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87caf04-8f07-499c-9364-84a43aaa9d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:46:08.830883 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87caf04-8f07-499c-9364-84a43aaa9d24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:46:08.831165 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87caf04-8f07-499c-9364-84a43aaa9d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:46:08.831439 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87caf04-8f07-499c-9364-84a43aaa9d24 admin admin] PATH_INFO: `/v3/users/2843e4e19a154767bc8616e49c12de96` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:46:08.832659 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87caf04-8f07-499c-9364-84a43aaa9d24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2843e4e19a154767bc8616e49c12de96)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:46:08.834587 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87caf04-8f07-499c-9364-84a43aaa9d24 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:46:08.846720 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:46:09.061385 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-c87caf04-8f07-499c-9364-84a43aaa9d24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2843e4e19a154767bc8616e49c12de96'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:46:09.068150 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-c87caf04-8f07-499c-9364-84a43aaa9d24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2843e4e19a154767bc8616e49c12de96'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:46:09.155954 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-c87caf04-8f07-499c-9364-84a43aaa9d24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2843e4e19a154767bc8616e49c12de96'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:46:09.156616 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-c87caf04-8f07-499c-9364-84a43aaa9d24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2843e4e19a154767bc8616e49c12de96'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:46:09.169986 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-c87caf04-8f07-499c-9364-84a43aaa9d24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2843e4e19a154767bc8616e49c12de96'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:46:09.175800 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1441/2876] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:46:08 2022] DELETE /identity/v3/users/2843e4e19a154767bc8616e49c12de96 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:46:09.550737 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74120b57-1850-407d-a70b-3da01f2dd493 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:46:09.552589 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-74120b57-1850-407d-a70b-3da01f2dd493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:46:09.564882 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74120b57-1850-407d-a70b-3da01f2dd493 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:46:09.607075 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:46:09.622720 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0613704-c768-46ef-beac-45ea220465ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:46:09.626246 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0613704-c768-46ef-beac-45ea220465ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:46:09.626246 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0613704-c768-46ef-beac-45ea220465ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:46:09.626246 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0613704-c768-46ef-beac-45ea220465ac admin admin] PATH_INFO: `/v3/projects/04eecdaebf8e4cfda228c6b27818aac6` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:46:09.626246 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0613704-c768-46ef-beac-45ea220465ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=04eecdaebf8e4cfda228c6b27818aac6)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:46:09.627291 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0613704-c768-46ef-beac-45ea220465ac admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:46:09.760924 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-e0613704-c768-46ef-beac-45ea220465ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04eecdaebf8e4cfda228c6b27818aac6', 'request_id': 'req-e0613704-c768-46ef-beac-45ea220465ac'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:46:09.835181 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-e0613704-c768-46ef-beac-45ea220465ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04eecdaebf8e4cfda228c6b27818aac6', 'request_id': 'req-e0613704-c768-46ef-beac-45ea220465ac'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:46:09.844732 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-e0613704-c768-46ef-beac-45ea220465ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04eecdaebf8e4cfda228c6b27818aac6', 'request_id': 'req-e0613704-c768-46ef-beac-45ea220465ac'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:46:09.852790 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-e0613704-c768-46ef-beac-45ea220465ac admin admin] The token cache is being invalidate because project 04eecdaebf8e4cfda228c6b27818aac6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:46:09.853074 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-e0613704-c768-46ef-beac-45ea220465ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:46:09.853705 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-e0613704-c768-46ef-beac-45ea220465ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:46:09.855257 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1436/2877] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:46:09 2022] DELETE /identity/v3/projects/04eecdaebf8e4cfda228c6b27818aac6 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:46:09.860295 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df176db-9a5a-4a27-95d2-0ef07432fa30 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:46:09.860766 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df176db-9a5a-4a27-95d2-0ef07432fa30 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:46:09.860902 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df176db-9a5a-4a27-95d2-0ef07432fa30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:46:09.879341 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-2df176db-9a5a-4a27-95d2-0ef07432fa30 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:46:09.881156 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-2df176db-9a5a-4a27-95d2-0ef07432fa30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:46:09.941156 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1442/2878] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:46:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:46:09.949574 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34ee9a-8e5d-4d15-95b3-a770e9809bc0 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:46:09.949864 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34ee9a-8e5d-4d15-95b3-a770e9809bc0 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:46:09.950141 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34ee9a-8e5d-4d15-95b3-a770e9809bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:46:09.969132 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-7e34ee9a-8e5d-4d15-95b3-a770e9809bc0 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:46:09.970474 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-7e34ee9a-8e5d-4d15-95b3-a770e9809bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:46:09.978970 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1437/2879] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:46:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:46:09.983170 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df176db-9a5a-4a27-95d2-0ef07432fa30 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:46:09.993774 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df176db-9a5a-4a27-95d2-0ef07432fa30 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:46:09.998471 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d760c-0af3-430d-9a1a-fd74886ca831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:46:09.999124 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d760c-0af3-430d-9a1a-fd74886ca831 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:46:09.999414 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d760c-0af3-430d-9a1a-fd74886ca831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:46:09.999692 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d760c-0af3-430d-9a1a-fd74886ca831 admin admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:46:10.000456 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d760c-0af3-430d-9a1a-fd74886ca831 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:46:10.000767 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d760c-0af3-430d-9a1a-fd74886ca831 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:46:10.002359 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d760c-0af3-430d-9a1a-fd74886ca831 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:46:10.014718 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1443/2880] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:46:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:46:10.019048 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34ee9a-8e5d-4d15-95b3-a770e9809bc0 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:46:10.028563 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34ee9a-8e5d-4d15-95b3-a770e9809bc0 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:46:10.033274 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fdb1f2-a527-483e-93d4-b17537872e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:46:10.033917 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdb1f2-a527-483e-93d4-b17537872e5e admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:46:10.034201 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdb1f2-a527-483e-93d4-b17537872e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:46:10.034505 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdb1f2-a527-483e-93d4-b17537872e5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:46:10.035366 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fdb1f2-a527-483e-93d4-b17537872e5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:46:10.037306 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fdb1f2-a527-483e-93d4-b17537872e5e admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:46:10.156629 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1438/2881] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:46:10 2022] POST /identity/v3/projects => generated 375 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:46:10.160789 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d760c-0af3-430d-9a1a-fd74886ca831 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:46:10.170738 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d760c-0af3-430d-9a1a-fd74886ca831 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:46:10.228414 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf0301d-688f-4c8b-b749-9e2832e2c81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:46:10.229082 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0301d-688f-4c8b-b749-9e2832e2c81b admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:46:10.229362 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0301d-688f-4c8b-b749-9e2832e2c81b admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:46:10.229636 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0301d-688f-4c8b-b749-9e2832e2c81b admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:46:10.230327 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf0301d-688f-4c8b-b749-9e2832e2c81b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:46:10.232264 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf0301d-688f-4c8b-b749-9e2832e2c81b admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:46:10.357113 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1444/2882] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:46:10 2022] POST /identity/v3/users => generated 288 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 09:46:10.361233 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fdb1f2-a527-483e-93d4-b17537872e5e admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:46:10.372348 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fdb1f2-a527-483e-93d4-b17537872e5e admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:46:10.376834 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b26ff0-08bb-431a-b2f7-a1125f4be9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:46:10.377482 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b26ff0-08bb-431a-b2f7-a1125f4be9b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:46:10.377811 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b26ff0-08bb-431a-b2f7-a1125f4be9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:46:10.378089 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b26ff0-08bb-431a-b2f7-a1125f4be9b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:46:10.378842 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b26ff0-08bb-431a-b2f7-a1125f4be9b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:46:10.380469 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b26ff0-08bb-431a-b2f7-a1125f4be9b6 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:46:10.391613 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1439/2883] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:46:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:46:10.395597 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf0301d-688f-4c8b-b749-9e2832e2c81b admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:46:10.410369 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf0301d-688f-4c8b-b749-9e2832e2c81b admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:46:10.415546 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73348016-0af1-4742-9877-362a439e34fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:46:10.416223 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73348016-0af1-4742-9877-362a439e34fa admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:46:10.416513 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73348016-0af1-4742-9877-362a439e34fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:46:10.416785 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73348016-0af1-4742-9877-362a439e34fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:46:10.417501 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73348016-0af1-4742-9877-362a439e34fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:46:10.419295 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73348016-0af1-4742-9877-362a439e34fa admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:46:10.420786 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:46:10.431630 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1445/2884] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:46:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:46:10.439762 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b26ff0-08bb-431a-b2f7-a1125f4be9b6 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:46:10.450052 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b26ff0-08bb-431a-b2f7-a1125f4be9b6 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:46:10.454618 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f9a41-4a37-417f-8a67-ed4165cd3bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:46:10.455505 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f9a41-4a37-417f-8a67-ed4165cd3bfd admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:46:10.455774 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f9a41-4a37-417f-8a67-ed4165cd3bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:46:10.456050 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f9a41-4a37-417f-8a67-ed4165cd3bfd admin admin] PATH_INFO: `/v3/projects/af3cf02bbbdb409487bd75c1cc749caf/users/63f8a50c08784a30bbcf84c893e67e7a/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:46:10.471289 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f9a41-4a37-417f-8a67-ed4165cd3bfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=af3cf02bbbdb409487bd75c1cc749caf, user_id=63f8a50c08784a30bbcf84c893e67e7a, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:46:10.474249 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f9a41-4a37-417f-8a67-ed4165cd3bfd admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:46:10.538228 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1440/2885] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:46:10 2022] PUT /identity/v3/projects/af3cf02bbbdb409487bd75c1cc749caf/users/63f8a50c08784a30bbcf84c893e67e7a/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:46:10.548405 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f84246-af0f-4cdc-9e21-ed5f09cc131b None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:46:10.548696 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f84246-af0f-4cdc-9e21-ed5f09cc131b None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:46:10.548976 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f84246-af0f-4cdc-9e21-ed5f09cc131b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:46:10.575945 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-15f84246-af0f-4cdc-9e21-ed5f09cc131b None None] MFA Rules not processed for user `63f8a50c08784a30bbcf84c893e67e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:46:10.577207 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-15f84246-af0f-4cdc-9e21-ed5f09cc131b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:46:10.640419 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1446/2886] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:46:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:46:10.650950 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f9a41-4a37-417f-8a67-ed4165cd3bfd admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:46:10.652798 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-092f9a41-4a37-417f-8a67-ed4165cd3bfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:46:10.709438 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f9a41-4a37-417f-8a67-ed4165cd3bfd admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:46:10.713037 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d26cc87-0fa6-4866-80ce-d5c2b4933eae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:46:10.713669 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26cc87-0fa6-4866-80ce-d5c2b4933eae service cinder] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:46:10.713947 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26cc87-0fa6-4866-80ce-d5c2b4933eae service cinder] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:46:10.714216 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26cc87-0fa6-4866-80ce-d5c2b4933eae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:46:10.722310 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d26cc87-0fa6-4866-80ce-d5c2b4933eae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:46:10.723976 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d26cc87-0fa6-4866-80ce-d5c2b4933eae service cinder] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:46:10.733264 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1441/2887] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:46:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:46:20.637552 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=34 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:46:20.729330 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=85,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:46:23.179922 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f84246-af0f-4cdc-9e21-ed5f09cc131b None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:46:23.269435 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f84246-af0f-4cdc-9e21-ed5f09cc131b None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:46:23.274110 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c2fa7-7549-469a-ae21-b79e6bd55666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:46:23.274981 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c2fa7-7549-469a-ae21-b79e6bd55666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:46:23.275264 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c2fa7-7549-469a-ae21-b79e6bd55666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:46:23.275570 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c2fa7-7549-469a-ae21-b79e6bd55666 admin admin] PATH_INFO: `/v3/users/63f8a50c08784a30bbcf84c893e67e7a` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:46:23.276812 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c2fa7-7549-469a-ae21-b79e6bd55666 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63f8a50c08784a30bbcf84c893e67e7a)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:46:23.278746 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c2fa7-7549-469a-ae21-b79e6bd55666 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:46:23.432724 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-ae3c2fa7-7549-469a-ae21-b79e6bd55666 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63f8a50c08784a30bbcf84c893e67e7a'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:46:23.439545 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-ae3c2fa7-7549-469a-ae21-b79e6bd55666 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63f8a50c08784a30bbcf84c893e67e7a'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:46:23.475264 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-ae3c2fa7-7549-469a-ae21-b79e6bd55666 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63f8a50c08784a30bbcf84c893e67e7a'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:46:23.475881 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-ae3c2fa7-7549-469a-ae21-b79e6bd55666 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63f8a50c08784a30bbcf84c893e67e7a'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:46:23.488616 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-ae3c2fa7-7549-469a-ae21-b79e6bd55666 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63f8a50c08784a30bbcf84c893e67e7a'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:46:23.495442 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1447/2888] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:46:23 2022] DELETE /identity/v3/users/63f8a50c08784a30bbcf84c893e67e7a => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:46:23.500048 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ff64b-f2cc-480d-bde8-0231ad234ec2 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:46:23.500588 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ff64b-f2cc-480d-bde8-0231ad234ec2 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:46:23.500898 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ff64b-f2cc-480d-bde8-0231ad234ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:46:23.531127 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-707ff64b-f2cc-480d-bde8-0231ad234ec2 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:46:23.532623 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-707ff64b-f2cc-480d-bde8-0231ad234ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:46:23.594268 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1442/2889] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:46:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:46:23.611632 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c2fa7-7549-469a-ae21-b79e6bd55666 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:46:23.613065 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-ae3c2fa7-7549-469a-ae21-b79e6bd55666 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:46:23.674510 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:46:23.689303 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c2fa7-7549-469a-ae21-b79e6bd55666 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:46:23.693091 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d3848-95f9-46c6-b1b5-7695f464045c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:46:23.693727 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d3848-95f9-46c6-b1b5-7695f464045c service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:46:23.694007 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d3848-95f9-46c6-b1b5-7695f464045c service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:46:23.694286 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d3848-95f9-46c6-b1b5-7695f464045c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:46:23.703326 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32d3848-95f9-46c6-b1b5-7695f464045c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:46:23.704790 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32d3848-95f9-46c6-b1b5-7695f464045c service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:46:23.714984 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1448/2890] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:46:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:46:24.128028 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ff64b-f2cc-480d-bde8-0231ad234ec2 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:46:24.129494 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-707ff64b-f2cc-480d-bde8-0231ad234ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:46:24.142120 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ff64b-f2cc-480d-bde8-0231ad234ec2 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:46:24.146845 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1009cf1-0f62-4436-a8c6-4d988bf37483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:46:24.147758 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1009cf1-0f62-4436-a8c6-4d988bf37483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:46:24.147980 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1009cf1-0f62-4436-a8c6-4d988bf37483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:46:24.148281 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1009cf1-0f62-4436-a8c6-4d988bf37483 admin admin] PATH_INFO: `/v3/projects/af3cf02bbbdb409487bd75c1cc749caf` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:46:24.149632 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1009cf1-0f62-4436-a8c6-4d988bf37483 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af3cf02bbbdb409487bd75c1cc749caf)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:46:24.151537 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1009cf1-0f62-4436-a8c6-4d988bf37483 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:46:24.265261 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-b1009cf1-0f62-4436-a8c6-4d988bf37483 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af3cf02bbbdb409487bd75c1cc749caf', 'request_id': 'req-b1009cf1-0f62-4436-a8c6-4d988bf37483'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:46:24.338205 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-b1009cf1-0f62-4436-a8c6-4d988bf37483 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af3cf02bbbdb409487bd75c1cc749caf', 'request_id': 'req-b1009cf1-0f62-4436-a8c6-4d988bf37483'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:46:24.344320 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-b1009cf1-0f62-4436-a8c6-4d988bf37483 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af3cf02bbbdb409487bd75c1cc749caf', 'request_id': 'req-b1009cf1-0f62-4436-a8c6-4d988bf37483'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:46:24.367923 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-b1009cf1-0f62-4436-a8c6-4d988bf37483 admin admin] The token cache is being invalidate because project af3cf02bbbdb409487bd75c1cc749caf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:46:24.368229 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-b1009cf1-0f62-4436-a8c6-4d988bf37483 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:46:24.368857 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-b1009cf1-0f62-4436-a8c6-4d988bf37483 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:46:24.370377 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1443/2891] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:46:24 2022] DELETE /identity/v3/projects/af3cf02bbbdb409487bd75c1cc749caf => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:46:24.375431 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14c7c3-758f-4f72-86f3-ceecb67a7fe7 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:46:24.375893 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14c7c3-758f-4f72-86f3-ceecb67a7fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:46:24.375990 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14c7c3-758f-4f72-86f3-ceecb67a7fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:46:24.394425 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-ac14c7c3-758f-4f72-86f3-ceecb67a7fe7 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:46:24.395604 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-ac14c7c3-758f-4f72-86f3-ceecb67a7fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:46:24.477718 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1449/2892] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:46:24.485680 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ce5bd-87f6-4a18-bcf0-9a19a7375401 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:46:24.485984 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ce5bd-87f6-4a18-bcf0-9a19a7375401 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:46:24.486258 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ce5bd-87f6-4a18-bcf0-9a19a7375401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:46:24.504611 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-242ce5bd-87f6-4a18-bcf0-9a19a7375401 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:46:24.505809 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-242ce5bd-87f6-4a18-bcf0-9a19a7375401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:46:24.513642 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1444/2893] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:46:24.518123 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac14c7c3-758f-4f72-86f3-ceecb67a7fe7 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:46:24.528177 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac14c7c3-758f-4f72-86f3-ceecb67a7fe7 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:46:24.532800 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc91ff-cd99-4741-9da5-c96c3dccbe16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:46:24.533447 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc91ff-cd99-4741-9da5-c96c3dccbe16 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:46:24.533735 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc91ff-cd99-4741-9da5-c96c3dccbe16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:46:24.534006 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc91ff-cd99-4741-9da5-c96c3dccbe16 admin admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:46:24.534725 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebc91ff-cd99-4741-9da5-c96c3dccbe16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 09:46:24.535030 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebc91ff-cd99-4741-9da5-c96c3dccbe16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:46:24.536655 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebc91ff-cd99-4741-9da5-c96c3dccbe16 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:46:24.548699 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1450/2894] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Jun 27 09:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 09:46:24.553073 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ce5bd-87f6-4a18-bcf0-9a19a7375401 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:46:24.563172 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ce5bd-87f6-4a18-bcf0-9a19a7375401 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:46:24.567739 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d4be1-43ca-4f8d-995f-92ed21ea60af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:46:24.568433 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d4be1-43ca-4f8d-995f-92ed21ea60af admin admin] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:46:24.568742 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d4be1-43ca-4f8d-995f-92ed21ea60af admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:46:24.569015 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d4be1-43ca-4f8d-995f-92ed21ea60af admin admin] PATH_INFO: `/v3/projects` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:46:24.569693 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d4be1-43ca-4f8d-995f-92ed21ea60af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:46:24.571648 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d4be1-43ca-4f8d-995f-92ed21ea60af admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:46:24.689667 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1445/2895] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Jun 27 09:46:24 2022] POST /identity/v3/projects => generated 375 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:46:24.694030 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc91ff-cd99-4741-9da5-c96c3dccbe16 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:46:24.705243 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc91ff-cd99-4741-9da5-c96c3dccbe16 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:46:24.767095 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d1da14-ca2d-4fea-ad11-9e1665026e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:46:24.767976 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1da14-ca2d-4fea-ad11-9e1665026e9e admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:46:24.768355 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1da14-ca2d-4fea-ad11-9e1665026e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:46:24.768577 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1da14-ca2d-4fea-ad11-9e1665026e9e admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:46:24.769286 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d1da14-ca2d-4fea-ad11-9e1665026e9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:46:24.771218 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d1da14-ca2d-4fea-ad11-9e1665026e9e admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:46:24.835072 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1451/2896] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Jun 27 09:46:24 2022] POST /identity/v3/users => generated 288 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 09:46:24.839704 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d4be1-43ca-4f8d-995f-92ed21ea60af admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:46:24.850942 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d4be1-43ca-4f8d-995f-92ed21ea60af admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:46:24.856491 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c205caea-a519-47cd-8dde-e2b2581d0430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:46:24.857186 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205caea-a519-47cd-8dde-e2b2581d0430 admin admin] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:46:24.857467 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205caea-a519-47cd-8dde-e2b2581d0430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:46:24.857744 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205caea-a519-47cd-8dde-e2b2581d0430 admin admin] PATH_INFO: `/v3/roles` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:46:24.858475 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c205caea-a519-47cd-8dde-e2b2581d0430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:46:24.860068 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c205caea-a519-47cd-8dde-e2b2581d0430 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:46:24.871916 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1446/2897] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:46:24.880548 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d1da14-ca2d-4fea-ad11-9e1665026e9e admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:46:24.891770 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d1da14-ca2d-4fea-ad11-9e1665026e9e admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:46:24.896633 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5a230-cb99-46da-8a56-19425a66103f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:46:24.897449 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5a230-cb99-46da-8a56-19425a66103f admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:46:24.901007 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5a230-cb99-46da-8a56-19425a66103f admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:46:24.901007 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5a230-cb99-46da-8a56-19425a66103f admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:46:24.901007 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba5a230-cb99-46da-8a56-19425a66103f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:46:24.901007 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba5a230-cb99-46da-8a56-19425a66103f admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:46:24.912306 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1452/2898] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Jun 27 09:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 09:46:24.917365 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c205caea-a519-47cd-8dde-e2b2581d0430 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:46:24.927578 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c205caea-a519-47cd-8dde-e2b2581d0430 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:46:24.932481 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e79250-0d92-4834-9cc2-31b48be6a3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:46:24.933368 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e79250-0d92-4834-9cc2-31b48be6a3a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:46:24.933855 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e79250-0d92-4834-9cc2-31b48be6a3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:46:24.934229 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e79250-0d92-4834-9cc2-31b48be6a3a4 admin admin] PATH_INFO: `/v3/projects/2c88bef87412473698678a07117850e7/users/584b6692d4a74c6a913c651d9b87d99a/roles/b1260d153ca7497eaaaa0991f053ff89` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:46:24.950178 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e79250-0d92-4834-9cc2-31b48be6a3a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c88bef87412473698678a07117850e7, user_id=584b6692d4a74c6a913c651d9b87d99a, role_id=b1260d153ca7497eaaaa0991f053ff89)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:46:24.952891 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e79250-0d92-4834-9cc2-31b48be6a3a4 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:46:25.042714 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:46:25.047534 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1447/2899] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Jun 27 09:46:24 2022] PUT /identity/v3/projects/2c88bef87412473698678a07117850e7/users/584b6692d4a74c6a913c651d9b87d99a/roles/b1260d153ca7497eaaaa0991f053ff89 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:46:25.059694 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae5442-ca52-4544-95b4-3b6fec151a2e None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:46:25.059984 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae5442-ca52-4544-95b4-3b6fec151a2e None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:46:25.060294 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae5442-ca52-4544-95b4-3b6fec151a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:46:25.092742 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-f3ae5442-ca52-4544-95b4-3b6fec151a2e None None] MFA Rules not processed for user `584b6692d4a74c6a913c651d9b87d99a`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:46:25.093971 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-f3ae5442-ca52-4544-95b4-3b6fec151a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:46:25.115936 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:46:25.169989 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1453/2900] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:46:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:46:25.181910 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e79250-0d92-4834-9cc2-31b48be6a3a4 admin admin] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:46:25.184242 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-74e79250-0d92-4834-9cc2-31b48be6a3a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:46:25.245804 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e79250-0d92-4834-9cc2-31b48be6a3a4 admin admin] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:46:25.249557 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb21260-d8c0-4293-bac2-c0b6b7a0ce77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333bceb4a90749df97595b7f38bf7ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:46:25.250201 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb21260-d8c0-4293-bac2-c0b6b7a0ce77 service cinder] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:46:25.250718 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb21260-d8c0-4293-bac2-c0b6b7a0ce77 service cinder] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:46:25.250890 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb21260-d8c0-4293-bac2-c0b6b7a0ce77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:46:25.260448 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb21260-d8c0-4293-bac2-c0b6b7a0ce77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:46:25.261956 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb21260-d8c0-4293-bac2-c0b6b7a0ce77 service cinder] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:46:25.271848 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1448/2901] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:46:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:46:27.036287 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9b3a1-811a-4faa-abb6-891161cb1cc6 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:46:27.036855 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9b3a1-811a-4faa-abb6-891161cb1cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:46:27.036855 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9b3a1-811a-4faa-abb6-891161cb1cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:46:27.054358 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-9fc9b3a1-811a-4faa-abb6-891161cb1cc6 None None] MFA Rules not processed for user `584b6692d4a74c6a913c651d9b87d99a`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:46:27.055571 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-9fc9b3a1-811a-4faa-abb6-891161cb1cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:46:27.062859 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1454/2902] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:46:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:46:27.640090 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb21260-d8c0-4293-bac2-c0b6b7a0ce77 service cinder] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:46:27.642130 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-9cb21260-d8c0-4293-bac2-c0b6b7a0ce77 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:46:27.712783 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb21260-d8c0-4293-bac2-c0b6b7a0ce77 service cinder] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:46:27.717708 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e68aa6-81fa-4938-a171-71ea6a700049 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbaf738138b40b2a06bb63934f6608c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:46:27.718345 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e68aa6-81fa-4938-a171-71ea6a700049 service placement] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:46:27.718624 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e68aa6-81fa-4938-a171-71ea6a700049 service placement] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:46:27.718896 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e68aa6-81fa-4938-a171-71ea6a700049 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:46:27.720664 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-d4e68aa6-81fa-4938-a171-71ea6a700049 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:46:27.732468 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e68aa6-81fa-4938-a171-71ea6a700049 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:46:27.734018 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e68aa6-81fa-4938-a171-71ea6a700049 service placement] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:46:27.744030 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1449/2903] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:46:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:46:31.129022 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9b3a1-811a-4faa-abb6-891161cb1cc6 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:46:31.130481 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-9fc9b3a1-811a-4faa-abb6-891161cb1cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:46:31.211752 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9b3a1-811a-4faa-abb6-891161cb1cc6 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:46:31.213950 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d911b8-4cce-4147-94fa-318752d89998 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:46:31.214600 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d911b8-4cce-4147-94fa-318752d89998 service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:46:31.214877 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d911b8-4cce-4147-94fa-318752d89998 service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:46:31.215148 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d911b8-4cce-4147-94fa-318752d89998 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:46:31.217067 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-26d911b8-4cce-4147-94fa-318752d89998 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:46:31.228483 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d911b8-4cce-4147-94fa-318752d89998 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:46:31.230573 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d911b8-4cce-4147-94fa-318752d89998 service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:46:31.239255 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1455/2904] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:46:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:46:37.739750 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=58 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:46:39.510468 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e68aa6-81fa-4938-a171-71ea6a700049 service placement] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:46:39.512065 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-d4e68aa6-81fa-4938-a171-71ea6a700049 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:46:39.586741 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e68aa6-81fa-4938-a171-71ea6a700049 service placement] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:46:39.592731 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114853d2-73bb-4070-bdb7-bd1bc6812b5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1434a85b30411c9c59cc50c3980cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:46:39.593383 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114853d2-73bb-4070-bdb7-bd1bc6812b5d service nova] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:46:39.593668 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114853d2-73bb-4070-bdb7-bd1bc6812b5d service nova] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:46:39.593942 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114853d2-73bb-4070-bdb7-bd1bc6812b5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:46:39.595754 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-114853d2-73bb-4070-bdb7-bd1bc6812b5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:46:39.609099 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114853d2-73bb-4070-bdb7-bd1bc6812b5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:46:39.610710 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114853d2-73bb-4070-bdb7-bd1bc6812b5d service nova] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:46:39.622317 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1450/2905] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:46:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:46:41.235052 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=56 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:46:46.764823 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabf0c5-7a1a-4b3a-a7a6-f45849f2b533 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:46:46.765394 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabf0c5-7a1a-4b3a-a7a6-f45849f2b533 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:46:46.765394 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabf0c5-7a1a-4b3a-a7a6-f45849f2b533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:46:46.793504 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-8cabf0c5-7a1a-4b3a-a7a6-f45849f2b533 None None] MFA Rules not processed for user `8f5d1f2327914f9fb070c6212582b6dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:46:46.794692 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-8cabf0c5-7a1a-4b3a-a7a6-f45849f2b533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:46:46.848639 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1456/2906] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Jun 27 09:46:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:46:47.010026 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114853d2-73bb-4070-bdb7-bd1bc6812b5d service nova] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:46:47.011449 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-114853d2-73bb-4070-bdb7-bd1bc6812b5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:46:47.078069 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114853d2-73bb-4070-bdb7-bd1bc6812b5d service nova] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:46:47.083073 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff24c5-55b6-4672-8334-c2a0aada0639 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5477b14dae24fd3a644c9cbd6ff85ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:46:47.083712 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff24c5-55b6-4672-8334-c2a0aada0639 service swift] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:46:47.083993 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff24c5-55b6-4672-8334-c2a0aada0639 service swift] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:46:47.084294 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff24c5-55b6-4672-8334-c2a0aada0639 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:46:47.093181 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff24c5-55b6-4672-8334-c2a0aada0639 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:46:47.094759 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff24c5-55b6-4672-8334-c2a0aada0639 service swift] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:46:47.103927 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1451/2907] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Jun 27 09:46:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 09:46:47.934193 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93b627-169b-4a8f-956e-4dc5a92b286a None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:46:47.934655 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93b627-169b-4a8f-956e-4dc5a92b286a None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:46:47.934765 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93b627-169b-4a8f-956e-4dc5a92b286a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:46:47.952985 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-7b93b627-169b-4a8f-956e-4dc5a92b286a None None] MFA Rules not processed for user `8f5d1f2327914f9fb070c6212582b6dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:46:47.954177 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-7b93b627-169b-4a8f-956e-4dc5a92b286a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:46:47.968808 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1457/2908] 10.222.0.62 () {58 vars in 967 bytes} [Mon Jun 27 09:46:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:46:47.981943 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff24c5-55b6-4672-8334-c2a0aada0639 service swift] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:46:47.992678 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff24c5-55b6-4672-8334-c2a0aada0639 service swift] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:46:47.997796 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403bf64-4e35-4bcd-a335-3452bd9ac887 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5477b14dae24fd3a644c9cbd6ff85ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:46:47.998442 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403bf64-4e35-4bcd-a335-3452bd9ac887 service swift] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:46:47.998726 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403bf64-4e35-4bcd-a335-3452bd9ac887 service swift] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:46:47.999005 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403bf64-4e35-4bcd-a335-3452bd9ac887 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:46:48.007100 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1403bf64-4e35-4bcd-a335-3452bd9ac887 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:46:48.008710 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1403bf64-4e35-4bcd-a335-3452bd9ac887 service swift] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:46:48.016875 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1452/2909] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Jun 27 09:46:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 09:46:48.564214 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a05ce-a1a6-4725-9702-c098d5b1fc5d None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:46:48.564507 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a05ce-a1a6-4725-9702-c098d5b1fc5d None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:46:48.564785 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a05ce-a1a6-4725-9702-c098d5b1fc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:46:48.583984 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-db7a05ce-a1a6-4725-9702-c098d5b1fc5d None None] MFA Rules not processed for user `8f5d1f2327914f9fb070c6212582b6dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:46:48.586111 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-db7a05ce-a1a6-4725-9702-c098d5b1fc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:46:48.595234 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1458/2910] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Jun 27 09:46:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:46:48.610491 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403bf64-4e35-4bcd-a335-3452bd9ac887 service swift] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:46:48.625786 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403bf64-4e35-4bcd-a335-3452bd9ac887 service swift] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:46:48.630849 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b7a64-2346-4eb7-9cb2-caf0e1f41d91 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5477b14dae24fd3a644c9cbd6ff85ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:46:48.631482 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b7a64-2346-4eb7-9cb2-caf0e1f41d91 service swift] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:46:48.631762 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b7a64-2346-4eb7-9cb2-caf0e1f41d91 service swift] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:46:48.632034 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b7a64-2346-4eb7-9cb2-caf0e1f41d91 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:46:48.640525 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4b7a64-2346-4eb7-9cb2-caf0e1f41d91 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:46:48.642093 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4b7a64-2346-4eb7-9cb2-caf0e1f41d91 service swift] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:46:48.650567 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1453/2911] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Jun 27 09:46:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 09:46:49.197440 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abff080-26f1-4faa-923a-7df0037dd97c None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:46:49.197900 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abff080-26f1-4faa-923a-7df0037dd97c None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:46:49.198009 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abff080-26f1-4faa-923a-7df0037dd97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:46:49.219161 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-5abff080-26f1-4faa-923a-7df0037dd97c None None] MFA Rules not processed for user `8f5d1f2327914f9fb070c6212582b6dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:46:49.220439 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-5abff080-26f1-4faa-923a-7df0037dd97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:46:49.227876 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1459/2912] 10.222.0.62 () {58 vars in 967 bytes} [Mon Jun 27 09:46:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:46:49.239723 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b7a64-2346-4eb7-9cb2-caf0e1f41d91 service swift] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:46:49.250713 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b7a64-2346-4eb7-9cb2-caf0e1f41d91 service swift] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:46:49.255628 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe000d-6177-4e28-8e23-a470e5b69fe7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5477b14dae24fd3a644c9cbd6ff85ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:46:49.256283 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe000d-6177-4e28-8e23-a470e5b69fe7 service swift] REQUEST_METHOD: `GET` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:46:49.256566 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe000d-6177-4e28-8e23-a470e5b69fe7 service swift] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:46:49.256843 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe000d-6177-4e28-8e23-a470e5b69fe7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:46:49.265407 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffe000d-6177-4e28-8e23-a470e5b69fe7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:46:49.266969 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffe000d-6177-4e28-8e23-a470e5b69fe7 service swift] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:46:49.274957 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1454/2913] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Jun 27 09:46:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 09:46:51.824247 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abff080-26f1-4faa-923a-7df0037dd97c None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:46:51.886081 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abff080-26f1-4faa-923a-7df0037dd97c None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:46:51.890562 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f802ada-470d-4064-b88d-be484de56e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:46:51.891419 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f802ada-470d-4064-b88d-be484de56e26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:46:51.891698 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f802ada-470d-4064-b88d-be484de56e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:46:51.891971 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f802ada-470d-4064-b88d-be484de56e26 admin admin] PATH_INFO: `/v3/users/584b6692d4a74c6a913c651d9b87d99a` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:46:51.893188 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f802ada-470d-4064-b88d-be484de56e26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=584b6692d4a74c6a913c651d9b87d99a)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:46:51.895108 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f802ada-470d-4064-b88d-be484de56e26 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:46:52.070974 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-9f802ada-470d-4064-b88d-be484de56e26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '584b6692d4a74c6a913c651d9b87d99a'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:46:52.078098 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-9f802ada-470d-4064-b88d-be484de56e26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '584b6692d4a74c6a913c651d9b87d99a'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:46:52.160649 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-9f802ada-470d-4064-b88d-be484de56e26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '584b6692d4a74c6a913c651d9b87d99a'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:46:52.161281 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-9f802ada-470d-4064-b88d-be484de56e26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '584b6692d4a74c6a913c651d9b87d99a'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:46:52.169587 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:46:52.174876 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-9f802ada-470d-4064-b88d-be484de56e26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '584b6692d4a74c6a913c651d9b87d99a'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:46:52.180768 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1460/2914] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Jun 27 09:46:51 2022] DELETE /identity/v3/users/584b6692d4a74c6a913c651d9b87d99a => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:46:52.186074 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869aad5-ef18-4be3-bf39-030384f55832 None None] REQUEST_METHOD: `POST` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:46:52.186577 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869aad5-ef18-4be3-bf39-030384f55832 None None] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:46:52.186678 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869aad5-ef18-4be3-bf39-030384f55832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:46:52.213323 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.auth.core [None req-7869aad5-ef18-4be3-bf39-030384f55832 None None] MFA Rules not processed for user `a46ad49f063c49cdb572468399714ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 09:46:52.214550 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-7869aad5-ef18-4be3-bf39-030384f55832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:46:52.241276 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=100 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:46:52.276046 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1455/2915] 10.222.0.62 () {58 vars in 957 bytes} [Mon Jun 27 09:46:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 09:46:52.286362 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f802ada-470d-4064-b88d-be484de56e26 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:46:52.292299 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-9f802ada-470d-4064-b88d-be484de56e26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:46:52.345061 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f802ada-470d-4064-b88d-be484de56e26 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:46:52.348883 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f3d5c5-d545-437c-9244-04cd6d7cfd8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097b991d67164cda94cc5aa24397f414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:46:52.349521 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3d5c5-d545-437c-9244-04cd6d7cfd8b service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:46:52.349805 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3d5c5-d545-437c-9244-04cd6d7cfd8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:46:52.350082 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3d5c5-d545-437c-9244-04cd6d7cfd8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:46:52.359152 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f3d5c5-d545-437c-9244-04cd6d7cfd8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:46:52.360619 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f3d5c5-d545-437c-9244-04cd6d7cfd8b service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:46:52.370659 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1461/2916] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:46:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:46:52.614755 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7869aad5-ef18-4be3-bf39-030384f55832 None None] Authenticating user token {{(pid=80306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:46:52.622348 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.fernet_utils [None req-7869aad5-ef18-4be3-bf39-030384f55832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:46:52.630505 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7869aad5-ef18-4be3-bf39-030384f55832 None None] Validating token access rules against request {{(pid=80306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:46:52.637686 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858bb36b-ab9e-44f8-8062-44d52802d744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46ad49f063c49cdb572468399714ea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22d0a8f6bf9e4c98ba20a328083165ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:46:52.639129 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858bb36b-ab9e-44f8-8062-44d52802d744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:46:52.639415 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858bb36b-ab9e-44f8-8062-44d52802d744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:46:52.639684 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858bb36b-ab9e-44f8-8062-44d52802d744 admin admin] PATH_INFO: `/v3/projects/2c88bef87412473698678a07117850e7` {{(pid=80306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:46:52.642047 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858bb36b-ab9e-44f8-8062-44d52802d744 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c88bef87412473698678a07117850e7)` {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:46:52.643959 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858bb36b-ab9e-44f8-8062-44d52802d744 admin admin] RBAC: Authorization granted {{(pid=80306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:46:52.773277 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-858bb36b-ab9e-44f8-8062-44d52802d744 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c88bef87412473698678a07117850e7', 'request_id': 'req-858bb36b-ab9e-44f8-8062-44d52802d744'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:46:52.886327 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-858bb36b-ab9e-44f8-8062-44d52802d744 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c88bef87412473698678a07117850e7', 'request_id': 'req-858bb36b-ab9e-44f8-8062-44d52802d744'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:46:52.892489 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-858bb36b-ab9e-44f8-8062-44d52802d744 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c88bef87412473698678a07117850e7', 'request_id': 'req-858bb36b-ab9e-44f8-8062-44d52802d744'} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:46:52.905144 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-858bb36b-ab9e-44f8-8062-44d52802d744 admin admin] The token cache is being invalidate because project 2c88bef87412473698678a07117850e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 09:46:52.905424 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-858bb36b-ab9e-44f8-8062-44d52802d744 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:46:52.906099 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG keystone.notifications [None req-858bb36b-ab9e-44f8-8062-44d52802d744 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 09:46:52.907778 dv-cinder-847730-1-smb devstack@keystone.service[80306]: [pid: 80306|app: 0|req: 1456/2917] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Jun 27 09:46:52 2022] DELETE /identity/v3/projects/2c88bef87412473698678a07117850e7 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 09:47:02.366071 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=30,keystone:DELETE=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:47:02.901865 dv-cinder-847730-1-smb devstack@keystone.service[80306]: DEBUG dbcounter [-] [80306] Writing DB stats keystone:SELECT=41,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:48:38.338109 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f3d5c5-d545-437c-9244-04cd6d7cfd8b service neutron] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 09:48:38.338109 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-22f3d5c5-d545-437c-9244-04cd6d7cfd8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:48:38.425656 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f3d5c5-d545-437c-9244-04cd6d7cfd8b service neutron] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 09:48:38.487831 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796a8f3-6146-4d5b-a84d-18f5fbc9f376 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbaf738138b40b2a06bb63934f6608c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba8e40538db4d89b93469b79322d20e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 09:48:38.488510 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796a8f3-6146-4d5b-a84d-18f5fbc9f376 service placement] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 09:48:38.488795 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796a8f3-6146-4d5b-a84d-18f5fbc9f376 service placement] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 09:48:38.489072 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796a8f3-6146-4d5b-a84d-18f5fbc9f376 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 09:48:38.490888 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-7796a8f3-6146-4d5b-a84d-18f5fbc9f376 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 09:48:38.502179 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7796a8f3-6146-4d5b-a84d-18f5fbc9f376 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 09:48:38.503753 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7796a8f3-6146-4d5b-a84d-18f5fbc9f376 service placement] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 09:48:38.514190 dv-cinder-847730-1-smb devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1462/2918] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Jun 27 09:48:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 09:48:48.509999 dv-cinder-847730-1-smb devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=67 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}